2024-05-08T17:09:28.681 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T17:09:28.682 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-05-08_14:59:36-rados-wip-lflores-testing-2-2024-05-07-1606-squid-distro-default-smithi/7697765 --description rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} --name lflores-2024-05-08_14:59:36-rados-wip-lflores-testing-2-2024-05-07-1606-squid-distro-default-smithi --verbose -- /home/teuthworker/archive/lflores-2024-05-08_14:59:36-rados-wip-lflores-testing-2-2024-05-07-1606-squid-distro-default-smithi/7697765/orig.config.yaml 2024-05-08T17:09:28.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T17:09:28.782 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-05-08_14:59:36-rados-wip-lflores-testing-2-2024-05-07-1606-squid-distro-default-smithi/7697765 branch: wip-lflores-testing-2-2024-05-07-1606-squid description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} email: null first_in_suite: false job_id: '7697765' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: lflores-2024-05-08_14:59:36-rados-wip-lflores-testing-2-2024-05-07-1606-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lflores-testing-2-2024-05-07-1606-squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 95a4ad3c90f2f12f920e87725ad8d9002f948722 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 95a4ad3c90f2f12f920e87725ad8d9002f948722 workunit: branch: wip-lflores-testing-2-2024-05-07-1606-squid sha1: 95a4ad3c90f2f12f920e87725ad8d9002f948722 owner: scheduled_lflores@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 8082 sha1: 95a4ad3c90f2f12f920e87725ad8d9002f948722 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-lflores-testing-2-2024-05-07-1606-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_95a4ad3c90f2f12f920e87725ad8d9002f948722/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 95a4ad3c90f2f12f920e87725ad8d9002f948722 targets: smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyVF+iwHT6XFBH2Z0kgAwJjCMcmFUrcyZMOE8SaFJvn2N+dmpacfIH2VbUQibLgZ3PO7ZfMK55ySf0h3FoCY2A= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd-backfill teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_14:59:36 tube: smithi user: lflores verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T17:09:28.782 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_95a4ad3c90f2f12f920e87725ad8d9002f948722/qa; will attempt to use it 2024-05-08T17:09:28.783 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_95a4ad3c90f2f12f920e87725ad8d9002f948722/qa/tasks 2024-05-08T17:09:28.783 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T17:09:28.785 INFO:teuthology.task.internal:Checking packages... 2024-05-08T17:09:28.808 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '95a4ad3c90f2f12f920e87725ad8d9002f948722' 2024-05-08T17:09:28.808 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T17:09:28.808 INFO:teuthology.packaging:ref: None 2024-05-08T17:09:28.808 INFO:teuthology.packaging:tag: None 2024-05-08T17:09:28.808 INFO:teuthology.packaging:branch: wip-lflores-testing-2-2024-05-07-1606-squid 2024-05-08T17:09:28.809 INFO:teuthology.packaging:sha1: 95a4ad3c90f2f12f920e87725ad8d9002f948722 2024-05-08T17:09:28.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lflores-testing-2-2024-05-07-1606-squid 2024-05-08T17:09:28.948 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2517-g95a4ad3c-1jammy 2024-05-08T17:09:28.950 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T17:09:28.957 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T17:09:28.957 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T17:09:28.972 INFO:teuthology.task.internal:Saving configuration 2024-05-08T17:09:28.983 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T17:09:28.991 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T17:09:29.017 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-05-08_14:59:36-rados-wip-lflores-testing-2-2024-05-07-1606-squid-distro-default-smithi/7697765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 17:03:55.487384', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFP7Hefe/OVAXuJUMKH076GkDWKTzlKg/+PSQxFunWPM'} 2024-05-08T17:09:29.017 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T17:09:29.025 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-05-08T17:09:29.025 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T17:09:29.069 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc763bbbf70>, signals=[15]) 2024-05-08T17:09:29.069 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T17:09:29.077 INFO:teuthology.task.internal:Opening connections... 2024-05-08T17:09:29.077 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T17:09:29.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:09:29.159 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T17:09:29.166 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-05-08T17:09:29.263 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-05-08T17:09:29.263 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-05-08T17:09:29.310 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T17:09:29.311 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2024-05-08T17:09:29.312 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-05-08T17:09:29.338 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T17:09:29.348 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T17:09:29.361 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T17:09:29.362 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-05-08T17:09:29.366 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T17:09:29.377 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T17:09:29.377 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-05-08T17:09:29.416 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T17:09:29.452 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T17:09:29.523 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T17:09:29.524 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T17:09:29.524 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T17:09:29.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T17:09:29.529 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-05-08T17:09:29.575 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-56-generic 2024-05-08T17:09:29.575 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.15.0-56-generic 2024-05-08T17:09:29.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2024-05-08T17:09:29.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-05-08T17:09:29.835 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:09:29.835 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T17:09:29.837 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T17:09:29.926 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T17:09:30.070 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T17:09:30.142 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T17:09:30.150 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T17:09:30.191 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T17:09:30.195 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T17:09:30.195 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T17:09:30.225 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T17:09:30.226 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T17:09:30.230 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:09:30.230 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T17:09:30.241 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T17:09:30.246 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T17:09:30.282 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T17:09:30.283 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T17:09:30.284 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T17:09:30.284 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T17:09:30.284 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T17:09:30.284 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T17:09:30.293 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T17:09:30.299 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T17:09:30.299 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T17:09:30.330 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T17:09:30.330 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T17:09:30.334 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:09:30.335 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T17:09:30.344 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T17:09:30.354 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T17:09:30.357 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T17:09:30.357 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T17:09:30.358 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T17:09:30.369 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T17:09:30.370 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T17:09:30.370 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T17:09:30.370 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T17:09:30.371 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T17:09:30.390 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T17:09:30.390 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T17:09:30.390 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T17:09:30.390 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T17:09:30.391 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T17:09:36.101 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 13.4 MB in 2s (7,205 kB/s) 2024-05-08T17:09:37.622 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T17:09:37.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:09:37.701 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T17:09:37.903 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-05-08T17:09:37.904 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-05-08T17:09:38.085 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:09:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:09:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:09:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:09:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T17:09:38.085 INFO:teuthology.orchestra.run.smithi117.stdout: python2.7-minimal 2024-05-08T17:09:38.086 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:09:38.086 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-05-08T17:09:38.086 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:09:38.086 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T17:09:38.087 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T17:09:38.088 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-05-08T17:09:38.088 INFO:teuthology.orchestra.run.smithi117.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T17:09:38.088 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-05-08T17:09:38.088 INFO:teuthology.orchestra.run.smithi117.stdout: thermald 2024-05-08T17:09:38.136 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-05-08T17:09:38.136 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:09:38.136 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T17:09:38.137 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T17:09:38.138 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2024-05-08T17:09:38.138 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T17:09:38.196 INFO:teuthology.orchestra.run.smithi117.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:09:38.196 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 113 MB of archives. 2024-05-08T17:09:38.196 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T17:09:38.196 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T17:09:38.724 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T17:09:38.877 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T17:09:39.932 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T17:09:39.933 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T17:09:39.933 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T17:09:40.102 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T17:09:40.147 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T17:09:40.539 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 113 MB in 2s (56.6 MB/s) 2024-05-08T17:09:40.690 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T17:09:42.671 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T17:09:42.675 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:09:42.812 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:09:44.813 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T17:09:44.834 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:09:44.913 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:09:45.341 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T17:09:45.361 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:09:45.399 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:09:51.889 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:09:52.016 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:09:52.374 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:09:52.495 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:09:52.815 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T17:09:52.837 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T17:09:52.881 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:09:58.855 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T17:09:58.891 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:09:58.929 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:10:01.491 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:10:01.614 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:10:01.955 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:10:02.078 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:10:02.211 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T17:10:02.331 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:10:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:10:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T17:10:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:10:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T17:10:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:10:05.262 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:10:07.394 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T17:10:07.520 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T17:10:07.646 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:10:07.708 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T17:10:07.708 INFO:teuthology.orchestra.run.smithi117.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:10:22.207 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T17:10:22.208 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub' 2024-05-08T17:10:22.222 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:10:22.246 INFO:teuthology.orchestra.run.smithi117.stdout:Generating grub configuration file ... 2024-05-08T17:10:22.526 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:10:22.542 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:10:22.848 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:10:22.854 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:10:22.922 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:10:22.928 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:10:23.101 INFO:teuthology.orchestra.run.smithi117.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:10:23.102 INFO:teuthology.orchestra.run.smithi117.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:10:23.102 INFO:teuthology.orchestra.run.smithi117.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:10:23.147 INFO:teuthology.orchestra.run.smithi117.stdout:done 2024-05-08T17:10:23.628 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2024-05-08T17:10:23.689 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 21 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.15.0.106.106 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2024-05-08T17:10:23.690 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:10:23.691 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2024-05-08T17:10:23.691 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T17:10:23.692 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T17:10:23.692 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T17:10:23.692 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T17:10:23.692 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T17:10:23.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2024-05-08T17:10:23.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-05-08T17:10:23.993 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:10:24.004 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T17:10:24.024 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T17:10:24.109 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T17:10:25.375 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T17:10:25.394 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:10:25.452 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T17:10:25.663 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-05-08T17:10:25.663 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-05-08T17:10:25.829 INFO:teuthology.orchestra.run.smithi117.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T17:10:25.829 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:10:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:10:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:10:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:10:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T17:10:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T17:10:25.830 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:10:25.867 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:10:25.870 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2024-05-08T17:10:25.886 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2024-05-08T17:10:25.886 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 21 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.15.0.106.106 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:10:25.887 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:10:25.888 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2024-05-08T17:10:25.888 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2024-05-08T17:10:25.888 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:10:25.888 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2024-05-08T17:10:25.888 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-05-08T17:10:25.935 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.1B4EOzCu5Z 2024-05-08T17:10:25.935 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub/grub.cfg /tmp/tmp.1B4EOzCu5Z 2024-05-08T17:10:25.990 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.1B4EOzCu5Z 2024-05-08T17:10:26.115 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.1B4EOzCu5Z is 10KB 2024-05-08T17:10:26.130 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.1B4EOzCu5Z 2024-05-08T17:10:26.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T17:10:26.190 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T17:10:26.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T17:10:26.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T17:10:26.257 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T17:10:26.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo update-grub 2024-05-08T17:10:27.446 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2024-05-08T17:10:27.447 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:10:27.449 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-05-08T17:10:27.626 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:10:27.631 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:10:27.860 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:10:27.865 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:10:27.906 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:10:27.911 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:10:28.039 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:10:28.039 INFO:teuthology.orchestra.run.smithi117.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:10:28.039 INFO:teuthology.orchestra.run.smithi117.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:10:28.055 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-05-08T17:10:28.064 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-05-08T17:10:58.090 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T17:10:58.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T17:10:58.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:11:32.643 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-05-08T17:11:41.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T17:11:41.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:12:00.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-05-08T17:12:12.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T17:12:12.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:12:12.496 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-05-08T17:12:13.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T17:12:13.378 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-08T17:12:13.378 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-05-08T17:12:13.426 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-106-generic 2024-05-08T17:12:13.427 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T17:12:13.427 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T17:12:13.427 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T17:12:14.428 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T17:12:14.428 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T17:12:14.504 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-05-08T17:12:14.544 DEBUG:teuthology.parallel:result is None 2024-05-08T17:12:14.544 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T17:12:14.552 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T17:12:14.552 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T17:12:14.558 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T17:12:14.565 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T17:12:14.575 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T17:12:14.576 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T17:12:14.618 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T17:12:14.624 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T17:12:14.625 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T17:12:14.703 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:12:14.711 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:12:14.713 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T17:12:14.721 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T17:12:14.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T17:12:14.741 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T17:12:14.754 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T17:12:14.755 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T17:12:14.787 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T17:12:14.834 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T17:12:14.882 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T17:12:14.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T17:12:14.946 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-05-08T17:12:15.084 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T17:12:15.092 INFO:teuthology.task.internal:Starting timer... 2024-05-08T17:12:15.092 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T17:12:15.105 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T17:12:15.114 DEBUG:teuthology.task.selinux:Excluding smithi117: OS 'ubuntu' does not support SELinux 2024-05-08T17:12:15.114 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T17:12:15.115 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-08T17:12:15.115 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T17:12:15.115 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T17:12:15.124 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T17:12:15.142 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T17:12:15.144 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T17:19:14.224 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-05-08T17:19:14.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T17:19:14.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:19:14.306 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-05-08T17:19:14.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T17:19:14.378 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T17:19:14.390 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T17:19:14.390 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T17:19:14.391 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T17:19:14.449 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T17:19:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Command line: ntpd -gq 2024-05-08T17:19:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: ---------------------------------------------------- 2024-05-08T17:19:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T17:19:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T17:19:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: corporation. Support and training for ntp-4 are 2024-05-08T17:19:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: available at https://www.nwtime.org/support 2024-05-08T17:19:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: ---------------------------------------------------- 2024-05-08T17:19:14.451 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: proto: precision = 0.046 usec (-24) 2024-05-08T17:19:14.451 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: basedate set to 2022-02-04 2024-05-08T17:19:14.451 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: gps base set to 2022-02-06 (week 2196) 2024-05-08T17:19:14.451 INFO:teuthology.orchestra.run.smithi117.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T17:19:14.452 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T17:19:14.452 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T17:19:14.452 INFO:teuthology.orchestra.run.smithi117.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T17:19:14.453 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T17:19:14.453 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T17:19:14.453 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T17:19:14.453 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Listen normally on 3 enp3s0f1 172.21.15.117:123 2024-05-08T17:19:14.453 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Listen normally on 4 lo [::1]:123 2024-05-08T17:19:14.453 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4463%5]:123 2024-05-08T17:19:14.453 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:14 ntpd[17255]: Listening on routing socket on fd #22 for interface updates 2024-05-08T17:19:15.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:15.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:15 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:16.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:16 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:16.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:16 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:16.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:16 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:16.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:16 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:16.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:16 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:16.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:16 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:17.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:17.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:17.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:17.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:17.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:17.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:17.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:17.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:17.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:17.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:17.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:17.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:17.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:17.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:17 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:18.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:18 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:18.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:18 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:18.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:18 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:18.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:18 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:18.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:18 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:18.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:18 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:19.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:19.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:19.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:19.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:19.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:19.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:19.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:19.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:19.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:19.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:19.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:19.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:19 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:20.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:20 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:20.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:20 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:20.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:20 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:20.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:20 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:20.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:20 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:20.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:20 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:21.450 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 17:19:21 ntpd[17255]: ntpd: time slew -0.003624 s 2024-05-08T17:19:21.451 INFO:teuthology.orchestra.run.smithi117.stdout:ntpd: time slew -0.003624s 2024-05-08T17:19:21.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T17:19:21.452 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 17:19:21 ntpd[17255]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T17:19:21.507 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T17:19:21.507 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-05-08T17:19:21.507 INFO:teuthology.orchestra.run.smithi117.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T17:19:21.507 INFO:teuthology.orchestra.run.smithi117.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T17:19:21.507 INFO:teuthology.orchestra.run.smithi117.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T17:19:21.507 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T17:19:21.507 INFO:teuthology.run_tasks:Running task install... 2024-05-08T17:19:21.516 DEBUG:teuthology.task.install:project ceph 2024-05-08T17:19:21.516 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '95a4ad3c90f2f12f920e87725ad8d9002f948722'}} 2024-05-08T17:19:21.516 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '95a4ad3c90f2f12f920e87725ad8d9002f948722'} 2024-05-08T17:19:21.516 INFO:teuthology.task.install:Using flavor: default 2024-05-08T17:19:21.522 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T17:19:21.522 INFO:teuthology.task.install:extra packages: [] 2024-05-08T17:19:21.523 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-key list | grep Ceph 2024-05-08T17:19:21.603 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T17:19:21.631 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T17:19:21.631 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T17:19:21.631 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-08T17:19:21.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95a4ad3c90f2f12f920e87725ad8d9002f948722 2024-05-08T17:19:21.871 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default/ 2024-05-08T17:19:21.871 INFO:teuthology.task.install.deb:Package version is 19.0.0-2517-g95a4ad3c-1jammy 2024-05-08T17:19:21.983 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T17:19:21.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T17:19:21.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-05-08T17:19:22.166 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:19:22.181 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T17:19:22.201 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T17:19:22.278 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T17:19:22.303 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T17:19:22.314 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T17:19:22.351 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T17:19:22.387 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-05-08T17:19:22.429 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-05-08T17:19:22.508 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 28.9 kB in 0s (85.4 kB/s) 2024-05-08T17:19:23.440 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T17:19:23.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2517-g95a4ad3c-1jammy cephadm=19.0.0-2517-g95a4ad3c-1jammy ceph-mds=19.0.0-2517-g95a4ad3c-1jammy ceph-mgr=19.0.0-2517-g95a4ad3c-1jammy ceph-common=19.0.0-2517-g95a4ad3c-1jammy ceph-fuse=19.0.0-2517-g95a4ad3c-1jammy ceph-test=19.0.0-2517-g95a4ad3c-1jammy ceph-volume=19.0.0-2517-g95a4ad3c-1jammy radosgw=19.0.0-2517-g95a4ad3c-1jammy python3-rados=19.0.0-2517-g95a4ad3c-1jammy python3-rgw=19.0.0-2517-g95a4ad3c-1jammy python3-cephfs=19.0.0-2517-g95a4ad3c-1jammy python3-rbd=19.0.0-2517-g95a4ad3c-1jammy libcephfs2=19.0.0-2517-g95a4ad3c-1jammy libcephfs-dev=19.0.0-2517-g95a4ad3c-1jammy librados2=19.0.0-2517-g95a4ad3c-1jammy librbd1=19.0.0-2517-g95a4ad3c-1jammy rbd-fuse=19.0.0-2517-g95a4ad3c-1jammy 2024-05-08T17:19:23.507 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T17:19:23.684 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-05-08T17:19:23.685 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-05-08T17:19:23.858 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:19:23.859 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:19:23.859 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:19:23.859 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:19:23.859 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T17:19:23.859 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T17:19:23.859 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:19:23.860 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-05-08T17:19:23.860 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T17:19:23.860 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T17:19:23.861 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-08T17:19:23.862 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet zip 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-05-08T17:19:23.863 INFO:teuthology.orchestra.run.smithi117.stdout: btrfs-tools 2024-05-08T17:19:23.961 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-05-08T17:19:23.961 INFO:teuthology.orchestra.run.smithi117.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T17:19:23.961 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T17:19:23.961 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-08T17:19:23.961 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-08T17:19:23.961 INFO:teuthology.orchestra.run.smithi117.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-08T17:19:23.961 INFO:teuthology.orchestra.run.smithi117.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-08T17:19:23.962 INFO:teuthology.orchestra.run.smithi117.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-08T17:19:23.962 INFO:teuthology.orchestra.run.smithi117.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-08T17:19:23.962 INFO:teuthology.orchestra.run.smithi117.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-08T17:19:23.962 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-08T17:19:23.963 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-08T17:19:23.964 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-08T17:19:23.964 INFO:teuthology.orchestra.run.smithi117.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-08T17:19:24.030 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T17:19:24.030 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 180 MB of archives. 2024-05-08T17:19:24.031 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 822 MB of additional disk space will be used. 2024-05-08T17:19:24.031 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T17:19:24.139 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T17:19:24.142 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T17:19:24.162 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T17:19:24.183 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2517-g95a4ad3c-1jammy [3,546 kB] 2024-05-08T17:19:24.234 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T17:19:24.240 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T17:19:24.255 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T17:19:24.260 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T17:19:24.260 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T17:19:24.261 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T17:19:24.271 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-08T17:19:24.273 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-08T17:19:24.276 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-08T17:19:24.277 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-08T17:19:24.282 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-08T17:19:24.285 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-08T17:19:24.287 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-08T17:19:24.302 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T17:19:24.303 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T17:19:24.303 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T17:19:24.305 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T17:19:24.305 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T17:19:24.305 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T17:19:24.306 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T17:19:24.323 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T17:19:24.324 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T17:19:24.324 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T17:19:24.345 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T17:19:24.346 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T17:19:24.347 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T17:19:24.347 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T17:19:24.348 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T17:19:24.348 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T17:19:24.349 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T17:19:24.366 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T17:19:24.367 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T17:19:24.367 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T17:19:24.387 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T17:19:24.387 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T17:19:24.387 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T17:19:24.388 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T17:19:24.389 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T17:19:24.392 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T17:19:24.393 INFO:teuthology.orchestra.run.smithi117.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T17:19:24.407 INFO:teuthology.orchestra.run.smithi117.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T17:19:24.408 INFO:teuthology.orchestra.run.smithi117.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T17:19:24.411 INFO:teuthology.orchestra.run.smithi117.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T17:19:24.428 INFO:teuthology.orchestra.run.smithi117.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T17:19:24.428 INFO:teuthology.orchestra.run.smithi117.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T17:19:24.431 INFO:teuthology.orchestra.run.smithi117.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T17:19:24.488 INFO:teuthology.orchestra.run.smithi117.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T17:19:24.489 INFO:teuthology.orchestra.run.smithi117.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T17:19:24.490 INFO:teuthology.orchestra.run.smithi117.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T17:19:24.491 INFO:teuthology.orchestra.run.smithi117.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T17:19:24.492 INFO:teuthology.orchestra.run.smithi117.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T17:19:24.516 INFO:teuthology.orchestra.run.smithi117.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T17:19:24.518 INFO:teuthology.orchestra.run.smithi117.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T17:19:24.518 INFO:teuthology.orchestra.run.smithi117.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T17:19:24.537 INFO:teuthology.orchestra.run.smithi117.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T17:19:24.538 INFO:teuthology.orchestra.run.smithi117.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T17:19:24.538 INFO:teuthology.orchestra.run.smithi117.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T17:19:24.549 INFO:teuthology.orchestra.run.smithi117.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2517-g95a4ad3c-1jammy [3,216 kB] 2024-05-08T17:19:24.550 INFO:teuthology.orchestra.run.smithi117.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T17:19:24.551 INFO:teuthology.orchestra.run.smithi117.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T17:19:24.552 INFO:teuthology.orchestra.run.smithi117.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T17:19:24.552 INFO:teuthology.orchestra.run.smithi117.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T17:19:24.553 INFO:teuthology.orchestra.run.smithi117.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T17:19:24.556 INFO:teuthology.orchestra.run.smithi117.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T17:19:24.571 INFO:teuthology.orchestra.run.smithi117.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T17:19:24.572 INFO:teuthology.orchestra.run.smithi117.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T17:19:24.573 INFO:teuthology.orchestra.run.smithi117.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T17:19:24.577 INFO:teuthology.orchestra.run.smithi117.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T17:19:24.598 INFO:teuthology.orchestra.run.smithi117.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-08T17:19:24.599 INFO:teuthology.orchestra.run.smithi117.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-08T17:19:24.600 INFO:teuthology.orchestra.run.smithi117.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T17:19:24.605 INFO:teuthology.orchestra.run.smithi117.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-08T17:19:24.605 INFO:teuthology.orchestra.run.smithi117.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T17:19:24.609 INFO:teuthology.orchestra.run.smithi117.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T17:19:24.622 INFO:teuthology.orchestra.run.smithi117.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T17:19:24.622 INFO:teuthology.orchestra.run.smithi117.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T17:19:24.623 INFO:teuthology.orchestra.run.smithi117.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T17:19:24.624 INFO:teuthology.orchestra.run.smithi117.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T17:19:24.645 INFO:teuthology.orchestra.run.smithi117.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T17:19:24.657 INFO:teuthology.orchestra.run.smithi117.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T17:19:24.658 INFO:teuthology.orchestra.run.smithi117.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T17:19:24.658 INFO:teuthology.orchestra.run.smithi117.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T17:19:24.662 INFO:teuthology.orchestra.run.smithi117.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T17:19:24.663 INFO:teuthology.orchestra.run.smithi117.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T17:19:24.719 INFO:teuthology.orchestra.run.smithi117.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2517-g95a4ad3c-1jammy [711 kB] 2024-05-08T17:19:24.749 INFO:teuthology.orchestra.run.smithi117.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2517-g95a4ad3c-1jammy [356 kB] 2024-05-08T17:19:24.757 INFO:teuthology.orchestra.run.smithi117.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2517-g95a4ad3c-1jammy [32.8 kB] 2024-05-08T17:19:24.759 INFO:teuthology.orchestra.run.smithi117.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2517-g95a4ad3c-1jammy [180 kB] 2024-05-08T17:19:24.766 INFO:teuthology.orchestra.run.smithi117.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2517-g95a4ad3c-1jammy [67.1 kB] 2024-05-08T17:19:24.776 INFO:teuthology.orchestra.run.smithi117.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2517-g95a4ad3c-1jammy [330 kB] 2024-05-08T17:19:24.787 INFO:teuthology.orchestra.run.smithi117.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2517-g95a4ad3c-1jammy [6,779 kB] 2024-05-08T17:19:25.005 INFO:teuthology.orchestra.run.smithi117.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2517-g95a4ad3c-1jammy [112 kB] 2024-05-08T17:19:25.007 INFO:teuthology.orchestra.run.smithi117.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2517-g95a4ad3c-1jammy [466 kB] 2024-05-08T17:19:25.022 INFO:teuthology.orchestra.run.smithi117.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2517-g95a4ad3c-1jammy [25.6 MB] 2024-05-08T17:19:25.950 INFO:teuthology.orchestra.run.smithi117.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2517-g95a4ad3c-1jammy [5,085 kB] 2024-05-08T17:19:26.041 INFO:teuthology.orchestra.run.smithi117.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2517-g95a4ad3c-1jammy [244 kB] 2024-05-08T17:19:26.048 INFO:teuthology.orchestra.run.smithi117.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2517-g95a4ad3c-1jammy [124 kB] 2024-05-08T17:19:26.051 INFO:teuthology.orchestra.run.smithi117.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2517-g95a4ad3c-1jammy [1,526 kB] 2024-05-08T17:19:26.109 INFO:teuthology.orchestra.run.smithi117.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2517-g95a4ad3c-1jammy [6,246 kB] 2024-05-08T17:19:26.377 INFO:teuthology.orchestra.run.smithi117.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2517-g95a4ad3c-1jammy [22.7 MB] 2024-05-08T17:19:27.200 INFO:teuthology.orchestra.run.smithi117.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2517-g95a4ad3c-1jammy [14.1 kB] 2024-05-08T17:19:27.201 INFO:teuthology.orchestra.run.smithi117.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2517-g95a4ad3c-1jammy [869 kB] 2024-05-08T17:19:27.219 INFO:teuthology.orchestra.run.smithi117.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2517-g95a4ad3c-1jammy [2,437 kB] 2024-05-08T17:19:27.262 INFO:teuthology.orchestra.run.smithi117.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2517-g95a4ad3c-1jammy [791 kB] 2024-05-08T17:19:27.272 INFO:teuthology.orchestra.run.smithi117.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2517-g95a4ad3c-1jammy [148 kB] 2024-05-08T17:19:27.274 INFO:teuthology.orchestra.run.smithi117.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2517-g95a4ad3c-1jammy [2,331 kB] 2024-05-08T17:19:27.321 INFO:teuthology.orchestra.run.smithi117.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2517-g95a4ad3c-1jammy [8,625 kB] 2024-05-08T17:19:27.608 INFO:teuthology.orchestra.run.smithi117.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2517-g95a4ad3c-1jammy [14.2 kB] 2024-05-08T17:19:27.675 INFO:teuthology.orchestra.run.smithi117.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2517-g95a4ad3c-1jammy [50.7 MB] 2024-05-08T17:19:29.524 INFO:teuthology.orchestra.run.smithi117.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2517-g95a4ad3c-1jammy [121 kB] 2024-05-08T17:19:29.526 INFO:teuthology.orchestra.run.smithi117.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2517-g95a4ad3c-1jammy [38.9 kB] 2024-05-08T17:19:29.527 INFO:teuthology.orchestra.run.smithi117.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2517-g95a4ad3c-1jammy [13.4 MB] 2024-05-08T17:19:29.874 INFO:teuthology.orchestra.run.smithi117.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-lflores-testing-2-2024-05-07-1606-squid/95a4ad3c90f2f12f920e87725ad8d9002f948722/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2517-g95a4ad3c-1jammy [91.6 kB] 2024-05-08T17:19:30.429 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 180 MB in 6s (30.4 MB/s) 2024-05-08T17:19:30.531 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T17:19:30.620 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T17:19:30.625 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T17:19:30.697 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T17:19:31.017 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T17:19:31.043 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T17:19:31.083 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T17:19:31.419 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T17:19:31.446 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T17:19:31.486 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T17:19:31.856 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T17:19:31.883 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T17:19:31.922 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T17:19:32.309 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T17:19:32.336 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T17:19:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T17:19:32.714 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T17:19:32.741 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T17:19:32.781 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T17:19:33.184 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T17:19:33.210 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T17:19:33.250 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T17:19:33.570 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librados2. 2024-05-08T17:19:33.596 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../007-librados2_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:33.636 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librados2 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:34.114 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librbd1. 2024-05-08T17:19:34.140 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../008-librbd1_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:34.181 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librbd1 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:34.592 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T17:19:34.617 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:34.650 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs2 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rados. 2024-05-08T17:19:34.917 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:34.960 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rados (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:35.288 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T17:19:35.314 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2517-g95a4ad3c-1jammy_all.deb ... 2024-05-08T17:19:35.354 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-argparse (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:35.624 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T17:19:35.650 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:35.690 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cephfs (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:36.001 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T17:19:36.028 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2517-g95a4ad3c-1jammy_all.deb ... 2024-05-08T17:19:36.068 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-common (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:36.388 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T17:19:36.414 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T17:19:36.454 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T17:19:36.740 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T17:19:36.756 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T17:19:36.790 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T17:19:37.026 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T17:19:37.053 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:37.093 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rbd (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:37.437 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T17:19:37.464 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T17:19:37.504 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T17:19:37.781 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-08T17:19:37.796 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-08T17:19:38.000 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T17:19:38.359 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-08T17:19:38.375 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-08T17:19:38.409 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T17:19:38.704 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua5.1. 2024-05-08T17:19:38.730 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-08T17:19:38.771 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-08T17:19:39.082 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-any. 2024-05-08T17:19:39.108 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-08T17:19:39.149 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-08T17:19:39.393 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package zip. 2024-05-08T17:19:39.408 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-08T17:19:39.443 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking zip (3.0-12build2) ... 2024-05-08T17:19:39.704 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package unzip. 2024-05-08T17:19:39.730 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-08T17:19:39.762 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-08T17:19:40.150 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package luarocks. 2024-05-08T17:19:40.176 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-08T17:19:40.216 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-08T17:19:40.582 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librgw2. 2024-05-08T17:19:40.609 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../025-librgw2_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:40.671 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librgw2 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:41.184 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T17:19:41.199 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:41.242 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rgw (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:41.528 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T17:19:41.544 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T17:19:41.578 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T17:19:41.856 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T17:19:41.883 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:41.923 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libradosstriper1 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:42.326 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-common. 2024-05-08T17:19:42.352 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:42.392 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-common (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:43.715 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-base. 2024-05-08T17:19:43.741 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:43.790 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-base (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:44.377 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T17:19:44.400 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T17:19:44.435 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T17:19:44.671 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T17:19:44.698 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T17:19:44.738 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T17:19:45.066 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T17:19:45.092 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T17:19:45.132 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T17:19:45.444 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T17:19:45.470 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T17:19:45.510 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T17:19:45.813 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T17:19:45.839 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T17:19:45.879 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T17:19:46.141 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T17:19:46.167 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T17:19:46.207 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T17:19:46.510 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-portend. 2024-05-08T17:19:46.537 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-08T17:19:46.576 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T17:19:46.863 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T17:19:46.889 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T17:19:46.929 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T17:19:47.215 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T17:19:47.230 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T17:19:47.265 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T17:19:47.610 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T17:19:47.637 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T17:19:47.677 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T17:19:47.988 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T17:19:48.014 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T17:19:48.054 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T17:19:48.316 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T17:19:48.344 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T17:19:48.533 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T17:19:48.810 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-mako. 2024-05-08T17:19:48.837 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T17:19:48.877 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T17:19:49.213 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T17:19:49.240 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T17:19:49.288 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T17:19:49.550 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T17:19:49.576 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T17:19:49.608 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T17:19:49.910 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webob. 2024-05-08T17:19:49.937 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T17:19:49.976 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T17:19:50.313 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T17:19:50.340 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T17:19:50.383 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T17:19:50.691 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T17:19:50.718 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T17:19:50.757 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T17:19:51.035 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-paste. 2024-05-08T17:19:51.062 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T17:19:51.093 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T17:19:51.388 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T17:19:51.404 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T17:19:51.438 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T17:19:51.733 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T17:19:51.759 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T17:19:51.799 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T17:19:52.102 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T17:19:52.129 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T17:19:52.178 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T17:19:52.488 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T17:19:52.515 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T17:19:52.554 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T17:19:52.884 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T17:19:52.911 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T17:19:52.951 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T17:19:53.245 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-idna. 2024-05-08T17:19:53.272 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-08T17:19:53.312 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T17:19:53.606 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T17:19:53.633 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T17:19:53.673 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T17:19:54.018 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests. 2024-05-08T17:19:54.045 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T17:19:54.084 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T17:19:54.379 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T17:19:54.406 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T17:19:54.445 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T17:19:54.740 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T17:19:54.755 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2517-g95a4ad3c-1jammy_all.deb ... 2024-05-08T17:19:54.798 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:55.144 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T17:19:55.172 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:55.202 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:55.531 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T17:19:55.557 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T17:19:55.597 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T17:19:55.900 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T17:19:55.927 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T17:19:55.966 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T17:19:56.253 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T17:19:56.280 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:56.310 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:56.664 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T17:19:56.691 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:56.730 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mon (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:57.643 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T17:19:57.670 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:58.051 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-osd (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:59.170 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph. 2024-05-08T17:19:59.186 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../066-ceph_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:59.220 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:59.523 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T17:19:59.550 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:19:59.590 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-fuse (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:19:59.959 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T17:19:59.987 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:20:00.026 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mds (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:00.412 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephadm. 2024-05-08T17:20:00.439 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../069-cephadm_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:20:00.478 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephadm (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:00.773 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T17:20:00.800 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T17:20:00.839 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T17:20:01.109 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T17:20:01.128 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T17:20:01.159 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T17:20:02.172 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-babel. 2024-05-08T17:20:02.199 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T17:20:02.238 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T17:20:02.558 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T17:20:02.584 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T17:20:02.624 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T17:20:03.002 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T17:20:03.029 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2517-g95a4ad3c-1jammy_all.deb ... 2024-05-08T17:20:03.069 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:03.430 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T17:20:03.457 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T17:20:03.488 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T17:20:03.958 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-routes. 2024-05-08T17:20:03.985 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T17:20:04.024 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T17:20:04.369 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T17:20:04.396 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2517-g95a4ad3c-1jammy_all.deb ... 2024-05-08T17:20:04.435 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:05.674 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T17:20:05.690 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T17:20:05.732 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T17:20:06.202 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T17:20:06.230 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T17:20:06.268 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T17:20:06.614 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T17:20:06.629 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T17:20:06.664 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T17:20:06.942 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T17:20:06.969 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T17:20:07.008 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T17:20:07.692 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T17:20:07.719 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2517-g95a4ad3c-1jammy_all.deb ... 2024-05-08T17:20:07.844 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:08.772 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T17:20:08.799 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T17:20:08.839 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T17:20:09.108 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T17:20:09.136 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T17:20:09.166 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T17:20:09.470 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T17:20:09.497 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T17:20:09.536 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T17:20:09.856 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T17:20:09.883 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-08T17:20:09.922 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T17:20:10.226 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T17:20:10.253 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T17:20:10.292 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T17:20:10.571 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T17:20:10.598 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T17:20:10.637 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T17:20:10.948 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T17:20:10.975 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T17:20:11.015 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T17:20:11.326 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T17:20:11.354 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T17:20:11.418 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T17:20:12.134 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T17:20:12.150 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2517-g95a4ad3c-1jammy_all.deb ... 2024-05-08T17:20:12.192 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:12.520 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T17:20:12.547 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T17:20:12.586 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T17:20:12.889 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T17:20:12.917 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T17:20:12.955 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T17:20:13.191 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package jq. 2024-05-08T17:20:13.207 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T17:20:13.249 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T17:20:13.485 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package socat. 2024-05-08T17:20:13.502 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T17:20:13.543 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T17:20:13.821 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T17:20:13.838 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T17:20:13.880 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T17:20:14.418 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-test. 2024-05-08T17:20:14.445 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:20:14.476 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-test (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:16.638 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T17:20:16.665 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2517-g95a4ad3c-1jammy_all.deb ... 2024-05-08T17:20:16.704 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-volume (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:17.000 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T17:20:17.028 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:20:17.066 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs-dev (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:17.377 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-08T17:20:17.405 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-08T17:20:17.444 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T17:20:17.731 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-08T17:20:17.759 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-08T17:20:17.798 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-08T17:20:18.160 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T17:20:18.188 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T17:20:18.227 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T17:20:18.682 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package pkg-config. 2024-05-08T17:20:18.709 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-08T17:20:18.756 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T17:20:18.984 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T17:20:19.000 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T17:20:19.034 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T17:20:19.521 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T17:20:19.548 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T17:20:19.604 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T17:20:19.890 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T17:20:19.917 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T17:20:19.965 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T17:20:20.301 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T17:20:20.329 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T17:20:20.368 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T17:20:20.679 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T17:20:20.706 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T17:20:20.745 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T17:20:21.048 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-py. 2024-05-08T17:20:21.076 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-08T17:20:21.123 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T17:20:21.451 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T17:20:21.479 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T17:20:21.517 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T17:20:21.955 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T17:20:21.983 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T17:20:22.021 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T17:20:22.308 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-toml. 2024-05-08T17:20:22.335 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-08T17:20:22.374 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T17:20:22.677 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T17:20:22.704 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T17:20:22.743 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T17:20:23.055 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T17:20:23.083 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T17:20:23.121 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T17:20:23.390 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T17:20:23.407 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T17:20:23.440 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T17:20:24.128 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package radosgw. 2024-05-08T17:20:24.156 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../116-radosgw_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:20:24.185 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking radosgw (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:24.972 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T17:20:25.000 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2517-g95a4ad3c-1jammy_amd64.deb ... 2024-05-08T17:20:25.038 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking rbd-fuse (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T17:20:25.601 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T17:20:25.727 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T17:20:25.970 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T17:20:26.311 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T17:20:26.727 INFO:teuthology.orchestra.run.smithi117.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T17:20:26.787 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephadm (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:27.303 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user cephadm....done 2024-05-08T17:20:27.435 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T17:20:27.711 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T17:20:27.962 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T17:20:28.071 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T17:20:28.331 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T17:20:28.607 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T17:20:28.733 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T17:20:29.077 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T17:20:29.428 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T17:20:29.671 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T17:20:30.089 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-08T17:20:30.349 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T17:20:30.616 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T17:20:30.884 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T17:20:31.218 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-argparse (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:31.469 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T17:20:31.578 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T17:20:31.679 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T17:20:31.805 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T17:20:32.073 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-08T17:20:32.420 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-08T17:20:32.454 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-08T17:20:32.501 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T17:20:32.602 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T17:20:32.970 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T17:20:33.096 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T17:20:33.363 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T17:20:33.665 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T17:20:33.965 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up zip (3.0-12build2) ... 2024-05-08T17:20:34.092 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T17:20:34.768 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T17:20:35.011 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T17:20:35.137 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T17:20:35.271 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T17:20:35.598 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T17:20:35.999 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T17:20:36.258 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T17:20:36.618 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T17:20:36.936 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T17:20:37.304 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T17:20:37.563 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T17:20:37.689 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-common (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:38.024 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T17:20:38.341 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T17:20:39.572 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T17:20:39.815 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T17:20:39.949 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T17:20:40.208 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T17:20:40.326 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T17:20:40.435 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T17:20:40.712 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T17:20:40.962 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T17:20:41.214 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T17:20:41.340 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T17:20:41.633 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T17:20:41.875 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T17:20:42.151 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T17:20:42.386 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T17:20:42.637 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T17:20:42.904 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T17:20:43.039 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T17:20:43.323 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T17:20:43.457 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T17:20:43.758 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T17:20:44.059 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T17:20:44.285 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T17:20:44.394 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-08T17:20:44.520 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T17:20:44.610 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T17:20:44.839 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T17:20:44.965 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T17:20:45.366 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T17:20:45.617 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-08T17:20:45.735 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T17:20:45.994 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T17:20:46.120 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T17:20:46.454 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T17:20:46.781 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T17:20:47.074 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T17:20:47.199 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T17:20:47.476 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T17:20:47.743 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T17:20:48.088 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T17:20:48.464 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T17:20:48.749 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T17:20:49.076 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T17:20:49.202 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librados2 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:49.328 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:49.463 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-08T17:20:49.799 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs2 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:49.917 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libradosstriper1 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:50.026 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T17:20:50.294 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librbd1 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:50.420 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-modules-core (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:50.555 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-fuse (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:50.769 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T17:20:50.769 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T17:20:51.273 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs-dev (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:51.399 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rados (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:51.533 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librgw2 (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:51.642 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T17:20:52.784 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rbd (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:52.902 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up rbd-fuse (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:53.028 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rgw (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:53.153 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cephfs (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:53.280 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-common (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:53.804 INFO:teuthology.orchestra.run.smithi117.stdout:Adding group ceph....done 2024-05-08T17:20:54.182 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user ceph....done 2024-05-08T17:20:54.358 INFO:teuthology.orchestra.run.smithi117.stdout:Setting system user ceph properties....done 2024-05-08T17:20:54.374 INFO:teuthology.orchestra.run.smithi117.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T17:20:54.512 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T17:20:54.821 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T17:20:55.305 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-test (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:55.431 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up radosgw (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:55.898 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T17:20:55.898 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T17:20:56.408 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-base (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:56.737 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T17:20:57.226 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mds (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:57.459 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T17:20:57.459 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T17:20:57.919 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:58.139 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T17:20:58.139 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T17:20:58.654 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-osd (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:58.938 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T17:20:58.938 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T17:20:59.430 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:59.701 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:20:59.852 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mon (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:21:00.062 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T17:21:00.062 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T17:21:00.519 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-cephadm (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:21:00.665 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:21:00.807 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-dashboard (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:21:01.267 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-volume (19.0.0-2517-g95a4ad3c-1jammy) ... 2024-05-08T17:21:01.611 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T17:21:01.712 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T17:21:01.864 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T17:21:02.614 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T17:21:03.261 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T17:21:03.266 DEBUG:teuthology.parallel:result is None 2024-05-08T17:21:03.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95a4ad3c90f2f12f920e87725ad8d9002f948722 2024-05-08T17:21:03.405 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' ceph 2024-05-08T17:21:03.424 INFO:teuthology.orchestra.run.smithi117.stdout:19.0.0-2517-g95a4ad3c-1jammy 2024-05-08T17:21:03.425 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2517-g95a4ad3c-1jammy 2024-05-08T17:21:03.425 INFO:teuthology.task.install:The correct ceph version 19.0.0-2517-g95a4ad3c-1jammy is installed. 2024-05-08T17:21:03.427 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T17:21:03.427 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T17:21:03.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T17:21:03.480 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T17:21:03.480 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T17:21:03.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T17:21:03.536 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T17:21:03.591 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T17:21:03.591 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T17:21:03.591 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T17:21:03.643 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T17:21:03.694 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T17:21:03.694 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T17:21:03.694 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T17:21:03.747 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T17:21:03.803 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T17:21:03.817 INFO:tasks.workunit:Pulling workunits from ref 95a4ad3c90f2f12f920e87725ad8d9002f948722 2024-05-08T17:21:03.817 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T17:21:03.817 INFO:tasks.workunit:timeout=3h 2024-05-08T17:21:03.817 INFO:tasks.workunit:cleanup=True 2024-05-08T17:21:03.818 DEBUG:teuthology.orchestra.run.smithi117:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T17:21:03.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T17:21:03.852 INFO:teuthology.orchestra.run.smithi117.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-08T17:21:03.852 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-08T17:21:03.900 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-08T17:21:03.900 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-08T17:21:03.948 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 95a4ad3c90f2f12f920e87725ad8d9002f948722 2024-05-08T17:21:03.998 INFO:tasks.workunit.client.0.smithi117.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr:Note: switching to '95a4ad3c90f2f12f920e87725ad8d9002f948722'. 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T17:22:29.759 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr: git switch -c 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr:Or undo this operation with: 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr: git switch - 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:22:29.760 INFO:tasks.workunit.client.0.smithi117.stderr:HEAD is now at 95a4ad3c90f Merge branch 'wip-rf-reinstate-q-squid' of https://github.com/ronen-fr/ceph into wip-lflores-testing-2-2024-05-07-1606-squid 2024-05-08T17:22:29.765 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T17:22:29.812 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T17:22:29.812 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T17:22:29.859 INFO:tasks.workunit:Running workunits matching osd-backfill on client.0... 2024-05-08T17:22:29.859 INFO:tasks.workunit:Running workunit osd-backfill/osd-backfill-prio.sh... 2024-05-08T17:22:29.860 DEBUG:teuthology.orchestra.run.smithi117:workunit test osd-backfill/osd-backfill-prio.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=95a4ad3c90f2f12f920e87725ad8d9002f948722 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh 2024-05-08T17:22:29.922 INFO:tasks.workunit.client.0.smithi117.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-05-08T17:22:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-05-08T17:22:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2307: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2307: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2308: main: export PYTHONWARNINGS=ignore 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2308: main: PYTHONWARNINGS=ignore 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2309: main: export CEPH_CONF=/dev/null 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2309: main: CEPH_CONF=/dev/null 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2310: main: unset CEPH_ARGS 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2312: main: local code 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2313: main: run td/osd-backfill-prio 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:21: run: local dir=td/osd-backfill-prio 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:22: run: shift 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:25: run: export CEPH_MON=127.0.0.1:7114 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:25: run: CEPH_MON=127.0.0.1:7114 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:26: run: export CEPH_ARGS 2024-05-08T17:22:29.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:27: run: uuidgen 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:27: run: CEPH_ARGS+='--fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none ' 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 ' 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:29: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:32: run: CEPH_ARGS+='--osd-op-queue=wpq ' 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:33: run: export objects=50 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:33: run: objects=50 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:34: run: export poolprefix=test 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:34: run: poolprefix=test 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:35: run: export FORCE_PRIO=254 2024-05-08T17:22:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:35: run: FORCE_PRIO=254 2024-05-08T17:22:29.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:36: run: export DEGRADED_PRIO=150 2024-05-08T17:22:29.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:36: run: DEGRADED_PRIO=150 2024-05-08T17:22:29.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:37: run: export NORMAL_PRIO=110 2024-05-08T17:22:29.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:37: run: NORMAL_PRIO=110 2024-05-08T17:22:29.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:39: run: set 2024-05-08T17:22:29.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:39: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-05-08T17:22:29.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:39: run: local 'funcs=TEST_backfill_pool_priority 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_priority' 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:40: run: for func in $funcs 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:41: run: setup td/osd-backfill-prio 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-prio 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-prio 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:22:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:22:29.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:22:29.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:22:29.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:22:29.935 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:22:29.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:22:29.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:22:29.936 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:22:29.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:22:29.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:22:29.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:22:29.938 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:22:29.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:22:29.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:22:29.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2024-05-08T17:22:29.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:22:29.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:22:29.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:22:29.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.20310 2024-05-08T17:22:29.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:22:29.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:22:29.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-prio 2024-05-08T17:22:29.943 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T17:22:29.943 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:22:29.943 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:22:29.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.20310 2024-05-08T17:22:29.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T17:22:29.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2024-05-08T17:22:29.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-prio 1' TERM HUP INT 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:42: run: TEST_backfill_pool_priority td/osd-backfill-prio 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:329: TEST_backfill_pool_priority: local dir=td/osd-backfill-prio 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:330: TEST_backfill_pool_priority: local pools=3 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:331: TEST_backfill_pool_priority: local OSDS=2 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:333: TEST_backfill_pool_priority: run_mon td/osd-backfill-prio a 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-prio 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-prio/a 2024-05-08T17:22:29.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-prio/a --run-dir=td/osd-backfill-prio 2024-05-08T17:22:30.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T17:22:30.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:22:30.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:22:30.466 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:22:30.467 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:22:30.467 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:22:30.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:22:30.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-prio/a '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-prio/log --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T17:22:30.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T17:22:30.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T17:22:30.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:22:30.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:22:30.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T17:22:30.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T17:22:30.686 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:22:30.686 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:22:30.686 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:22:30.687 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:22:30.687 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:22:30.687 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:22:30.687 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-mon.a.asok 2024-05-08T17:22:30.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:22:30.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.20310/ceph-mon.a.asok config get fsid 2024-05-08T17:22:30.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:22:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-mon.a.asok 2024-05-08T17:22:30.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:22:30.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.20310/ceph-mon.a.asok config get mon_host 2024-05-08T17:22:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:334: TEST_backfill_pool_priority: run_mgr td/osd-backfill-prio x 2024-05-08T17:22:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-prio 2024-05-08T17:22:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T17:22:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T17:22:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T17:22:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-prio/x 2024-05-08T17:22:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T17:22:31.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T17:22:31.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:22:31.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:22:31.837 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:22:31.837 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:22:31.837 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:22:31.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:22:31.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:22:31.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-prio/x '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:22:31.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:335: TEST_backfill_pool_priority: export CEPH_ARGS 2024-05-08T17:22:31.911 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:337: TEST_backfill_pool_priority: expr 2 - 1 2024-05-08T17:22:31.912 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:337: TEST_backfill_pool_priority: seq 0 1 2024-05-08T17:22:31.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:337: TEST_backfill_pool_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:22:31.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:339: TEST_backfill_pool_priority: run_osd td/osd-backfill-prio 0 2024-05-08T17:22:31.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-prio 2024-05-08T17:22:31.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:22:31.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T17:22:31.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:22:31.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-prio/0 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/0' 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/0/journal' 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:22:31.939 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:22:31.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:22:31.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:22:31.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:22:31.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-prio/0 2024-05-08T17:22:31.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:22:31.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=265b0a5b-750f-4162-bd81-d087c0383441 2024-05-08T17:22:31.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 265b0a5b-750f-4162-bd81-d087c0383441' 2024-05-08T17:22:31.942 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 265b0a5b-750f-4162-bd81-d087c0383441 2024-05-08T17:22:31.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:22:31.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDXtDtmc/qDORAAiHMFHGP8L4xB1v08BLlsNA== 2024-05-08T17:22:31.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDXtDtmc/qDORAAiHMFHGP8L4xB1v08BLlsNA=="}' 2024-05-08T17:22:31.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 265b0a5b-750f-4162-bd81-d087c0383441 -i td/osd-backfill-prio/0/new.json 2024-05-08T17:22:32.292 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:22:32.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-prio/0/new.json 2024-05-08T17:22:32.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDXtDtmc/qDORAAiHMFHGP8L4xB1v08BLlsNA== --osd-uuid 265b0a5b-750f-4162-bd81-d087c0383441 2024-05-08T17:22:32.378 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:32.382+0000 7f5d325da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:32.381 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:32.382+0000 7f5d325da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:32.382 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:32.386+0000 7f5d325da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:32.383 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:32.386+0000 7f5d325da7c0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2024-05-08T17:22:32.383 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:32.386+0000 7f5d325da7c0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2024-05-08T17:22:32.383 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:32.386+0000 7f5d325da7c0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2024-05-08T17:22:32.506 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:32.506+0000 7f5d325da7c0 -1 bluestore(td/osd-backfill-prio/0) _read_fsid unparsable uuid 2024-05-08T17:22:39.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-prio/0/keyring 2024-05-08T17:22:39.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:22:39.386 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T17:22:39.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T17:22:39.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-prio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:22:39.632 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:22:39.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T17:22:39.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:22:39.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:22:39.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:22:39.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:22:39.670 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:39.670+0000 7fbd25bb87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:39.672 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:39.674+0000 7fbd25bb87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:39.674 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:39.674+0000 7fbd25bb87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:39.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T17:22:39.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:22:39.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:22:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:22:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:22:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:22:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:22:39.866 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:22:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:22:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:22:40.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:22:40.232 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:40.234+0000 7fbd25bb87c0 -1 Falling back to public interface 2024-05-08T17:22:41.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:22:41.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:22:41.115 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:22:41.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:22:41.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:22:41.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:22:41.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:22:42.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:22:42.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:22:42.543 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:22:42.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:22:42.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:22:42.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:22:42.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:22:43.000 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:43.002+0000 7fbd25bb87c0 -1 osd.0 0 log_to_monitors true 2024-05-08T17:22:43.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:22:43.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:22:43.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:22:43.972 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:22:43.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:22:43.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:22:44.598 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3218752982,v1:127.0.0.1:6801/3218752982] [v2:127.0.0.1:6802/3218752982,v1:127.0.0.1:6803/3218752982] exists,up 265b0a5b-750f-4162-bd81-d087c0383441 2024-05-08T17:22:44.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:22:44.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:22:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:22:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:337: TEST_backfill_pool_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:22:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:339: TEST_backfill_pool_priority: run_osd td/osd-backfill-prio 1 2024-05-08T17:22:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-prio 2024-05-08T17:22:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:22:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T17:22:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:22:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-prio/1 2024-05-08T17:22:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-05-08T17:22:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:22:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:22:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:22:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/1' 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/1/journal' 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:22:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:22:44.606 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:22:44.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:22:44.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:22:44.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:22:44.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:22:44.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-05-08T17:22:44.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-05-08T17:22:44.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:22:44.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:22:44.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:22:44.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:22:44.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:22:44.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:22:44.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-prio/1 2024-05-08T17:22:44.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:22:44.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6b157838-d444-4d38-8c95-f176e8efadf3 2024-05-08T17:22:44.608 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 6b157838-d444-4d38-8c95-f176e8efadf3 2024-05-08T17:22:44.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 6b157838-d444-4d38-8c95-f176e8efadf3' 2024-05-08T17:22:44.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:22:44.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDktDtmgo+0JRAAb2LdFKKfkBTZDI8c1fXDlA== 2024-05-08T17:22:44.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDktDtmgo+0JRAAb2LdFKKfkBTZDI8c1fXDlA=="}' 2024-05-08T17:22:44.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6b157838-d444-4d38-8c95-f176e8efadf3 -i td/osd-backfill-prio/1/new.json 2024-05-08T17:22:45.134 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:22:45.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-prio/1/new.json 2024-05-08T17:22:45.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDktDtmgo+0JRAAb2LdFKKfkBTZDI8c1fXDlA== --osd-uuid 6b157838-d444-4d38-8c95-f176e8efadf3 2024-05-08T17:22:45.182 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:45.186+0000 7f2a6ef2b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:45.216 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:45.218+0000 7f2a6ef2b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:45.217 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:45.218+0000 7f2a6ef2b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:45.218 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:45.218+0000 7f2a6ef2b7c0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2024-05-08T17:22:45.218 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:45.218+0000 7f2a6ef2b7c0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2024-05-08T17:22:45.218 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:45.218+0000 7f2a6ef2b7c0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2024-05-08T17:22:45.255 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:45.258+0000 7f2a6ef2b7c0 -1 bluestore(td/osd-backfill-prio/1) _read_fsid unparsable uuid 2024-05-08T17:22:51.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-prio/1/keyring 2024-05-08T17:22:51.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:22:51.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T17:22:51.825 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T17:22:51.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-prio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:22:52.382 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T17:22:52.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T17:22:52.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:22:52.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:22:52.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:22:52.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:22:52.422 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:52.421+0000 7f0871db17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:52.469 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:52.469+0000 7f0871db17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:52.471 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:52.473+0000 7f0871db17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:22:52.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T17:22:52.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:22:52.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T17:22:52.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:22:52.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:22:52.800 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:22:52.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:22:52.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:22:52.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:22:52.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:22:53.037 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:53.037+0000 7f0871db17c0 -1 Falling back to public interface 2024-05-08T17:22:53.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:22:54.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:22:54.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:22:54.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:22:54.219 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:22:54.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:22:54.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:22:54.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:22:55.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:22:55.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:22:55.633 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:22:55.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:22:55.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:22:55.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:22:55.707 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:22:55.709+0000 7f0871db17c0 -1 osd.1 0 log_to_monitors true 2024-05-08T17:22:56.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:22:57.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:22:57.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:22:57.097 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:22:57.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:22:57.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:22:57.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:22:57.506 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3378433489,v1:127.0.0.1:6811/3378433489] [v2:127.0.0.1:6812/3378433489,v1:127.0.0.1:6813/3378433489] exists,up 6b157838-d444-4d38-8c95-f176e8efadf3 2024-05-08T17:22:57.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:22:57.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:22:57.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:22:57.507 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: seq 1 3 2024-05-08T17:22:57.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-05-08T17:22:57.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:344: TEST_backfill_pool_priority: create_pool test1 1 1 2024-05-08T17:22:57.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test1 1 1 2024-05-08T17:22:58.149 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' already exists 2024-05-08T17:22:58.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:22:59.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:345: TEST_backfill_pool_priority: ceph osd pool set test1 size 2 2024-05-08T17:22:59.999 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T17:23:00.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-05-08T17:23:00.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:344: TEST_backfill_pool_priority: create_pool test2 1 1 2024-05-08T17:23:00.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test2 1 1 2024-05-08T17:23:00.916 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' already exists 2024-05-08T17:23:00.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:23:01.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:345: TEST_backfill_pool_priority: ceph osd pool set test2 size 2 2024-05-08T17:23:04.316 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 2 2024-05-08T17:23:04.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-05-08T17:23:04.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:344: TEST_backfill_pool_priority: create_pool test3 1 1 2024-05-08T17:23:04.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test3 1 1 2024-05-08T17:23:05.477 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test3' already exists 2024-05-08T17:23:05.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:23:06.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:345: TEST_backfill_pool_priority: ceph osd pool set test3 size 2 2024-05-08T17:23:07.413 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 3 size to 2 2024-05-08T17:23:07.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:347: TEST_backfill_pool_priority: sleep 5 2024-05-08T17:23:12.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:349: TEST_backfill_pool_priority: wait_for_clean 2024-05-08T17:23:12.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:23:12.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:23:12.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:23:12.439 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:23:12.440 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:23:12.440 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:23:12.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:23:12.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:23:12.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:23:12.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:23:12.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:23:12.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:23:12.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:23:12.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:23:12.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:23:12.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:23:12.983 INFO:tasks.workunit.client.0.smithi117.stderr:1' 2024-05-08T17:23:12.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:23:12.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:23:12.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:23:13.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836488 2024-05-08T17:23:13.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836488 2024-05-08T17:23:13.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836488' 2024-05-08T17:23:13.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:23:13.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:23:13.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672966 2024-05-08T17:23:13.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672966 2024-05-08T17:23:13.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836488 1-42949672966' 2024-05-08T17:23:13.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:23:13.332 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836488 2024-05-08T17:23:13.332 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:23:13.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:23:13.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836488 2024-05-08T17:23:13.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:23:13.336 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836488 2024-05-08T17:23:13.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836488 2024-05-08T17:23:13.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2024-05-08T17:23:13.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:23:13.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836486 -lt 21474836488 2024-05-08T17:23:13.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:23:14.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:23:14.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:23:15.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836488 -lt 21474836488 2024-05-08T17:23:15.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:23:15.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672966 2024-05-08T17:23:15.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:23:15.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:23:15.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672966 2024-05-08T17:23:15.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:23:15.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672966 2024-05-08T17:23:15.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2024-05-08T17:23:15.268 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672966 2024-05-08T17:23:15.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:23:15.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672966 -lt 42949672966 2024-05-08T17:23:15.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:23:15.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:23:15.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:23:16.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 3 == 0 2024-05-08T17:23:16.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:23:16.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:23:16.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:23:16.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:23:16.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:23:16.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:23:16.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:23:16.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=3 2024-05-08T17:23:16.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:23:16.718 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:23:16.718 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:23:17.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 3 = 3 2024-05-08T17:23:17.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:23:17.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:23:17.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:351: TEST_backfill_pool_priority: ceph pg dump pgs 2024-05-08T17:23:17.683 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T17:23:17.683 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:23:08.104655+0000 0'0 28:20 [1,0] 1 [1,0] 1 0'0 2024-05-08T17:23:05.170877+0000 0'0 2024-05-08T17:23:05.170877+0000 0 0 periodic scrub scheduled @ 2024-05-10T02:50:56.198019+0000 0 0 2024-05-08T17:23:17.683 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:23:05.701309+0000 0'0 28:30 [0,1] 0 [0,1] 0 0'0 2024-05-08T17:23:00.673074+0000 0'0 2024-05-08T17:23:00.673074+0000 0 0 periodic scrub scheduled @ 2024-05-10T01:36:00.522321+0000 0 0 2024-05-08T17:23:17.683 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:23:00.286262+0000 0'0 28:38 [1,0] 1 [1,0] 1 0'0 2024-05-08T17:22:57.911468+0000 0'0 2024-05-08T17:22:57.911468+0000 0 0 periodic scrub scheduled @ 2024-05-10T02:51:38.190687+0000 0 0 2024-05-08T17:23:17.683 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T17:23:17.683 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T17:23:17.683 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:23:17.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:355: TEST_backfill_pool_priority: local PG1 2024-05-08T17:23:17.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:356: TEST_backfill_pool_priority: local POOLNUM1 2024-05-08T17:23:17.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:357: TEST_backfill_pool_priority: local pool1 2024-05-08T17:23:17.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:358: TEST_backfill_pool_priority: local chk_osd1_1 2024-05-08T17:23:17.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:359: TEST_backfill_pool_priority: local chk_osd1_2 2024-05-08T17:23:17.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:361: TEST_backfill_pool_priority: local PG2 2024-05-08T17:23:17.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:362: TEST_backfill_pool_priority: local POOLNUM2 2024-05-08T17:23:17.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:363: TEST_backfill_pool_priority: local pool2 2024-05-08T17:23:17.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:364: TEST_backfill_pool_priority: local chk_osd2_1 2024-05-08T17:23:17.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:365: TEST_backfill_pool_priority: local chk_osd2_2 2024-05-08T17:23:17.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: seq 1 3 2024-05-08T17:23:17.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-05-08T17:23:17.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: ceph pg map 1.0 --format=json 2024-05-08T17:23:17.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: jq '.acting[]' 2024-05-08T17:23:18.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:370: TEST_backfill_pool_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:23:18.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:370: TEST_backfill_pool_priority: local test_osd1=1 2024-05-08T17:23:18.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:23:18.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: local test_osd2=0 2024-05-08T17:23:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:372: TEST_backfill_pool_priority: '[' -z '' ']' 2024-05-08T17:23:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:374: TEST_backfill_pool_priority: PG1=1.0 2024-05-08T17:23:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:375: TEST_backfill_pool_priority: POOLNUM1=1 2024-05-08T17:23:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:376: TEST_backfill_pool_priority: pool1=test1 2024-05-08T17:23:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:377: TEST_backfill_pool_priority: chk_osd1_1=1 2024-05-08T17:23:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:378: TEST_backfill_pool_priority: chk_osd1_2=0 2024-05-08T17:23:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-05-08T17:23:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: ceph pg map 2.0 --format=json 2024-05-08T17:23:18.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: jq '.acting[]' 2024-05-08T17:23:18.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:370: TEST_backfill_pool_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:23:18.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:370: TEST_backfill_pool_priority: local test_osd1=0 2024-05-08T17:23:18.524 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:23:18.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: local test_osd2=1 2024-05-08T17:23:18.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:372: TEST_backfill_pool_priority: '[' -z 1.0 ']' 2024-05-08T17:23:18.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:379: TEST_backfill_pool_priority: '[' 1 '!=' 0 ']' 2024-05-08T17:23:18.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:381: TEST_backfill_pool_priority: PG2=2.0 2024-05-08T17:23:18.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:382: TEST_backfill_pool_priority: POOLNUM2=2 2024-05-08T17:23:18.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:383: TEST_backfill_pool_priority: pool2=test2 2024-05-08T17:23:18.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:384: TEST_backfill_pool_priority: chk_osd2_1=0 2024-05-08T17:23:18.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:385: TEST_backfill_pool_priority: chk_osd2_2=1 2024-05-08T17:23:18.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:386: TEST_backfill_pool_priority: break 2024-05-08T17:23:18.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:389: TEST_backfill_pool_priority: rm -f td/osd-backfill-prio/acting 2024-05-08T17:23:18.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:391: TEST_backfill_pool_priority: '[' test2 = '' ']' 2024-05-08T17:23:18.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:397: TEST_backfill_pool_priority: seq 1 3 2024-05-08T17:23:18.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:397: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-05-08T17:23:18.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:399: TEST_backfill_pool_priority: '[' 1 '!=' 1 -a 1 '!=' 2 ']' 2024-05-08T17:23:18.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:397: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-05-08T17:23:18.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:399: TEST_backfill_pool_priority: '[' 2 '!=' 1 -a 2 '!=' 2 ']' 2024-05-08T17:23:18.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:397: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-05-08T17:23:18.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:399: TEST_backfill_pool_priority: '[' 3 '!=' 1 -a 3 '!=' 2 ']' 2024-05-08T17:23:18.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:401: TEST_backfill_pool_priority: delete_pool test3 2024-05-08T17:23:18.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test3 2024-05-08T17:23:18.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2024-05-08T17:23:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test3' does not exist 2024-05-08T17:23:19.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:405: TEST_backfill_pool_priority: pool1_extra_prio=1 2024-05-08T17:23:19.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:406: TEST_backfill_pool_priority: pool2_extra_prio=2 2024-05-08T17:23:19.070 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:408: TEST_backfill_pool_priority: expr 150 + 1 + 1 2024-05-08T17:23:19.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:408: TEST_backfill_pool_priority: pool1_prio=152 2024-05-08T17:23:19.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:409: TEST_backfill_pool_priority: expr 150 + 1 + 2 2024-05-08T17:23:19.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:409: TEST_backfill_pool_priority: pool2_prio=153 2024-05-08T17:23:19.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:411: TEST_backfill_pool_priority: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2024-05-08T17:23:19.967 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T17:23:19.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:412: TEST_backfill_pool_priority: ceph osd pool set test1 recovery_priority 1 2024-05-08T17:23:21.056 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 recovery_priority to 1 2024-05-08T17:23:21.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:413: TEST_backfill_pool_priority: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2024-05-08T17:23:22.035 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 1 2024-05-08T17:23:22.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:414: TEST_backfill_pool_priority: ceph osd pool set test2 recovery_priority 2 2024-05-08T17:23:22.966 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 recovery_priority to 2 2024-05-08T17:23:22.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:415: TEST_backfill_pool_priority: wait_for_clean 2024-05-08T17:23:22.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:23:22.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:23:22.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:23:22.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:23:22.994 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:23:22.994 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:23:22.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:23:22.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:23:22.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:23:23.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:23:23.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:23:23.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:23:23.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:23:23.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:23:23.110 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:23:23.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:23:23.569 INFO:tasks.workunit.client.0.smithi117.stderr:1' 2024-05-08T17:23:23.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:23:23.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:23:23.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:23:23.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836492 2024-05-08T17:23:23.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836492 2024-05-08T17:23:23.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836492' 2024-05-08T17:23:23.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:23:23.755 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:23:23.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672970 2024-05-08T17:23:23.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672970 2024-05-08T17:23:23.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836492 1-42949672970' 2024-05-08T17:23:23.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:23:23.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836492 2024-05-08T17:23:23.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:23:23.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:23:23.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836492 2024-05-08T17:23:23.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:23:23.924 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836492 2024-05-08T17:23:23.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836492 2024-05-08T17:23:23.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2024-05-08T17:23:23.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:23:24.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836490 -lt 21474836492 2024-05-08T17:23:24.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:23:25.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:23:25.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:23:25.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836492 -lt 21474836492 2024-05-08T17:23:25.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:23:25.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672970 2024-05-08T17:23:25.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:23:25.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:23:25.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672970 2024-05-08T17:23:25.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:23:25.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672970 2024-05-08T17:23:25.748 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672970 2024-05-08T17:23:25.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2024-05-08T17:23:25.748 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:23:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672970 -lt 42949672970 2024-05-08T17:23:26.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:23:26.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:23:26.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:23:26.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 == 0 2024-05-08T17:23:26.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:23:26.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:23:26.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:23:26.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:23:26.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:23:26.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:23:26.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:23:27.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:23:27.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:23:27.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:23:27.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:23:27.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 2 2024-05-08T17:23:27.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:23:27.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:23:27.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:417: TEST_backfill_pool_priority: dd if=/dev/urandom of=td/osd-backfill-prio/data bs=1M count=10 2024-05-08T17:23:27.684 INFO:tasks.workunit.client.0.smithi117.stderr:10+0 records in 2024-05-08T17:23:27.684 INFO:tasks.workunit.client.0.smithi117.stderr:10+0 records out 2024-05-08T17:23:27.684 INFO:tasks.workunit.client.0.smithi117.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0391853 s, 268 MB/s 2024-05-08T17:23:27.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: p=1 2024-05-08T17:23:27.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:419: TEST_backfill_pool_priority: for pname in $pool1 $pool2 2024-05-08T17:23:27.685 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: seq 1 50 2024-05-08T17:23:27.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:27.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj1-p1 td/osd-backfill-prio/data 2024-05-08T17:23:28.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:28.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj2-p1 td/osd-backfill-prio/data 2024-05-08T17:23:28.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:28.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj3-p1 td/osd-backfill-prio/data 2024-05-08T17:23:29.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:29.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj4-p1 td/osd-backfill-prio/data 2024-05-08T17:23:29.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:29.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj5-p1 td/osd-backfill-prio/data 2024-05-08T17:23:30.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:30.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj6-p1 td/osd-backfill-prio/data 2024-05-08T17:23:30.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:30.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj7-p1 td/osd-backfill-prio/data 2024-05-08T17:23:30.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:30.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj8-p1 td/osd-backfill-prio/data 2024-05-08T17:23:31.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:31.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj9-p1 td/osd-backfill-prio/data 2024-05-08T17:23:31.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:31.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj10-p1 td/osd-backfill-prio/data 2024-05-08T17:23:32.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:32.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj11-p1 td/osd-backfill-prio/data 2024-05-08T17:23:32.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:32.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj12-p1 td/osd-backfill-prio/data 2024-05-08T17:23:33.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:33.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj13-p1 td/osd-backfill-prio/data 2024-05-08T17:23:33.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:33.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj14-p1 td/osd-backfill-prio/data 2024-05-08T17:23:33.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:33.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj15-p1 td/osd-backfill-prio/data 2024-05-08T17:23:34.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:34.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj16-p1 td/osd-backfill-prio/data 2024-05-08T17:23:34.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:34.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj17-p1 td/osd-backfill-prio/data 2024-05-08T17:23:35.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:35.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj18-p1 td/osd-backfill-prio/data 2024-05-08T17:23:35.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:35.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj19-p1 td/osd-backfill-prio/data 2024-05-08T17:23:36.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:36.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj20-p1 td/osd-backfill-prio/data 2024-05-08T17:23:36.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:36.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj21-p1 td/osd-backfill-prio/data 2024-05-08T17:23:37.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:37.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj22-p1 td/osd-backfill-prio/data 2024-05-08T17:23:37.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:37.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj23-p1 td/osd-backfill-prio/data 2024-05-08T17:23:38.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:38.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj24-p1 td/osd-backfill-prio/data 2024-05-08T17:23:38.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:38.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj25-p1 td/osd-backfill-prio/data 2024-05-08T17:23:38.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:38.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj26-p1 td/osd-backfill-prio/data 2024-05-08T17:23:39.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:39.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj27-p1 td/osd-backfill-prio/data 2024-05-08T17:23:39.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:39.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj28-p1 td/osd-backfill-prio/data 2024-05-08T17:23:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj29-p1 td/osd-backfill-prio/data 2024-05-08T17:23:40.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:40.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj30-p1 td/osd-backfill-prio/data 2024-05-08T17:23:41.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:41.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj31-p1 td/osd-backfill-prio/data 2024-05-08T17:23:41.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:41.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj32-p1 td/osd-backfill-prio/data 2024-05-08T17:23:41.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:41.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj33-p1 td/osd-backfill-prio/data 2024-05-08T17:23:42.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:42.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj34-p1 td/osd-backfill-prio/data 2024-05-08T17:23:42.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:42.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj35-p1 td/osd-backfill-prio/data 2024-05-08T17:23:43.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:43.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj36-p1 td/osd-backfill-prio/data 2024-05-08T17:23:43.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:43.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj37-p1 td/osd-backfill-prio/data 2024-05-08T17:23:44.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:44.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj38-p1 td/osd-backfill-prio/data 2024-05-08T17:23:44.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:44.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj39-p1 td/osd-backfill-prio/data 2024-05-08T17:23:45.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:45.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj40-p1 td/osd-backfill-prio/data 2024-05-08T17:23:45.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:45.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj41-p1 td/osd-backfill-prio/data 2024-05-08T17:23:46.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:46.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj42-p1 td/osd-backfill-prio/data 2024-05-08T17:23:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj43-p1 td/osd-backfill-prio/data 2024-05-08T17:23:46.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:46.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj44-p1 td/osd-backfill-prio/data 2024-05-08T17:23:47.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:47.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj45-p1 td/osd-backfill-prio/data 2024-05-08T17:23:47.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:47.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj46-p1 td/osd-backfill-prio/data 2024-05-08T17:23:48.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:48.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj47-p1 td/osd-backfill-prio/data 2024-05-08T17:23:48.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:48.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj48-p1 td/osd-backfill-prio/data 2024-05-08T17:23:49.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:49.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj49-p1 td/osd-backfill-prio/data 2024-05-08T17:23:49.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:49.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj50-p1 td/osd-backfill-prio/data 2024-05-08T17:23:49.935 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: expr 1 + 1 2024-05-08T17:23:49.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: p=2 2024-05-08T17:23:49.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:419: TEST_backfill_pool_priority: for pname in $pool1 $pool2 2024-05-08T17:23:49.938 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: seq 1 50 2024-05-08T17:23:49.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:49.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj1-p2 td/osd-backfill-prio/data 2024-05-08T17:23:50.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:50.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj2-p2 td/osd-backfill-prio/data 2024-05-08T17:23:50.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:50.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj3-p2 td/osd-backfill-prio/data 2024-05-08T17:23:51.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:51.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj4-p2 td/osd-backfill-prio/data 2024-05-08T17:23:51.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:51.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj5-p2 td/osd-backfill-prio/data 2024-05-08T17:23:52.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:52.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj6-p2 td/osd-backfill-prio/data 2024-05-08T17:23:52.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:52.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj7-p2 td/osd-backfill-prio/data 2024-05-08T17:23:53.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj8-p2 td/osd-backfill-prio/data 2024-05-08T17:23:53.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:53.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj9-p2 td/osd-backfill-prio/data 2024-05-08T17:23:53.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:53.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj10-p2 td/osd-backfill-prio/data 2024-05-08T17:23:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj11-p2 td/osd-backfill-prio/data 2024-05-08T17:23:54.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:54.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj12-p2 td/osd-backfill-prio/data 2024-05-08T17:23:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj13-p2 td/osd-backfill-prio/data 2024-05-08T17:23:55.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:55.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj14-p2 td/osd-backfill-prio/data 2024-05-08T17:23:56.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:56.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj15-p2 td/osd-backfill-prio/data 2024-05-08T17:23:56.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:56.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj16-p2 td/osd-backfill-prio/data 2024-05-08T17:23:57.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:57.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj17-p2 td/osd-backfill-prio/data 2024-05-08T17:23:57.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:57.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj18-p2 td/osd-backfill-prio/data 2024-05-08T17:23:58.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:58.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj19-p2 td/osd-backfill-prio/data 2024-05-08T17:23:58.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:58.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj20-p2 td/osd-backfill-prio/data 2024-05-08T17:23:58.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:58.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj21-p2 td/osd-backfill-prio/data 2024-05-08T17:23:59.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:59.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj22-p2 td/osd-backfill-prio/data 2024-05-08T17:23:59.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:23:59.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj23-p2 td/osd-backfill-prio/data 2024-05-08T17:24:00.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:00.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj24-p2 td/osd-backfill-prio/data 2024-05-08T17:24:00.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:00.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj25-p2 td/osd-backfill-prio/data 2024-05-08T17:24:01.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:01.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj26-p2 td/osd-backfill-prio/data 2024-05-08T17:24:01.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:01.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj27-p2 td/osd-backfill-prio/data 2024-05-08T17:24:02.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:02.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj28-p2 td/osd-backfill-prio/data 2024-05-08T17:24:02.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:02.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj29-p2 td/osd-backfill-prio/data 2024-05-08T17:24:02.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:02.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj30-p2 td/osd-backfill-prio/data 2024-05-08T17:24:03.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:03.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj31-p2 td/osd-backfill-prio/data 2024-05-08T17:24:03.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:03.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj32-p2 td/osd-backfill-prio/data 2024-05-08T17:24:04.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:04.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj33-p2 td/osd-backfill-prio/data 2024-05-08T17:24:04.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:04.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj34-p2 td/osd-backfill-prio/data 2024-05-08T17:24:05.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:05.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj35-p2 td/osd-backfill-prio/data 2024-05-08T17:24:05.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:05.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj36-p2 td/osd-backfill-prio/data 2024-05-08T17:24:05.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:05.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj37-p2 td/osd-backfill-prio/data 2024-05-08T17:24:06.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:06.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj38-p2 td/osd-backfill-prio/data 2024-05-08T17:24:06.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:06.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj39-p2 td/osd-backfill-prio/data 2024-05-08T17:24:07.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:07.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj40-p2 td/osd-backfill-prio/data 2024-05-08T17:24:07.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:07.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj41-p2 td/osd-backfill-prio/data 2024-05-08T17:24:08.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:08.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj42-p2 td/osd-backfill-prio/data 2024-05-08T17:24:08.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:08.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj43-p2 td/osd-backfill-prio/data 2024-05-08T17:24:09.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:09.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj44-p2 td/osd-backfill-prio/data 2024-05-08T17:24:09.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:09.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj45-p2 td/osd-backfill-prio/data 2024-05-08T17:24:10.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:10.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj46-p2 td/osd-backfill-prio/data 2024-05-08T17:24:10.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:10.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj47-p2 td/osd-backfill-prio/data 2024-05-08T17:24:10.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:10.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj48-p2 td/osd-backfill-prio/data 2024-05-08T17:24:11.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:11.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj49-p2 td/osd-backfill-prio/data 2024-05-08T17:24:11.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-05-08T17:24:11.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj50-p2 td/osd-backfill-prio/data 2024-05-08T17:24:12.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: expr 2 + 1 2024-05-08T17:24:12.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: p=3 2024-05-08T17:24:12.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:428: TEST_backfill_pool_priority: get_not_primary test1 obj1-p1 2024-05-08T17:24:12.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test1 2024-05-08T17:24:12.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1-p1 2024-05-08T17:24:12.193 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test1 obj1-p1 2024-05-08T17:24:12.194 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test1 2024-05-08T17:24:12.194 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1-p1 2024-05-08T17:24:12.195 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test1 obj1-p1 2024-05-08T17:24:12.195 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T17:24:12.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T17:24:12.668 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test1 obj1-p1 2024-05-08T17:24:12.668 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T17:24:13.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:428: TEST_backfill_pool_priority: local otherosd=null 2024-05-08T17:24:13.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:430: TEST_backfill_pool_priority: ceph pg dump pgs 2024-05-08T17:24:13.537 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T17:24:13.537 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 44 0 0 0 0 455081984 0 0 30 100 30 active+clean 2024-05-08T17:23:22.533467+0000 39'130 39:186 [0] 0 [0] 0 0'0 2024-05-08T17:23:00.673074+0000 0'0 2024-05-08T17:23:00.673074+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:12:10.559557+0000 0 0 2024-05-08T17:24:13.538 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-05-08T17:23:20.565876+0000 39'150 39:214 [1] 1 [1] 1 0'0 2024-05-08T17:22:57.911468+0000 0'0 2024-05-08T17:22:57.911468+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:44:08.216330+0000 0 0 2024-05-08T17:24:13.538 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T17:24:13.538 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T17:24:13.538 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:24:13.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:431: TEST_backfill_pool_priority: ERRORS=0 2024-05-08T17:24:13.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:433: TEST_backfill_pool_priority: ceph osd pool set test1 size 2 2024-05-08T17:24:14.255 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T17:24:14.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:434: TEST_backfill_pool_priority: ceph osd pool set test2 size 2 2024-05-08T17:24:15.569 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 2 2024-05-08T17:24:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:435: TEST_backfill_pool_priority: sleep 5 2024-05-08T17:24:20.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: get_asok_path osd.1 2024-05-08T17:24:20.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:24:20.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:24:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:24:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:24:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:24:20.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:24:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: CEPH_ARGS= 2024-05-08T17:24:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:24:20.725 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 2024-05-08T17:24:20.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:437: TEST_backfill_pool_priority: echo osd.1 2024-05-08T17:24:20.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:438: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:24:20.726 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 152, 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "2.0", 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 153, 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:24:20.727 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:24:20.728 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:24:20.728 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:439: TEST_backfill_pool_priority: get_asok_path osd.0 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.0.asok 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:439: TEST_backfill_pool_priority: CEPH_ARGS= 2024-05-08T17:24:20.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:439: TEST_backfill_pool_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.0.asok dump_recovery_reservations 2024-05-08T17:24:20.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:440: TEST_backfill_pool_priority: echo osd.0 2024-05-08T17:24:20.854 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 2024-05-08T17:24:20.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:441: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-05-08T17:24:20.854 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:24:20.854 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:24:20.854 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:24:20.854 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:24:20.854 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "2.0", 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 153, 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:24:20.855 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 152, 2024-05-08T17:24:20.856 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:24:20.856 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:24:20.856 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:24:20.856 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:24:20.856 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:24:20.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:444: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-05-08T17:24:20.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:444: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].item' 2024-05-08T17:24:20.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:444: TEST_backfill_pool_priority: eval 'ITEM="1.0"' 2024-05-08T17:24:20.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:444: TEST_backfill_pool_priority: ITEM=1.0 2024-05-08T17:24:20.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:445: TEST_backfill_pool_priority: '[' 1.0 '!=' 1.0 ']' 2024-05-08T17:24:20.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:450: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-05-08T17:24:20.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:450: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].prio' 2024-05-08T17:24:20.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:450: TEST_backfill_pool_priority: PRIO=152 2024-05-08T17:24:20.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:451: TEST_backfill_pool_priority: '[' 152 '!=' 152 ']' 2024-05-08T17:24:20.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:459: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-05-08T17:24:20.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:459: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].item' 2024-05-08T17:24:20.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:459: TEST_backfill_pool_priority: eval 'ITEM="1.0"' 2024-05-08T17:24:20.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:459: TEST_backfill_pool_priority: ITEM=1.0 2024-05-08T17:24:20.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:460: TEST_backfill_pool_priority: '[' 1.0 '!=' 1.0 ']' 2024-05-08T17:24:20.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:465: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-05-08T17:24:20.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:465: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].prio' 2024-05-08T17:24:21.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:465: TEST_backfill_pool_priority: PRIO=152 2024-05-08T17:24:21.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:466: TEST_backfill_pool_priority: '[' 152 '!=' 152 ']' 2024-05-08T17:24:21.008 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:474: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-05-08T17:24:21.008 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:474: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].item' 2024-05-08T17:24:21.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:474: TEST_backfill_pool_priority: eval 'ITEM="2.0"' 2024-05-08T17:24:21.050 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:474: TEST_backfill_pool_priority: ITEM=2.0 2024-05-08T17:24:21.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:475: TEST_backfill_pool_priority: '[' 2.0 '!=' 2.0 ']' 2024-05-08T17:24:21.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:480: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-05-08T17:24:21.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:480: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].prio' 2024-05-08T17:24:21.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:480: TEST_backfill_pool_priority: PRIO=153 2024-05-08T17:24:21.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:481: TEST_backfill_pool_priority: '[' 153 '!=' 153 ']' 2024-05-08T17:24:21.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:489: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-05-08T17:24:21.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:489: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].item' 2024-05-08T17:24:21.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:489: TEST_backfill_pool_priority: eval 'ITEM="2.0"' 2024-05-08T17:24:21.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:489: TEST_backfill_pool_priority: ITEM=2.0 2024-05-08T17:24:21.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:490: TEST_backfill_pool_priority: '[' 2.0 '!=' 2.0 ']' 2024-05-08T17:24:21.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:495: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-05-08T17:24:21.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:495: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].prio' 2024-05-08T17:24:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:495: TEST_backfill_pool_priority: PRIO=153 2024-05-08T17:24:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:496: TEST_backfill_pool_priority: '[' 153 '!=' 153 ']' 2024-05-08T17:24:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:503: TEST_backfill_pool_priority: wait_for_clean 2024-05-08T17:24:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:24:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:24:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:24:21.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:24:21.146 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:24:21.147 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:24:21.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:24:21.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:24:21.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:24:21.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:24:21.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:24:21.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:24:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:24:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:24:21.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:24:21.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:24:21.746 INFO:tasks.workunit.client.0.smithi117.stderr:1' 2024-05-08T17:24:21.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:24:21.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:24:21.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:24:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836506 2024-05-08T17:24:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836506 2024-05-08T17:24:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836506' 2024-05-08T17:24:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:24:22.086 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:24:22.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672984 2024-05-08T17:24:22.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672984 2024-05-08T17:24:22.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836506 1-42949672984' 2024-05-08T17:24:22.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:24:22.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836506 2024-05-08T17:24:22.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:24:22.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:24:22.250 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836506 2024-05-08T17:24:22.250 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:24:22.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836506 2024-05-08T17:24:22.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2024-05-08T17:24:22.251 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836506 2024-05-08T17:24:22.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:24:22.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836506 -lt 21474836506 2024-05-08T17:24:22.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:24:22.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672984 2024-05-08T17:24:22.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:24:22.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:24:22.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672984 2024-05-08T17:24:22.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:24:22.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672984 2024-05-08T17:24:22.704 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672984 2024-05-08T17:24:22.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672984' 2024-05-08T17:24:22.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:24:23.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672984 -lt 42949672984 2024-05-08T17:24:23.180 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:24:23.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:23.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:23.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 == 0 2024-05-08T17:24:23.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:23.996 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:23.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:23.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:23.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:23.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:23.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:24.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:24.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:24.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:24.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:25.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:25.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T17:24:25.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:24:25.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T17:24:25.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:25.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:25.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:25.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:25.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:25.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:25.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:25.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:25.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:25.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:25.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:25.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:25.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:25.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:26.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:26.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:26.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:26.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:26.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:26.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:26.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:26.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:26.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:26.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=16228730 2024-05-08T17:24:26.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 16228730 '!=' null 2024-05-08T17:24:26.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:26.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:26.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:26.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:26.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:26.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:26.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:26.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:26.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:26.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:26.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:27.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:27.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:27.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:27.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:28.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:28.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:28.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=19977198 2024-05-08T17:24:28.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 19977198 '!=' null 2024-05-08T17:24:28.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:28.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:28.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:29.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:29.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:29.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:29.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:29.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:29.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:29.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:29.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:29.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:29.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:29.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:29.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:29.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:29.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:30.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=19977198 2024-05-08T17:24:30.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 19977198 '!=' null 2024-05-08T17:24:30.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:30.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:30.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:30.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:30.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:30.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:30.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:30.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:30.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:30.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:30.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:31.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:31.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:31.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:31.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:32.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:32.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:32.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:32.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:32.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:32.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:32.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:32.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:32.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:32.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=26207648 2024-05-08T17:24:32.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 26207648 '!=' null 2024-05-08T17:24:32.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:32.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:32.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:32.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:32.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:32.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:32.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:32.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:32.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:32.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:32.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:33.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:33.312 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:33.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:33.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:33.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:33.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:34.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=26207648 2024-05-08T17:24:34.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 26207648 '!=' null 2024-05-08T17:24:34.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:34.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:34.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:34.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:34.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:34.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:34.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:34.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:34.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:35.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:35.145 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:35.145 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:35.145 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:35.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:35.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:35.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:35.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:35.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:35.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:35.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:35.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:35.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:36.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=18345575 2024-05-08T17:24:36.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 18345575 '!=' null 2024-05-08T17:24:36.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:36.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:36.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:36.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:36.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:36.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:36.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:36.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:36.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:36.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:36.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:37.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:37.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:37.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:37.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:37.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:38.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=23586784 2024-05-08T17:24:38.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 23586784 '!=' null 2024-05-08T17:24:38.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:38.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:38.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:38.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:38.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:38.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:38.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:38.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:38.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:38.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:38.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:39.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:39.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:39.227 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:39.227 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:39.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:39.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:39.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:39.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:39.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:39.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:39.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:39.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:39.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:40.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=26207016 2024-05-08T17:24:40.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 26207016 '!=' null 2024-05-08T17:24:40.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:40.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:40.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:40.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:40.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:40.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:40.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:40.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:40.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:40.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:40.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:41.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:41.188 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:41.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:41.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:41.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:41.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:41.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:41.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:41.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:41.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:41.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:41.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:41.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:42.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=26206796 2024-05-08T17:24:42.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 26206796 '!=' null 2024-05-08T17:24:42.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:42.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:42.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:42.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:42.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:42.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:42.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:42.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:42.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:42.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:42.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:43.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:43.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:43.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:43.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:43.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:43.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:43.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:43.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:43.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:43.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:43.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:43.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:43.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:44.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=26207337 2024-05-08T17:24:44.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 26207337 '!=' null 2024-05-08T17:24:44.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:44.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:44.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:44.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:44.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:44.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:44.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:44.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:44.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:44.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:44.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:45.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:45.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:45.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:45.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:45.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:45.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:45.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:45.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:45.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:45.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:45.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:45.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:45.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:46.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=20965928 2024-05-08T17:24:46.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 20965928 '!=' null 2024-05-08T17:24:46.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:46.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:46.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:46.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:46.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:46.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:46.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:46.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:46.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:46.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:46.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:47.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:47.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:47.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:47.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:47.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:47.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:47.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:47.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:47.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:47.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:47.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:47.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:47.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:48.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=26207138 2024-05-08T17:24:48.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 26207138 '!=' null 2024-05-08T17:24:48.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:48.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:48.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:48.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:48.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:48.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:48.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:48.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:48.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:48.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:48.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:49.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:49.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:49.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:49.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:49.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:49.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:49.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:49.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:50.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=26207110 2024-05-08T17:24:50.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 26207110 '!=' null 2024-05-08T17:24:50.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:50.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:50.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:50.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:50.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:50.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:50.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:50.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:50.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:50.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:50.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:51.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:51.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:51.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:51.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:51.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:51.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:52.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=25333682 2024-05-08T17:24:52.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 25333682 '!=' null 2024-05-08T17:24:52.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:52.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:52.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:52.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:52.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:52.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:52.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:52.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:52.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:52.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:52.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:53.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:53.168 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:53.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:53.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:53.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:53.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:53.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:53.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:53.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:53.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:53.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:53.873 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:53.874 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:54.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=24460373 2024-05-08T17:24:54.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 24460373 '!=' null 2024-05-08T17:24:54.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:54.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:54.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:54.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:54.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:54.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:54.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:54.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:54.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:54.685 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:54.685 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:55.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:55.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:55.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:55.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:55.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:55.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:55.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:55.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:55.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:55.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:55.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:55.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:55.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:56.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=19218599 2024-05-08T17:24:56.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 19218599 '!=' null 2024-05-08T17:24:56.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:56.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:56.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:56.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:56.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:56.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:56.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:56.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:56.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:56.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:56.551 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:56.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:56.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:56.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:56.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:24:57.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:24:57.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:24:57.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:24:57.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:24:57.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:24:57.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:24:57.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:24:57.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:24:57.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:24:58.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=24460003 2024-05-08T17:24:58.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 24460003 '!=' null 2024-05-08T17:24:58.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:24:58.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:24:58.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:24:58.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:24:58.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:24:58.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:24:58.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:24:58.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:24:58.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:24:58.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:24:58.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:24:59.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:24:59.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:24:59.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:24:59.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:25:00.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:25:00.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:25:00.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:25:00.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:25:00.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:25:00.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:25:00.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:25:00.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:25:00.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:25:00.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=23062398 2024-05-08T17:25:00.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 23062398 '!=' null 2024-05-08T17:25:00.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:25:00.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:25:00.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:25:00.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:25:00.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:25:00.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:25:00.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:25:00.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:25:00.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:25:00.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:25:00.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:25:01.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:25:01.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:25:01.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:25:01.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:25:01.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 2 2024-05-08T17:25:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:25:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:25:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:25:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:25:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:25:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:25:01.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:25:01.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:25:02.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=34067840 2024-05-08T17:25:02.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 34067840 '!=' null 2024-05-08T17:25:02.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:25:02.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:25:02.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:25:02.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:25:02.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:25:02.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:25:02.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:25:02.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:25:02.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:25:02.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:25:02.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:25:02.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:25:02.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:25:02.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:25:02.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:25:03.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 2 2024-05-08T17:25:03.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 0 2024-05-08T17:25:03.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:25:03.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=1 2024-05-08T17:25:03.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:25:03.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:25:03.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:25:03.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:25:03.387 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:25:03.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:25:03.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:25:03.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:25:03.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:25:03.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:25:03.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:25:03.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:25:03.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:25:03.816 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:25:04.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 2 2024-05-08T17:25:04.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:25:04.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:25:04.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:25:04.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:25:04.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:25:04.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:25:04.346 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:25:04.346 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:25:04.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=13977482 2024-05-08T17:25:04.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 13977482 '!=' null 2024-05-08T17:25:04.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:25:04.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:25:04.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:25:04.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:25:04.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:25:04.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:25:04.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:25:04.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:25:04.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:25:04.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:25:04.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:25:05.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:25:05.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:25:05.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:25:05.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:25:05.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 2 2024-05-08T17:25:05.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:25:05.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:25:05.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:25:05.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:25:05.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:25:05.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:25:05.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:25:05.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:25:06.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=13977482 2024-05-08T17:25:06.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 13977482 '!=' null 2024-05-08T17:25:06.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:25:06.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:25:06.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:25:06.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:25:06.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:25:06.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:25:06.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:25:06.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:25:06.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:25:06.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:25:06.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:25:06.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:25:06.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:25:06.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:25:06.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:25:07.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 2 2024-05-08T17:25:07.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:25:07.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:25:07.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:505: TEST_backfill_pool_priority: '[' 0 '!=' 0 ']' 2024-05-08T17:25:07.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:509: TEST_backfill_pool_priority: echo TEST PASSED 2024-05-08T17:25:07.633 INFO:tasks.workunit.client.0.smithi117.stdout:TEST PASSED 2024-05-08T17:25:07.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:512: TEST_backfill_pool_priority: delete_pool test1 2024-05-08T17:25:07.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test1 2024-05-08T17:25:07.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-05-08T17:25:08.301 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' does not exist 2024-05-08T17:25:08.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:513: TEST_backfill_pool_priority: delete_pool test2 2024-05-08T17:25:08.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test2 2024-05-08T17:25:08.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-05-08T17:25:08.989 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' does not exist 2024-05-08T17:25:09.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:514: TEST_backfill_pool_priority: kill_daemons td/osd-backfill-prio 2024-05-08T17:25:09.005 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:25:09.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:25:09.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:25:09.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:25:09.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:25:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:25:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:515: TEST_backfill_pool_priority: return 0 2024-05-08T17:25:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:43: run: teardown td/osd-backfill-prio 2024-05-08T17:25:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2024-05-08T17:25:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:25:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2024-05-08T17:25:14.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:25:14.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:25:14.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:25:14.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:25:14.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:25:14.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:25:14.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:25:14.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:25:14.332 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:25:14.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:25:14.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:25:14.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:25:14.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:25:14.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:25:14.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:25:14.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:25:14.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:25:14.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:25:14.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2024-05-08T17:25:14.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:25:14.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:14.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:14.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.20310 2024-05-08T17:25:14.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:40: run: for func in $funcs 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:41: run: setup td/osd-backfill-prio 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-prio 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-prio 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:25:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:25:14.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:25:14.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:25:14.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:25:14.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:25:14.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:25:14.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:25:14.362 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:25:14.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:25:14.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:25:14.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:25:14.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:25:14.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:25:14.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:25:14.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2024-05-08T17:25:14.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:25:14.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:14.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:14.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.20310 2024-05-08T17:25:14.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:25:14.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:25:14.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-prio 2024-05-08T17:25:14.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T17:25:14.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:14.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:14.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.20310 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-prio 1' TERM HUP INT 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:42: run: TEST_backfill_priority td/osd-backfill-prio 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:49: TEST_backfill_priority: local dir=td/osd-backfill-prio 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:50: TEST_backfill_priority: local pools=10 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:51: TEST_backfill_priority: local OSDS=5 2024-05-08T17:25:14.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:53: TEST_backfill_priority: expr 150 + 1 2024-05-08T17:25:14.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:53: TEST_backfill_priority: local degraded_prio=151 2024-05-08T17:25:14.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:54: TEST_backfill_priority: local max_tries=10 2024-05-08T17:25:14.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:56: TEST_backfill_priority: run_mon td/osd-backfill-prio a 2024-05-08T17:25:14.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-prio 2024-05-08T17:25:14.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T17:25:14.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T17:25:14.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T17:25:14.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-prio/a 2024-05-08T17:25:14.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-prio/a --run-dir=td/osd-backfill-prio 2024-05-08T17:25:14.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T17:25:14.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:25:14.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:25:14.767 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:25:14.767 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:14.767 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:14.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:14.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-prio/a '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-prio/log --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T17:25:14.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T17:25:14.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T17:25:14.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:25:14.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:25:14.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T17:25:14.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T17:25:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:25:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:25:14.996 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:25:14.996 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:25:14.996 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:14.996 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:14.996 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-mon.a.asok 2024-05-08T17:25:14.996 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:25:14.996 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.20310/ceph-mon.a.asok config get fsid 2024-05-08T17:25:15.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T17:25:15.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:25:15.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:25:15.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-mon.a.asok 2024-05-08T17:25:15.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:25:15.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.20310/ceph-mon.a.asok config get mon_host 2024-05-08T17:25:15.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:57: TEST_backfill_priority: run_mgr td/osd-backfill-prio x 2024-05-08T17:25:15.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-prio 2024-05-08T17:25:15.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T17:25:15.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T17:25:15.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T17:25:15.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-prio/x 2024-05-08T17:25:15.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T17:25:16.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T17:25:16.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:25:16.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:25:16.130 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:25:16.131 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:16.131 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:16.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:16.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:25:16.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-prio/x '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:25:16.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:58: TEST_backfill_priority: export CEPH_ARGS 2024-05-08T17:25:16.171 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: expr 5 - 1 2024-05-08T17:25:16.172 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: seq 0 4 2024-05-08T17:25:16.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:25:16.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 0 2024-05-08T17:25:16.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-prio 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-prio/0 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/0' 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/0/journal' 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:25:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:25:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-prio/0 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2adc93fa-2ce8-4e9f-88bd-0e9f495264f2 2024-05-08T17:25:16.179 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 2adc93fa-2ce8-4e9f-88bd-0e9f495264f2 2024-05-08T17:25:16.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 2adc93fa-2ce8-4e9f-88bd-0e9f495264f2' 2024-05-08T17:25:16.180 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:25:16.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB8tTtm4O9ADBAA1Lz6iErM1f+kKn8PjpiP0g== 2024-05-08T17:25:16.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB8tTtm4O9ADBAA1Lz6iErM1f+kKn8PjpiP0g=="}' 2024-05-08T17:25:16.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2adc93fa-2ce8-4e9f-88bd-0e9f495264f2 -i td/osd-backfill-prio/0/new.json 2024-05-08T17:25:16.497 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:25:16.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-prio/0/new.json 2024-05-08T17:25:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB8tTtm4O9ADBAA1Lz6iErM1f+kKn8PjpiP0g== --osd-uuid 2adc93fa-2ce8-4e9f-88bd-0e9f495264f2 2024-05-08T17:25:16.560 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:16.560+0000 7f7adc59b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:16.565 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:16.564+0000 7f7adc59b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:16.566 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:16.568+0000 7f7adc59b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:16.567 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:16.568+0000 7f7adc59b7c0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2024-05-08T17:25:16.567 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:16.568+0000 7f7adc59b7c0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2024-05-08T17:25:16.567 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:16.568+0000 7f7adc59b7c0 -1 bluestore(td/osd-backfill-prio/0/block) _read_bdev_label failed to open td/osd-backfill-prio/0/block: (2) No such file or directory 2024-05-08T17:25:16.606 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:16.608+0000 7f7adc59b7c0 -1 bluestore(td/osd-backfill-prio/0) _read_fsid unparsable uuid 2024-05-08T17:25:23.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-prio/0/keyring 2024-05-08T17:25:23.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:25:23.052 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T17:25:23.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T17:25:23.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-prio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:25:23.614 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:25:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T17:25:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:25:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:25:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:25:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:25:23.653 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:23.656+0000 7fa2d93c87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:23.688 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:23.688+0000 7fa2d93c87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:23.689 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:23.692+0000 7fa2d93c87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:24.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T17:25:24.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:25:24.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:25:24.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:25:24.077 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:25:24.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:25:24.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:24.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:25:24.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:24.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:25:24.257 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:24.256+0000 7fa2d93c87c0 -1 Falling back to public interface 2024-05-08T17:25:24.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:25.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:25.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:25.499 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:25:25.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:25:25.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:25.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:25:25.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:26.869 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:26.868+0000 7fa2d93c87c0 -1 osd.0 0 log_to_monitors true 2024-05-08T17:25:26.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:26.923 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:25:26.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:26.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:25:26.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:26.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:25:27.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:28.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:28.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:28.450 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:25:28.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:25:28.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:28.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:25:28.878 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3358212961,v1:127.0.0.1:6803/3358212961] [v2:127.0.0.1:6804/3358212961,v1:127.0.0.1:6805/3358212961] exists,up 2adc93fa-2ce8-4e9f-88bd-0e9f495264f2 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 1 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-prio 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T17:25:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-prio/1 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/1' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/1/journal' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:25:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:25:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:25:28.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-prio/1 2024-05-08T17:25:28.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:25:28.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=da3c48b0-3761-456d-8455-cdc0a704cc88 2024-05-08T17:25:28.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 da3c48b0-3761-456d-8455-cdc0a704cc88' 2024-05-08T17:25:28.885 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 da3c48b0-3761-456d-8455-cdc0a704cc88 2024-05-08T17:25:28.886 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:25:28.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCItTtmcYt+NhAAbL7mri9W6l3jbO0JavSn7A== 2024-05-08T17:25:28.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCItTtmcYt+NhAAbL7mri9W6l3jbO0JavSn7A=="}' 2024-05-08T17:25:28.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new da3c48b0-3761-456d-8455-cdc0a704cc88 -i td/osd-backfill-prio/1/new.json 2024-05-08T17:25:29.391 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:25:29.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-prio/1/new.json 2024-05-08T17:25:29.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCItTtmcYt+NhAAbL7mri9W6l3jbO0JavSn7A== --osd-uuid da3c48b0-3761-456d-8455-cdc0a704cc88 2024-05-08T17:25:29.449 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:29.452+0000 7f08ff73e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:29.479 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:29.480+0000 7f08ff73e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:29.480 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:29.480+0000 7f08ff73e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:29.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:29.480+0000 7f08ff73e7c0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2024-05-08T17:25:29.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:29.480+0000 7f08ff73e7c0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2024-05-08T17:25:29.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:29.480+0000 7f08ff73e7c0 -1 bluestore(td/osd-backfill-prio/1/block) _read_bdev_label failed to open td/osd-backfill-prio/1/block: (2) No such file or directory 2024-05-08T17:25:29.518 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:29.520+0000 7f08ff73e7c0 -1 bluestore(td/osd-backfill-prio/1) _read_fsid unparsable uuid 2024-05-08T17:25:36.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-prio/1/keyring 2024-05-08T17:25:36.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:25:36.388 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T17:25:36.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T17:25:36.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-prio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:25:36.956 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T17:25:36.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T17:25:36.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:25:36.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:25:36.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:25:36.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:25:36.994 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:36.996+0000 7fa2bc9607c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:37.024 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:37.024+0000 7fa2bc9607c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:37.026 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:37.028+0000 7fa2bc9607c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:37.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T17:25:37.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:25:37.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T17:25:37.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:25:37.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:25:37.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:37.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:25:37.454 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:25:37.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:37.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:25:37.595 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:37.596+0000 7fa2bc9607c0 -1 Falling back to public interface 2024-05-08T17:25:37.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:38.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:38.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:38.910 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:25:38.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:25:38.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:38.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:25:39.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:40.166 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:40.168+0000 7fa2bc9607c0 -1 osd.1 0 log_to_monitors true 2024-05-08T17:25:40.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:40.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:40.349 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:25:40.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:25:40.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:40.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:25:40.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:41.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:41.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:41.906 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:25:41.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:25:41.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:41.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:25:42.354 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3652945715,v1:127.0.0.1:6811/3652945715] [v2:127.0.0.1:6812/3652945715,v1:127.0.0.1:6813/3652945715] exists,up da3c48b0-3761-456d-8455-cdc0a704cc88 2024-05-08T17:25:42.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:25:42.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:25:42.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:25:42.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:25:42.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 2 2024-05-08T17:25:42.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-prio 2024-05-08T17:25:42.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-prio/2 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/2' 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/2/journal' 2024-05-08T17:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-05-08T17:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:42.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-prio/2 2024-05-08T17:25:42.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:25:42.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=18e57982-1ae6-4bda-9be0-d91ca1f1b696 2024-05-08T17:25:42.361 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 18e57982-1ae6-4bda-9be0-d91ca1f1b696 2024-05-08T17:25:42.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 18e57982-1ae6-4bda-9be0-d91ca1f1b696' 2024-05-08T17:25:42.362 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:25:42.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCWtTtmtSIYFxAAZDW4Hj5Ee27dMzS0XxLihQ== 2024-05-08T17:25:42.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCWtTtmtSIYFxAAZDW4Hj5Ee27dMzS0XxLihQ=="}' 2024-05-08T17:25:42.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 18e57982-1ae6-4bda-9be0-d91ca1f1b696 -i td/osd-backfill-prio/2/new.json 2024-05-08T17:25:42.947 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:25:42.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-prio/2/new.json 2024-05-08T17:25:42.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/2 --osd-journal=td/osd-backfill-prio/2/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCWtTtmtSIYFxAAZDW4Hj5Ee27dMzS0XxLihQ== --osd-uuid 18e57982-1ae6-4bda-9be0-d91ca1f1b696 2024-05-08T17:25:43.002 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:43.004+0000 7fb9d82907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:43.025 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:43.028+0000 7fb9d82907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:43.027 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:43.028+0000 7fb9d82907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:43.027 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:43.028+0000 7fb9d82907c0 -1 bluestore(td/osd-backfill-prio/2/block) _read_bdev_label failed to open td/osd-backfill-prio/2/block: (2) No such file or directory 2024-05-08T17:25:43.027 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:43.028+0000 7fb9d82907c0 -1 bluestore(td/osd-backfill-prio/2/block) _read_bdev_label failed to open td/osd-backfill-prio/2/block: (2) No such file or directory 2024-05-08T17:25:43.028 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:43.028+0000 7fb9d82907c0 -1 bluestore(td/osd-backfill-prio/2/block) _read_bdev_label failed to open td/osd-backfill-prio/2/block: (2) No such file or directory 2024-05-08T17:25:43.064 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:43.064+0000 7fb9d82907c0 -1 bluestore(td/osd-backfill-prio/2) _read_fsid unparsable uuid 2024-05-08T17:25:49.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-prio/2/keyring 2024-05-08T17:25:49.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:25:49.935 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T17:25:49.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T17:25:49.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-prio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:25:50.507 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T17:25:50.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T17:25:50.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/2 --osd-journal=td/osd-backfill-prio/2/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:25:50.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:25:50.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:25:50.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:25:50.546 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:50.548+0000 7fb5220717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:50.591 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:50.592+0000 7fb5220717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:50.591 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:50.592+0000 7fb5220717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:50.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T17:25:50.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:25:50.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T17:25:50.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:25:50.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:25:50.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:50.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:25:50.963 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:25:50.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:50.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:25:51.162 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:51.164+0000 7fb5220717c0 -1 Falling back to public interface 2024-05-08T17:25:51.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:52.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:52.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:52.393 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:25:52.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:25:52.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:52.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:25:52.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:53.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:53.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:53.817 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:25:53.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:25:53.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:53.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:25:53.905 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:53.908+0000 7fb5220717c0 -1 osd.2 0 log_to_monitors true 2024-05-08T17:25:54.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:25:55.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:25:55.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:25:55.307 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:25:55.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:25:55.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:25:55.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:25:55.736 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2622184722,v1:127.0.0.1:6819/2622184722] [v2:127.0.0.1:6820/2622184722,v1:127.0.0.1:6821/2622184722] exists,up 18e57982-1ae6-4bda-9be0-d91ca1f1b696 2024-05-08T17:25:55.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:25:55.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:25:55.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:25:55.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:25:55.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 3 2024-05-08T17:25:55.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-prio 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-prio/3 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/3' 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/3/journal' 2024-05-08T17:25:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:25:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-prio/3 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:25:55.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=77e3169d-5018-40bf-8cec-096f0695787e 2024-05-08T17:25:55.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 77e3169d-5018-40bf-8cec-096f0695787e' 2024-05-08T17:25:55.745 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 77e3169d-5018-40bf-8cec-096f0695787e 2024-05-08T17:25:55.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:25:55.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCjtTtmwQ8ELhAAY6DAmFJLJETADEqfKsPU8Q== 2024-05-08T17:25:55.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCjtTtmwQ8ELhAAY6DAmFJLJETADEqfKsPU8Q=="}' 2024-05-08T17:25:55.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 77e3169d-5018-40bf-8cec-096f0695787e -i td/osd-backfill-prio/3/new.json 2024-05-08T17:25:56.424 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:25:56.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-prio/3/new.json 2024-05-08T17:25:56.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/3 --osd-journal=td/osd-backfill-prio/3/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCjtTtmwQ8ELhAAY6DAmFJLJETADEqfKsPU8Q== --osd-uuid 77e3169d-5018-40bf-8cec-096f0695787e 2024-05-08T17:25:56.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:56.484+0000 7f336f8507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:56.483 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:56.484+0000 7f336f8507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:56.485 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:56.488+0000 7f336f8507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:25:56.485 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:56.488+0000 7f336f8507c0 -1 bluestore(td/osd-backfill-prio/3/block) _read_bdev_label failed to open td/osd-backfill-prio/3/block: (2) No such file or directory 2024-05-08T17:25:56.485 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:56.488+0000 7f336f8507c0 -1 bluestore(td/osd-backfill-prio/3/block) _read_bdev_label failed to open td/osd-backfill-prio/3/block: (2) No such file or directory 2024-05-08T17:25:56.485 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:56.488+0000 7f336f8507c0 -1 bluestore(td/osd-backfill-prio/3/block) _read_bdev_label failed to open td/osd-backfill-prio/3/block: (2) No such file or directory 2024-05-08T17:25:56.565 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:25:56.564+0000 7f336f8507c0 -1 bluestore(td/osd-backfill-prio/3) _read_fsid unparsable uuid 2024-05-08T17:26:03.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-prio/3/keyring 2024-05-08T17:26:03.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:26:03.291 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T17:26:03.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T17:26:03.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-prio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:26:03.832 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T17:26:03.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T17:26:03.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:26:03.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:26:03.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/3 --osd-journal=td/osd-backfill-prio/3/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:26:03.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:26:03.870 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:03.872+0000 7f66bbd0b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:03.872 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:03.876+0000 7f66bbd0b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:03.874 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:03.876+0000 7f66bbd0b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:04.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T17:26:04.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:26:04.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T17:26:04.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:26:04.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:26:04.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:26:04.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:26:04.257 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:26:04.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:26:04.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:26:04.438 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:04.440+0000 7f66bbd0b7c0 -1 Falling back to public interface 2024-05-08T17:26:04.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:26:05.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:26:05.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:26:05.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:26:05.682 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:26:05.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:26:05.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:26:06.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:26:07.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:26:07.111 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:26:07.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:26:07.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:26:07.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:26:07.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:26:07.152 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:07.152+0000 7f66bbd0b7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T17:26:07.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:26:08.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:26:08.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:26:08.626 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:26:08.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:26:08.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:26:08.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:26:09.060 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1327454450,v1:127.0.0.1:6827/1327454450] [v2:127.0.0.1:6828/1327454450,v1:127.0.0.1:6829/1327454450] exists,up 77e3169d-5018-40bf-8cec-096f0695787e 2024-05-08T17:26:09.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:26:09.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:26:09.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:26:09.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:26:09.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 4 2024-05-08T17:26:09.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-prio 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-prio/4 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/4' 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/4/journal' 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:26:09.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-prio/4 2024-05-08T17:26:09.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:26:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8e46eeb1-82e7-4f19-b6cb-57ee20636e0d 2024-05-08T17:26:09.068 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 8e46eeb1-82e7-4f19-b6cb-57ee20636e0d 2024-05-08T17:26:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 8e46eeb1-82e7-4f19-b6cb-57ee20636e0d' 2024-05-08T17:26:09.068 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:26:09.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCxtTtmV6e5BRAAh0Kwpm77KEalwYAQfcjGDA== 2024-05-08T17:26:09.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCxtTtmV6e5BRAAh0Kwpm77KEalwYAQfcjGDA=="}' 2024-05-08T17:26:09.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8e46eeb1-82e7-4f19-b6cb-57ee20636e0d -i td/osd-backfill-prio/4/new.json 2024-05-08T17:26:09.790 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:26:09.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-prio/4/new.json 2024-05-08T17:26:09.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/4 --osd-journal=td/osd-backfill-prio/4/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCxtTtmV6e5BRAAh0Kwpm77KEalwYAQfcjGDA== --osd-uuid 8e46eeb1-82e7-4f19-b6cb-57ee20636e0d 2024-05-08T17:26:09.848 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:09.848+0000 7f372ea0e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:09.875 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:09.876+0000 7f372ea0e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:09.877 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:09.880+0000 7f372ea0e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:09.877 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:09.880+0000 7f372ea0e7c0 -1 bluestore(td/osd-backfill-prio/4/block) _read_bdev_label failed to open td/osd-backfill-prio/4/block: (2) No such file or directory 2024-05-08T17:26:09.877 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:09.880+0000 7f372ea0e7c0 -1 bluestore(td/osd-backfill-prio/4/block) _read_bdev_label failed to open td/osd-backfill-prio/4/block: (2) No such file or directory 2024-05-08T17:26:09.877 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:09.880+0000 7f372ea0e7c0 -1 bluestore(td/osd-backfill-prio/4/block) _read_bdev_label failed to open td/osd-backfill-prio/4/block: (2) No such file or directory 2024-05-08T17:26:09.915 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:09.916+0000 7f372ea0e7c0 -1 bluestore(td/osd-backfill-prio/4) _read_fsid unparsable uuid 2024-05-08T17:26:17.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-prio/4/keyring 2024-05-08T17:26:17.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:26:17.103 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T17:26:17.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T17:26:17.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-prio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:26:17.683 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T17:26:17.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T17:26:17.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=6d5e8ff5-e026-4d2a-8e8c-db1c2917b00d --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/4 --osd-journal=td/osd-backfill-prio/4/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.20310/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:26:17.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:26:17.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:26:17.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:26:17.721 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:17.724+0000 7f49883277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:17.775 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:17.776+0000 7f49883277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:17.776 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:17.776+0000 7f49883277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:26:18.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T17:26:18.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:26:18.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T17:26:18.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:26:18.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:26:18.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:26:18.100 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:26:18.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:26:18.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:26:18.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:26:18.343 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:18.344+0000 7f49883277c0 -1 Falling back to public interface 2024-05-08T17:26:18.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:26:19.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:26:19.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:26:19.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:26:19.512 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:26:19.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:26:19.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:26:19.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:26:20.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:26:20.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:26:20.940 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:26:20.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:26:20.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:26:20.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:26:21.004 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:26:21.004+0000 7f49883277c0 -1 osd.4 0 log_to_monitors true 2024-05-08T17:26:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:26:22.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:26:22.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:26:22.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:26:22.412 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:26:22.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:26:22.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:26:22.837 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1703749473,v1:127.0.0.1:6835/1703749473] [v2:127.0.0.1:6836/1703749473,v1:127.0.0.1:6837/1703749473] exists,up 8e46eeb1-82e7-4f19-b6cb-57ee20636e0d 2024-05-08T17:26:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:26:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:26:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:26:22.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: seq 1 10 2024-05-08T17:26:22.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:22.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test1 1 1 2024-05-08T17:26:22.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test1 1 1 2024-05-08T17:26:23.542 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' already exists 2024-05-08T17:26:23.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:24.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test1 size 2 2024-05-08T17:26:26.172 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T17:26:26.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:26.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test2 1 1 2024-05-08T17:26:26.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test2 1 1 2024-05-08T17:26:26.792 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' already exists 2024-05-08T17:26:26.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:27.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test2 size 2 2024-05-08T17:26:28.803 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 2 2024-05-08T17:26:28.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:28.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test3 1 1 2024-05-08T17:26:28.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test3 1 1 2024-05-08T17:26:29.659 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test3' already exists 2024-05-08T17:26:29.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:30.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test3 size 2 2024-05-08T17:26:31.685 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 3 size to 2 2024-05-08T17:26:31.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:31.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test4 1 1 2024-05-08T17:26:31.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test4 1 1 2024-05-08T17:26:32.537 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test4' already exists 2024-05-08T17:26:32.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:33.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test4 size 2 2024-05-08T17:26:34.651 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 4 size to 2 2024-05-08T17:26:34.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:34.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test5 1 1 2024-05-08T17:26:34.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test5 1 1 2024-05-08T17:26:35.464 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test5' already exists 2024-05-08T17:26:35.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:36.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test5 size 2 2024-05-08T17:26:37.992 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 5 size to 2 2024-05-08T17:26:38.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:38.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test6 1 1 2024-05-08T17:26:38.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test6 1 1 2024-05-08T17:26:38.704 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test6' already exists 2024-05-08T17:26:38.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:39.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test6 size 2 2024-05-08T17:26:41.075 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 6 size to 2 2024-05-08T17:26:41.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:41.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test7 1 1 2024-05-08T17:26:41.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test7 1 1 2024-05-08T17:26:41.847 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test7' already exists 2024-05-08T17:26:41.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:42.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test7 size 2 2024-05-08T17:26:43.790 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 7 size to 2 2024-05-08T17:26:43.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:43.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test8 1 1 2024-05-08T17:26:43.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test8 1 1 2024-05-08T17:26:44.837 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test8' already exists 2024-05-08T17:26:44.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:45.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test8 size 2 2024-05-08T17:26:47.177 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 8 size to 2 2024-05-08T17:26:47.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:47.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test9 1 1 2024-05-08T17:26:47.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test9 1 1 2024-05-08T17:26:47.905 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test9' already exists 2024-05-08T17:26:47.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:48.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test9 size 2 2024-05-08T17:26:49.810 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 9 size to 2 2024-05-08T17:26:49.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:26:49.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test10 1 1 2024-05-08T17:26:49.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test10 1 1 2024-05-08T17:26:50.758 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test10' already exists 2024-05-08T17:26:50.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:26:51.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test10 size 2 2024-05-08T17:26:52.588 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 10 size to 2 2024-05-08T17:26:52.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:70: TEST_backfill_priority: sleep 5 2024-05-08T17:26:57.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:72: TEST_backfill_priority: wait_for_clean 2024-05-08T17:26:57.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:26:57.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:26:57.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:26:57.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:26:57.615 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:26:57.615 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:26:57.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:26:57.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:26:57.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:26:57.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:26:57.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:26:57.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:26:57.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:26:57.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:26:57.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:26:58.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:26:58.158 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:26:58.158 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:26:58.159 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:26:58.159 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T17:26:58.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:26:58.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:26:58.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:26:58.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836501 2024-05-08T17:26:58.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836501 2024-05-08T17:26:58.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836501' 2024-05-08T17:26:58.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:26:58.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:26:58.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672978 2024-05-08T17:26:58.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672978 2024-05-08T17:26:58.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836501 1-42949672978' 2024-05-08T17:26:58.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:26:58.476 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:26:58.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509455 2024-05-08T17:26:58.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509455 2024-05-08T17:26:58.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836501 1-42949672978 2-64424509455' 2024-05-08T17:26:58.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:26:58.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:26:58.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345933 2024-05-08T17:26:58.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345933 2024-05-08T17:26:58.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836501 1-42949672978 2-64424509455 3-85899345933' 2024-05-08T17:26:58.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:26:58.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:26:58.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182410 2024-05-08T17:26:58.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182410 2024-05-08T17:26:58.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836501 1-42949672978 2-64424509455 3-85899345933 4-107374182410' 2024-05-08T17:26:58.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:26:58.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836501 2024-05-08T17:26:58.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:26:58.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:26:58.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836501 2024-05-08T17:26:58.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:26:58.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836501 2024-05-08T17:26:58.973 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836501 2024-05-08T17:26:58.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2024-05-08T17:26:58.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:26:59.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836501 -lt 21474836501 2024-05-08T17:26:59.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:26:59.387 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672978 2024-05-08T17:26:59.387 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:26:59.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:26:59.389 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672978 2024-05-08T17:26:59.389 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:26:59.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672978 2024-05-08T17:26:59.391 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672978 2024-05-08T17:26:59.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672978' 2024-05-08T17:26:59.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:26:59.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672978 -lt 42949672978 2024-05-08T17:26:59.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:26:59.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509455 2024-05-08T17:26:59.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:26:59.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:26:59.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509455 2024-05-08T17:26:59.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:26:59.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509455 2024-05-08T17:26:59.824 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509455 2024-05-08T17:26:59.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509455' 2024-05-08T17:26:59.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:27:00.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509455 -lt 64424509455 2024-05-08T17:27:00.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:27:00.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345933 2024-05-08T17:27:00.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:27:00.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:27:00.244 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345933 2024-05-08T17:27:00.245 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:27:00.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345933 2024-05-08T17:27:00.246 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345933 2024-05-08T17:27:00.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345933' 2024-05-08T17:27:00.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:27:00.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345931 -lt 85899345933 2024-05-08T17:27:00.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:27:01.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:27:01.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:27:02.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345933 -lt 85899345933 2024-05-08T17:27:02.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:27:02.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182410 2024-05-08T17:27:02.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:27:02.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:27:02.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:27:02.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182410 2024-05-08T17:27:02.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182410 2024-05-08T17:27:02.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182410' 2024-05-08T17:27:02.086 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182410 2024-05-08T17:27:02.086 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:27:02.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182410 -lt 107374182410 2024-05-08T17:27:02.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:27:02.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:27:02.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:27:03.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 10 == 0 2024-05-08T17:27:03.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:27:03.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:27:03.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:27:03.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:27:03.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:27:03.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:27:03.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:27:03.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=10 2024-05-08T17:27:03.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:27:03.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:27:03.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:27:03.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 10 = 10 2024-05-08T17:27:03.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:27:03.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:27:03.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:74: TEST_backfill_priority: ceph pg dump pgs 2024-05-08T17:27:04.436 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T17:27:04.436 INFO:tasks.workunit.client.0.smithi117.stdout:10.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:54.086068+0000 0'0 81:20 [2,1] 2 [2,1] 2 0'0 2024-05-08T17:26:50.298439+0000 0'0 2024-05-08T17:26:50.298439+0000 0 0 periodic scrub scheduled @ 2024-05-09T23:45:09.367986+0000 0 0 2024-05-08T17:27:04.436 INFO:tasks.workunit.client.0.smithi117.stdout:9.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:50.899655+0000 0'0 81:31 [1,2] 1 [1,2] 1 0'0 2024-05-08T17:26:47.729415+0000 0'0 2024-05-08T17:26:47.729415+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:43:50.811813+0000 0 0 2024-05-08T17:27:04.436 INFO:tasks.workunit.client.0.smithi117.stdout:8.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:48.192192+0000 0'0 81:39 [3,4] 3 [3,4] 3 0'0 2024-05-08T17:26:44.465762+0000 0'0 2024-05-08T17:26:44.465762+0000 0 0 periodic scrub scheduled @ 2024-05-09T21:28:22.088561+0000 0 0 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout:7.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:45.154459+0000 0'0 81:51 [1,4] 1 [1,4] 1 0'0 2024-05-08T17:26:41.495828+0000 0'0 2024-05-08T17:26:41.495828+0000 0 0 periodic scrub scheduled @ 2024-05-10T04:19:29.737348+0000 0 0 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout:6.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:42.328764+0000 0'0 81:58 [4,2] 4 [4,2] 4 0'0 2024-05-08T17:26:38.407771+0000 0'0 2024-05-08T17:26:38.407771+0000 0 0 periodic scrub scheduled @ 2024-05-09T20:31:31.776150+0000 0 0 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout:5.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:39.205424+0000 0'0 81:67 [3,4] 3 [3,4] 3 0'0 2024-05-08T17:26:35.066573+0000 0'0 2024-05-08T17:26:35.066573+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:36:11.419113+0000 0 0 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout:4.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:35.650782+0000 0'0 81:79 [4,0] 4 [4,0] 4 0'0 2024-05-08T17:26:32.218255+0000 0'0 2024-05-08T17:26:32.218255+0000 0 0 periodic scrub scheduled @ 2024-05-09T22:20:46.625241+0000 0 0 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:33.225773+0000 0'0 81:87 [1,2] 1 [1,2] 1 0'0 2024-05-08T17:26:29.227710+0000 0'0 2024-05-08T17:26:29.227710+0000 0 0 periodic scrub scheduled @ 2024-05-10T00:11:57.151066+0000 0 0 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:30.217695+0000 0'0 81:99 [3,1] 3 [3,1] 3 0'0 2024-05-08T17:26:26.608982+0000 0'0 2024-05-08T17:26:26.608982+0000 0 0 periodic scrub scheduled @ 2024-05-10T04:29:04.735656+0000 0 0 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T17:26:27.084615+0000 0'0 81:107 [1,0] 1 [1,0] 1 0'0 2024-05-08T17:26:23.271260+0000 0'0 2024-05-08T17:26:23.271260+0000 0 0 periodic scrub scheduled @ 2024-05-10T00:12:25.607324+0000 0 0 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T17:27:04.437 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T17:27:04.438 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:27:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:78: TEST_backfill_priority: local PG1 2024-05-08T17:27:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:79: TEST_backfill_priority: local POOLNUM1 2024-05-08T17:27:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:80: TEST_backfill_priority: local pool1 2024-05-08T17:27:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:81: TEST_backfill_priority: local chk_osd1_1 2024-05-08T17:27:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:82: TEST_backfill_priority: local chk_osd1_2 2024-05-08T17:27:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:84: TEST_backfill_priority: local PG2 2024-05-08T17:27:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:85: TEST_backfill_priority: local POOLNUM2 2024-05-08T17:27:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:86: TEST_backfill_priority: local pool2 2024-05-08T17:27:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:87: TEST_backfill_priority: local chk_osd2 2024-05-08T17:27:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:89: TEST_backfill_priority: local PG3 2024-05-08T17:27:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:90: TEST_backfill_priority: local POOLNUM3 2024-05-08T17:27:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:91: TEST_backfill_priority: local pool3 2024-05-08T17:27:04.453 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: seq 1 10 2024-05-08T17:27:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 1.0 --format=json 2024-05-08T17:27:04.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-05-08T17:27:04.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:27:04.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=1 2024-05-08T17:27:04.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:27:04.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=0 2024-05-08T17:27:04.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z '' ']' 2024-05-08T17:27:04.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:100: TEST_backfill_priority: PG1=1.0 2024-05-08T17:27:04.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:101: TEST_backfill_priority: POOLNUM1=1 2024-05-08T17:27:04.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:102: TEST_backfill_priority: pool1=test1 2024-05-08T17:27:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:103: TEST_backfill_priority: chk_osd1_1=1 2024-05-08T17:27:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:104: TEST_backfill_priority: chk_osd1_2=0 2024-05-08T17:27:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 2.0 --format=json 2024-05-08T17:27:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-05-08T17:27:05.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:27:05.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=3 2024-05-08T17:27:05.279 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:27:05.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=1 2024-05-08T17:27:05.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-05-08T17:27:05.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z '' -a 1 = 3 -a 0 '!=' 1 ']' 2024-05-08T17:27:05.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n '' -a 1 = 3 -a 0 '!=' 1 -a '' '!=' 1 ']' 2024-05-08T17:27:05.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:05.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 3.0 --format=json 2024-05-08T17:27:05.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-05-08T17:27:05.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:27:05.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=1 2024-05-08T17:27:05.690 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:27:05.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=2 2024-05-08T17:27:05.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-05-08T17:27:05.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z '' -a 1 = 1 -a 0 '!=' 2 ']' 2024-05-08T17:27:05.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:107: TEST_backfill_priority: PG2=3.0 2024-05-08T17:27:05.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:108: TEST_backfill_priority: POOLNUM2=3 2024-05-08T17:27:05.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:109: TEST_backfill_priority: pool2=test3 2024-05-08T17:27:05.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:110: TEST_backfill_priority: chk_osd2=2 2024-05-08T17:27:05.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:05.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 4.0 --format=json 2024-05-08T17:27:05.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-05-08T17:27:06.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:27:06.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=4 2024-05-08T17:27:06.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:27:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=0 2024-05-08T17:27:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-05-08T17:27:06.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z 3.0 -a 1 = 4 -a 0 '!=' 0 ']' 2024-05-08T17:27:06.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n 3.0 -a 1 = 4 -a 0 '!=' 0 -a 2 '!=' 0 ']' 2024-05-08T17:27:06.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:06.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 5.0 --format=json 2024-05-08T17:27:06.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-05-08T17:27:06.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:27:06.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=3 2024-05-08T17:27:06.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:27:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=4 2024-05-08T17:27:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-05-08T17:27:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z 3.0 -a 1 = 3 -a 0 '!=' 4 ']' 2024-05-08T17:27:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n 3.0 -a 1 = 3 -a 0 '!=' 4 -a 2 '!=' 4 ']' 2024-05-08T17:27:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-05-08T17:27:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 6.0 --format=json 2024-05-08T17:27:06.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:27:06.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=4 2024-05-08T17:27:06.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:27:06.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=2 2024-05-08T17:27:06.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-05-08T17:27:06.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z 3.0 -a 1 = 4 -a 0 '!=' 2 ']' 2024-05-08T17:27:06.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n 3.0 -a 1 = 4 -a 0 '!=' 2 -a 2 '!=' 2 ']' 2024-05-08T17:27:06.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:06.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 7.0 --format=json 2024-05-08T17:27:06.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-05-08T17:27:07.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-05-08T17:27:07.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=1 2024-05-08T17:27:07.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=4 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z 3.0 -a 1 = 1 -a 0 '!=' 4 ']' 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n 3.0 -a 1 = 1 -a 0 '!=' 4 -a 2 '!=' 4 ']' 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:113: TEST_backfill_priority: PG3=7.0 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:114: TEST_backfill_priority: POOLNUM3=7 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:115: TEST_backfill_priority: pool3=test7 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:116: TEST_backfill_priority: break 2024-05-08T17:27:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:119: TEST_backfill_priority: rm -f td/osd-backfill-prio/acting 2024-05-08T17:27:07.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:121: TEST_backfill_priority: '[' test3 = '' -o pool3 = '' ']' 2024-05-08T17:27:07.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: seq 1 10 2024-05-08T17:27:07.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:07.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 1 '!=' 1 -a 1 '!=' 3 -a 1 '!=' 7 ']' 2024-05-08T17:27:07.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:07.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 2 '!=' 1 -a 2 '!=' 3 -a 2 '!=' 7 ']' 2024-05-08T17:27:07.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test2 2024-05-08T17:27:07.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test2 2024-05-08T17:27:07.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-05-08T17:27:07.976 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' does not exist 2024-05-08T17:27:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 3 '!=' 1 -a 3 '!=' 3 -a 3 '!=' 7 ']' 2024-05-08T17:27:07.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:07.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 4 '!=' 1 -a 4 '!=' 3 -a 4 '!=' 7 ']' 2024-05-08T17:27:07.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test4 2024-05-08T17:27:07.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test4 2024-05-08T17:27:07.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2024-05-08T17:27:08.492 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test4' does not exist 2024-05-08T17:27:08.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:08.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 5 '!=' 1 -a 5 '!=' 3 -a 5 '!=' 7 ']' 2024-05-08T17:27:08.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test5 2024-05-08T17:27:08.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test5 2024-05-08T17:27:08.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2024-05-08T17:27:09.107 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test5' does not exist 2024-05-08T17:27:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 6 '!=' 1 -a 6 '!=' 3 -a 6 '!=' 7 ']' 2024-05-08T17:27:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test6 2024-05-08T17:27:09.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test6 2024-05-08T17:27:09.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2024-05-08T17:27:09.647 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test6' does not exist 2024-05-08T17:27:09.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:09.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 7 '!=' 1 -a 7 '!=' 3 -a 7 '!=' 7 ']' 2024-05-08T17:27:09.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:09.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 8 '!=' 1 -a 8 '!=' 3 -a 8 '!=' 7 ']' 2024-05-08T17:27:09.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test8 2024-05-08T17:27:09.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test8 2024-05-08T17:27:09.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2024-05-08T17:27:10.511 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test8' does not exist 2024-05-08T17:27:10.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:10.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 9 '!=' 1 -a 9 '!=' 3 -a 9 '!=' 7 ']' 2024-05-08T17:27:10.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test9 2024-05-08T17:27:10.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test9 2024-05-08T17:27:10.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test9 test9 --yes-i-really-really-mean-it 2024-05-08T17:27:11.328 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test9' does not exist 2024-05-08T17:27:11.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-05-08T17:27:11.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 10 '!=' 1 -a 10 '!=' 3 -a 10 '!=' 7 ']' 2024-05-08T17:27:11.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test10 2024-05-08T17:27:11.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test10 2024-05-08T17:27:11.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test10 test10 --yes-i-really-really-mean-it 2024-05-08T17:27:12.094 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test10' does not exist 2024-05-08T17:27:12.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:135: TEST_backfill_priority: ceph osd pool set test3 size 1 --yes-i-really-mean-it 2024-05-08T17:27:13.032 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 3 size to 1 2024-05-08T17:27:13.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:136: TEST_backfill_priority: ceph osd pool set test7 size 1 --yes-i-really-mean-it 2024-05-08T17:27:14.172 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 7 size to 1 2024-05-08T17:27:14.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:137: TEST_backfill_priority: wait_for_clean 2024-05-08T17:27:14.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:27:14.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:27:14.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:27:14.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:27:14.193 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:27:14.193 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:27:14.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:27:14.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:27:14.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:27:14.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:27:14.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:27:14.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:27:14.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:27:14.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:27:14.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:27:14.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:27:14.804 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:27:14.804 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:27:14.804 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:27:14.804 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T17:27:14.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:27:14.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:27:14.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:27:15.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836506 2024-05-08T17:27:15.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836506 2024-05-08T17:27:15.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836506' 2024-05-08T17:27:15.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:27:15.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:27:15.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672983 2024-05-08T17:27:15.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672983 2024-05-08T17:27:15.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836506 1-42949672983' 2024-05-08T17:27:15.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:27:15.230 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:27:15.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509460 2024-05-08T17:27:15.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509460 2024-05-08T17:27:15.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836506 1-42949672983 2-64424509460' 2024-05-08T17:27:15.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:27:15.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:27:15.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345938 2024-05-08T17:27:15.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345938 2024-05-08T17:27:15.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836506 1-42949672983 2-64424509460 3-85899345938' 2024-05-08T17:27:15.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:27:15.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:27:15.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182415 2024-05-08T17:27:15.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182415 2024-05-08T17:27:15.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836506 1-42949672983 2-64424509460 3-85899345938 4-107374182415' 2024-05-08T17:27:15.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:27:15.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836506 2024-05-08T17:27:15.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:27:15.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:27:15.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836506 2024-05-08T17:27:15.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:27:15.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836506 2024-05-08T17:27:15.747 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836506 2024-05-08T17:27:15.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2024-05-08T17:27:15.748 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:27:16.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836504 -lt 21474836506 2024-05-08T17:27:16.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:27:17.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:27:17.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:27:17.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836506 -lt 21474836506 2024-05-08T17:27:17.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:27:17.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:27:17.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672983 2024-05-08T17:27:17.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:27:17.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672983 2024-05-08T17:27:17.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:27:17.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672983 2024-05-08T17:27:17.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672983' 2024-05-08T17:27:17.574 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672983 2024-05-08T17:27:17.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:27:17.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672984 -lt 42949672983 2024-05-08T17:27:17.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:27:17.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509460 2024-05-08T17:27:17.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:27:17.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:27:17.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509460 2024-05-08T17:27:17.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:27:17.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509460 2024-05-08T17:27:17.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509460' 2024-05-08T17:27:17.979 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509460 2024-05-08T17:27:17.979 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:27:18.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509461 -lt 64424509460 2024-05-08T17:27:18.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:27:18.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:27:18.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345938 2024-05-08T17:27:18.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:27:18.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345938 2024-05-08T17:27:18.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:27:18.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345938 2024-05-08T17:27:18.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345938' 2024-05-08T17:27:18.384 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345938 2024-05-08T17:27:18.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:27:18.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345939 -lt 85899345938 2024-05-08T17:27:18.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:27:18.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182415 2024-05-08T17:27:18.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:27:18.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:27:18.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182415 2024-05-08T17:27:18.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:27:18.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182415 2024-05-08T17:27:18.866 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182415 2024-05-08T17:27:18.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182415' 2024-05-08T17:27:18.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:27:19.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182416 -lt 107374182415 2024-05-08T17:27:19.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:27:19.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:27:19.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:27:19.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 3 == 0 2024-05-08T17:27:19.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:27:19.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:27:19.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:27:19.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:27:19.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:27:19.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:27:19.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:27:20.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=3 2024-05-08T17:27:20.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:27:20.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:27:20.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:27:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 3 = 3 2024-05-08T17:27:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:27:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:27:20.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:139: TEST_backfill_priority: dd if=/dev/urandom of=td/osd-backfill-prio/data bs=1M count=10 2024-05-08T17:27:20.910 INFO:tasks.workunit.client.0.smithi117.stderr:10+0 records in 2024-05-08T17:27:20.910 INFO:tasks.workunit.client.0.smithi117.stderr:10+0 records out 2024-05-08T17:27:20.910 INFO:tasks.workunit.client.0.smithi117.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0383608 s, 273 MB/s 2024-05-08T17:27:20.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:140: TEST_backfill_priority: p=1 2024-05-08T17:27:20.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:141: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2024-05-08T17:27:20.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: seq 1 50 2024-05-08T17:27:20.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:20.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj1-p1 td/osd-backfill-prio/data 2024-05-08T17:27:21.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:21.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj2-p1 td/osd-backfill-prio/data 2024-05-08T17:27:22.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:22.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj3-p1 td/osd-backfill-prio/data 2024-05-08T17:27:23.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:23.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj4-p1 td/osd-backfill-prio/data 2024-05-08T17:27:23.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:23.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj5-p1 td/osd-backfill-prio/data 2024-05-08T17:27:24.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:24.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj6-p1 td/osd-backfill-prio/data 2024-05-08T17:27:25.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:25.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj7-p1 td/osd-backfill-prio/data 2024-05-08T17:27:26.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:26.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj8-p1 td/osd-backfill-prio/data 2024-05-08T17:27:27.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:27.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj9-p1 td/osd-backfill-prio/data 2024-05-08T17:27:27.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:27.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj10-p1 td/osd-backfill-prio/data 2024-05-08T17:27:28.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:28.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj11-p1 td/osd-backfill-prio/data 2024-05-08T17:27:29.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:29.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj12-p1 td/osd-backfill-prio/data 2024-05-08T17:27:29.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:29.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj13-p1 td/osd-backfill-prio/data 2024-05-08T17:27:30.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:30.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj14-p1 td/osd-backfill-prio/data 2024-05-08T17:27:31.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:31.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj15-p1 td/osd-backfill-prio/data 2024-05-08T17:27:32.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:32.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj16-p1 td/osd-backfill-prio/data 2024-05-08T17:27:33.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:33.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj17-p1 td/osd-backfill-prio/data 2024-05-08T17:27:33.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:33.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj18-p1 td/osd-backfill-prio/data 2024-05-08T17:27:34.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:34.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj19-p1 td/osd-backfill-prio/data 2024-05-08T17:27:35.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:35.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj20-p1 td/osd-backfill-prio/data 2024-05-08T17:27:36.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:36.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj21-p1 td/osd-backfill-prio/data 2024-05-08T17:27:36.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:36.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj22-p1 td/osd-backfill-prio/data 2024-05-08T17:27:37.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:37.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj23-p1 td/osd-backfill-prio/data 2024-05-08T17:27:38.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:38.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj24-p1 td/osd-backfill-prio/data 2024-05-08T17:27:39.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:39.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj25-p1 td/osd-backfill-prio/data 2024-05-08T17:27:39.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:39.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj26-p1 td/osd-backfill-prio/data 2024-05-08T17:27:40.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:40.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj27-p1 td/osd-backfill-prio/data 2024-05-08T17:27:41.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:41.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj28-p1 td/osd-backfill-prio/data 2024-05-08T17:27:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj29-p1 td/osd-backfill-prio/data 2024-05-08T17:27:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj30-p1 td/osd-backfill-prio/data 2024-05-08T17:27:43.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:43.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj31-p1 td/osd-backfill-prio/data 2024-05-08T17:27:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj32-p1 td/osd-backfill-prio/data 2024-05-08T17:27:45.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:45.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj33-p1 td/osd-backfill-prio/data 2024-05-08T17:27:46.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:46.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj34-p1 td/osd-backfill-prio/data 2024-05-08T17:27:46.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:46.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj35-p1 td/osd-backfill-prio/data 2024-05-08T17:27:47.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:47.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj36-p1 td/osd-backfill-prio/data 2024-05-08T17:27:48.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:48.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj37-p1 td/osd-backfill-prio/data 2024-05-08T17:27:49.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:49.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj38-p1 td/osd-backfill-prio/data 2024-05-08T17:27:49.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:49.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj39-p1 td/osd-backfill-prio/data 2024-05-08T17:27:50.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:50.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj40-p1 td/osd-backfill-prio/data 2024-05-08T17:27:51.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:51.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj41-p1 td/osd-backfill-prio/data 2024-05-08T17:27:52.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:52.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj42-p1 td/osd-backfill-prio/data 2024-05-08T17:27:52.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:52.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj43-p1 td/osd-backfill-prio/data 2024-05-08T17:27:53.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:53.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj44-p1 td/osd-backfill-prio/data 2024-05-08T17:27:54.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:54.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj45-p1 td/osd-backfill-prio/data 2024-05-08T17:27:55.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:55.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj46-p1 td/osd-backfill-prio/data 2024-05-08T17:27:55.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:55.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj47-p1 td/osd-backfill-prio/data 2024-05-08T17:27:56.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:56.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj48-p1 td/osd-backfill-prio/data 2024-05-08T17:27:57.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:57.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj49-p1 td/osd-backfill-prio/data 2024-05-08T17:27:58.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:58.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj50-p1 td/osd-backfill-prio/data 2024-05-08T17:27:59.010 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: expr 1 + 1 2024-05-08T17:27:59.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: p=2 2024-05-08T17:27:59.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:141: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2024-05-08T17:27:59.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: seq 1 50 2024-05-08T17:27:59.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:59.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj1-p2 td/osd-backfill-prio/data 2024-05-08T17:27:59.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:59.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj2-p2 td/osd-backfill-prio/data 2024-05-08T17:27:59.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:27:59.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj3-p2 td/osd-backfill-prio/data 2024-05-08T17:28:00.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:00.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj4-p2 td/osd-backfill-prio/data 2024-05-08T17:28:00.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:00.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj5-p2 td/osd-backfill-prio/data 2024-05-08T17:28:01.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:01.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj6-p2 td/osd-backfill-prio/data 2024-05-08T17:28:01.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:01.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj7-p2 td/osd-backfill-prio/data 2024-05-08T17:28:02.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:02.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj8-p2 td/osd-backfill-prio/data 2024-05-08T17:28:02.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:02.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj9-p2 td/osd-backfill-prio/data 2024-05-08T17:28:03.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:03.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj10-p2 td/osd-backfill-prio/data 2024-05-08T17:28:03.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:03.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj11-p2 td/osd-backfill-prio/data 2024-05-08T17:28:03.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:03.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj12-p2 td/osd-backfill-prio/data 2024-05-08T17:28:04.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:04.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj13-p2 td/osd-backfill-prio/data 2024-05-08T17:28:04.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:04.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj14-p2 td/osd-backfill-prio/data 2024-05-08T17:28:05.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:05.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj15-p2 td/osd-backfill-prio/data 2024-05-08T17:28:05.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:05.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj16-p2 td/osd-backfill-prio/data 2024-05-08T17:28:06.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:06.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj17-p2 td/osd-backfill-prio/data 2024-05-08T17:28:06.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:06.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj18-p2 td/osd-backfill-prio/data 2024-05-08T17:28:07.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:07.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj19-p2 td/osd-backfill-prio/data 2024-05-08T17:28:07.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:07.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj20-p2 td/osd-backfill-prio/data 2024-05-08T17:28:07.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:07.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj21-p2 td/osd-backfill-prio/data 2024-05-08T17:28:08.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:08.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj22-p2 td/osd-backfill-prio/data 2024-05-08T17:28:08.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:08.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj23-p2 td/osd-backfill-prio/data 2024-05-08T17:28:09.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:09.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj24-p2 td/osd-backfill-prio/data 2024-05-08T17:28:09.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:09.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj25-p2 td/osd-backfill-prio/data 2024-05-08T17:28:10.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:10.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj26-p2 td/osd-backfill-prio/data 2024-05-08T17:28:10.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:10.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj27-p2 td/osd-backfill-prio/data 2024-05-08T17:28:10.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:10.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj28-p2 td/osd-backfill-prio/data 2024-05-08T17:28:11.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:11.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj29-p2 td/osd-backfill-prio/data 2024-05-08T17:28:11.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:11.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj30-p2 td/osd-backfill-prio/data 2024-05-08T17:28:12.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:12.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj31-p2 td/osd-backfill-prio/data 2024-05-08T17:28:12.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:12.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj32-p2 td/osd-backfill-prio/data 2024-05-08T17:28:13.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:13.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj33-p2 td/osd-backfill-prio/data 2024-05-08T17:28:13.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:13.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj34-p2 td/osd-backfill-prio/data 2024-05-08T17:28:14.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:14.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj35-p2 td/osd-backfill-prio/data 2024-05-08T17:28:14.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:14.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj36-p2 td/osd-backfill-prio/data 2024-05-08T17:28:15.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:15.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj37-p2 td/osd-backfill-prio/data 2024-05-08T17:28:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj38-p2 td/osd-backfill-prio/data 2024-05-08T17:28:16.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:16.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj39-p2 td/osd-backfill-prio/data 2024-05-08T17:28:16.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:16.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj40-p2 td/osd-backfill-prio/data 2024-05-08T17:28:16.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:16.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj41-p2 td/osd-backfill-prio/data 2024-05-08T17:28:17.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:17.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj42-p2 td/osd-backfill-prio/data 2024-05-08T17:28:17.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:17.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj43-p2 td/osd-backfill-prio/data 2024-05-08T17:28:18.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:18.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj44-p2 td/osd-backfill-prio/data 2024-05-08T17:28:18.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:18.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj45-p2 td/osd-backfill-prio/data 2024-05-08T17:28:19.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:19.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj46-p2 td/osd-backfill-prio/data 2024-05-08T17:28:19.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:19.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj47-p2 td/osd-backfill-prio/data 2024-05-08T17:28:20.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:20.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj48-p2 td/osd-backfill-prio/data 2024-05-08T17:28:20.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:20.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj49-p2 td/osd-backfill-prio/data 2024-05-08T17:28:21.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:21.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj50-p2 td/osd-backfill-prio/data 2024-05-08T17:28:21.556 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: expr 2 + 1 2024-05-08T17:28:21.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: p=3 2024-05-08T17:28:21.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:141: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2024-05-08T17:28:21.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: seq 1 50 2024-05-08T17:28:21.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:21.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj1-p3 td/osd-backfill-prio/data 2024-05-08T17:28:21.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:21.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj2-p3 td/osd-backfill-prio/data 2024-05-08T17:28:22.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:22.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj3-p3 td/osd-backfill-prio/data 2024-05-08T17:28:22.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:22.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj4-p3 td/osd-backfill-prio/data 2024-05-08T17:28:23.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:23.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj5-p3 td/osd-backfill-prio/data 2024-05-08T17:28:23.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:23.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj6-p3 td/osd-backfill-prio/data 2024-05-08T17:28:24.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:24.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj7-p3 td/osd-backfill-prio/data 2024-05-08T17:28:24.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:24.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj8-p3 td/osd-backfill-prio/data 2024-05-08T17:28:25.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:25.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj9-p3 td/osd-backfill-prio/data 2024-05-08T17:28:25.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:25.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj10-p3 td/osd-backfill-prio/data 2024-05-08T17:28:26.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:26.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj11-p3 td/osd-backfill-prio/data 2024-05-08T17:28:26.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:26.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj12-p3 td/osd-backfill-prio/data 2024-05-08T17:28:26.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:26.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj13-p3 td/osd-backfill-prio/data 2024-05-08T17:28:27.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:27.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj14-p3 td/osd-backfill-prio/data 2024-05-08T17:28:27.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:27.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj15-p3 td/osd-backfill-prio/data 2024-05-08T17:28:28.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:28.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj16-p3 td/osd-backfill-prio/data 2024-05-08T17:28:28.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:28.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj17-p3 td/osd-backfill-prio/data 2024-05-08T17:28:29.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:29.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj18-p3 td/osd-backfill-prio/data 2024-05-08T17:28:29.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:29.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj19-p3 td/osd-backfill-prio/data 2024-05-08T17:28:30.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:30.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj20-p3 td/osd-backfill-prio/data 2024-05-08T17:28:30.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:30.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj21-p3 td/osd-backfill-prio/data 2024-05-08T17:28:30.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:30.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj22-p3 td/osd-backfill-prio/data 2024-05-08T17:28:31.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:31.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj23-p3 td/osd-backfill-prio/data 2024-05-08T17:28:31.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:31.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj24-p3 td/osd-backfill-prio/data 2024-05-08T17:28:32.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:32.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj25-p3 td/osd-backfill-prio/data 2024-05-08T17:28:32.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:32.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj26-p3 td/osd-backfill-prio/data 2024-05-08T17:28:33.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:33.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj27-p3 td/osd-backfill-prio/data 2024-05-08T17:28:33.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:33.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj28-p3 td/osd-backfill-prio/data 2024-05-08T17:28:34.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:34.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj29-p3 td/osd-backfill-prio/data 2024-05-08T17:28:34.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:34.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj30-p3 td/osd-backfill-prio/data 2024-05-08T17:28:34.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:34.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj31-p3 td/osd-backfill-prio/data 2024-05-08T17:28:35.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:35.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj32-p3 td/osd-backfill-prio/data 2024-05-08T17:28:35.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:35.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj33-p3 td/osd-backfill-prio/data 2024-05-08T17:28:36.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:36.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj34-p3 td/osd-backfill-prio/data 2024-05-08T17:28:36.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:36.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj35-p3 td/osd-backfill-prio/data 2024-05-08T17:28:37.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:37.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj36-p3 td/osd-backfill-prio/data 2024-05-08T17:28:37.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:37.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj37-p3 td/osd-backfill-prio/data 2024-05-08T17:28:38.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:38.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj38-p3 td/osd-backfill-prio/data 2024-05-08T17:28:38.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:38.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj39-p3 td/osd-backfill-prio/data 2024-05-08T17:28:39.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:39.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj40-p3 td/osd-backfill-prio/data 2024-05-08T17:28:39.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:39.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj41-p3 td/osd-backfill-prio/data 2024-05-08T17:28:39.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:39.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj42-p3 td/osd-backfill-prio/data 2024-05-08T17:28:40.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:40.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj43-p3 td/osd-backfill-prio/data 2024-05-08T17:28:40.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:40.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj44-p3 td/osd-backfill-prio/data 2024-05-08T17:28:41.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:41.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj45-p3 td/osd-backfill-prio/data 2024-05-08T17:28:41.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:41.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj46-p3 td/osd-backfill-prio/data 2024-05-08T17:28:42.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:42.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj47-p3 td/osd-backfill-prio/data 2024-05-08T17:28:42.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:42.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj48-p3 td/osd-backfill-prio/data 2024-05-08T17:28:43.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:43.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj49-p3 td/osd-backfill-prio/data 2024-05-08T17:28:43.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-05-08T17:28:43.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj50-p3 td/osd-backfill-prio/data 2024-05-08T17:28:44.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: expr 3 + 1 2024-05-08T17:28:44.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: p=4 2024-05-08T17:28:44.017 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:150: TEST_backfill_priority: get_not_primary test1 obj1-p1 2024-05-08T17:28:44.018 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test1 2024-05-08T17:28:44.018 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1-p1 2024-05-08T17:28:44.018 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test1 obj1-p1 2024-05-08T17:28:44.018 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test1 2024-05-08T17:28:44.018 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1-p1 2024-05-08T17:28:44.019 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test1 obj1-p1 2024-05-08T17:28:44.019 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T17:28:44.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T17:28:44.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test1 obj1-p1 2024-05-08T17:28:44.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T17:28:45.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:150: TEST_backfill_priority: local otherosd=0 2024-05-08T17:28:45.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:152: TEST_backfill_priority: ceph pg dump pgs 2024-05-08T17:28:45.507 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T17:28:45.508 INFO:tasks.workunit.client.0.smithi117.stdout:7.0 45 0 0 0 0 469762048 0 0 34 100 34 active+clean 2024-05-08T17:27:14.813685+0000 94'134 94:210 [1] 1 [1] 1 0'0 2024-05-08T17:26:41.495828+0000 0'0 2024-05-08T17:26:41.495828+0000 0 0 periodic scrub scheduled @ 2024-05-09T21:57:40.117686+0000 0 0 2024-05-08T17:28:45.508 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-05-08T17:27:13.655918+0000 94'150 94:263 [1] 1 [1] 1 0'0 2024-05-08T17:26:29.227710+0000 0'0 2024-05-08T17:26:29.227710+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:01:33.781301+0000 0 0 2024-05-08T17:28:45.508 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-05-08T17:26:27.084615+0000 94'150 94:280 [1,0] 1 [1,0] 1 0'0 2024-05-08T17:26:23.271260+0000 0'0 2024-05-08T17:26:23.271260+0000 0 0 periodic scrub scheduled @ 2024-05-10T00:12:25.607324+0000 0 0 2024-05-08T17:28:45.508 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T17:28:45.508 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T17:28:45.508 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:28:45.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:153: TEST_backfill_priority: ERRORS=0 2024-05-08T17:28:45.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:155: TEST_backfill_priority: ceph osd set nobackfill 2024-05-08T17:28:46.149 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T17:28:46.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:156: TEST_backfill_priority: ceph osd set noout 2024-05-08T17:28:47.119 INFO:tasks.workunit.client.0.smithi117.stderr:noout is set 2024-05-08T17:28:47.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:160: TEST_backfill_priority: ceph osd pool set test7 size 2 2024-05-08T17:28:47.923 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 7 size to 2 2024-05-08T17:28:47.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:161: TEST_backfill_priority: sleep 2 2024-05-08T17:28:49.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:163: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:28:49.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:28:49.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:28:49.950 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:28:49.950 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:28:49.950 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:28:49.950 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:28:49.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:163: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:28:49.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:163: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:28:50.068 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:28:50.068 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:28:50.068 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:28:50.068 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:28:50.068 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:28:50.068 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:28:50.068 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:28:50.069 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:28:50.069 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:28:50.069 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:28:50.069 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:28:50.069 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:28:50.069 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:28:50.069 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:28:50.069 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:28:50.070 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:28:50.070 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:28:50.070 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:28:50.070 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:28:50.070 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:28:50.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:166: TEST_backfill_priority: seq 1 10 2024-05-08T17:28:50.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:166: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2024-05-08T17:28:50.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: ceph pg force-backfill 7.0 2024-05-08T17:28:50.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2024-05-08T17:28:50.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:171: TEST_backfill_priority: '[' 1 = 10 ']' 2024-05-08T17:28:50.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:175: TEST_backfill_priority: sleep 2 2024-05-08T17:28:52.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:166: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2024-05-08T17:28:52.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: ceph pg force-backfill 7.0 2024-05-08T17:28:52.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2024-05-08T17:28:52.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:169: TEST_backfill_priority: break 2024-05-08T17:28:52.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:177: TEST_backfill_priority: flush_pg_stats 2024-05-08T17:28:52.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:28:52.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:28:53.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:28:53.325 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:28:53.326 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:28:53.326 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:28:53.326 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T17:28:53.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:28:53.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:28:53.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:28:53.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836528 2024-05-08T17:28:53.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836528 2024-05-08T17:28:53.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836528' 2024-05-08T17:28:53.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:28:53.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:28:53.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673005 2024-05-08T17:28:53.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673005 2024-05-08T17:28:53.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836528 1-42949673005' 2024-05-08T17:28:53.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:28:53.651 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:28:53.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509482 2024-05-08T17:28:53.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509482 2024-05-08T17:28:53.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836528 1-42949673005 2-64424509482' 2024-05-08T17:28:53.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:28:53.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:28:53.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345960 2024-05-08T17:28:53.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345960 2024-05-08T17:28:53.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836528 1-42949673005 2-64424509482 3-85899345960' 2024-05-08T17:28:53.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:28:53.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:28:54.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182437 2024-05-08T17:28:54.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182437 2024-05-08T17:28:54.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836528 1-42949673005 2-64424509482 3-85899345960 4-107374182437' 2024-05-08T17:28:54.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:28:54.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836528 2024-05-08T17:28:54.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:28:54.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:28:54.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836528 2024-05-08T17:28:54.109 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:28:54.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836528 2024-05-08T17:28:54.110 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836528 2024-05-08T17:28:54.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836528' 2024-05-08T17:28:54.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:28:54.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836525 -lt 21474836528 2024-05-08T17:28:54.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:28:55.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:28:55.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:28:55.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836528 -lt 21474836528 2024-05-08T17:28:55.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:28:55.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673005 2024-05-08T17:28:55.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:28:55.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:28:55.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673005 2024-05-08T17:28:55.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:28:55.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673005 2024-05-08T17:28:55.963 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673005 2024-05-08T17:28:55.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673005' 2024-05-08T17:28:55.964 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:28:56.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673005 -lt 42949673005 2024-05-08T17:28:56.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:28:56.389 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509482 2024-05-08T17:28:56.389 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:28:56.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:28:56.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509482 2024-05-08T17:28:56.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:28:56.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509482 2024-05-08T17:28:56.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509482' 2024-05-08T17:28:56.392 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509482 2024-05-08T17:28:56.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:28:56.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509482 -lt 64424509482 2024-05-08T17:28:56.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:28:56.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345960 2024-05-08T17:28:56.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:28:56.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:28:56.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345960 2024-05-08T17:28:56.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:28:56.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345960 2024-05-08T17:28:56.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345960' 2024-05-08T17:28:56.830 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345960 2024-05-08T17:28:56.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:28:57.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345960 -lt 85899345960 2024-05-08T17:28:57.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:28:57.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182437 2024-05-08T17:28:57.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:28:57.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:28:57.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182437 2024-05-08T17:28:57.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:28:57.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182437 2024-05-08T17:28:57.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182437' 2024-05-08T17:28:57.252 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182437 2024-05-08T17:28:57.253 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:28:57.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182437 -lt 107374182437 2024-05-08T17:28:57.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:178: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:28:57.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:28:57.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:28:57.704 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:28:57.704 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:28:57.704 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:28:57.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:28:57.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:178: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:28:57.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:178: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:28:57.804 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:28:57.805 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:28:57.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:180: TEST_backfill_priority: ceph osd out osd.0 2024-05-08T17:28:58.357 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T17:28:58.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:181: TEST_backfill_priority: sleep 2 2024-05-08T17:29:00.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:182: TEST_backfill_priority: flush_pg_stats 2024-05-08T17:29:00.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:29:00.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:29:00.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:29:00.841 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:29:00.841 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:29:00.841 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:29:00.841 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T17:29:00.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:29:00.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:00.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:29:01.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836531 2024-05-08T17:29:01.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836531 2024-05-08T17:29:01.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836531' 2024-05-08T17:29:01.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:01.024 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:29:01.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673008 2024-05-08T17:29:01.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673008 2024-05-08T17:29:01.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836531 1-42949673008' 2024-05-08T17:29:01.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:01.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:29:01.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509486 2024-05-08T17:29:01.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509486 2024-05-08T17:29:01.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836531 1-42949673008 2-64424509486' 2024-05-08T17:29:01.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:01.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:29:01.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345963 2024-05-08T17:29:01.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345963 2024-05-08T17:29:01.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836531 1-42949673008 2-64424509486 3-85899345963' 2024-05-08T17:29:01.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:01.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:29:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182440 2024-05-08T17:29:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182440 2024-05-08T17:29:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836531 1-42949673008 2-64424509486 3-85899345963 4-107374182440' 2024-05-08T17:29:01.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:01.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836531 2024-05-08T17:29:01.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:01.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:29:01.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836531 2024-05-08T17:29:01.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:01.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836531 2024-05-08T17:29:01.701 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836531 2024-05-08T17:29:01.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836531' 2024-05-08T17:29:01.701 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:29:02.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836529 -lt 21474836531 2024-05-08T17:29:02.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:29:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:29:03.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:29:03.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836531 -lt 21474836531 2024-05-08T17:29:03.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:03.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673008 2024-05-08T17:29:03.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:03.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:29:03.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673008 2024-05-08T17:29:03.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:03.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673008 2024-05-08T17:29:03.561 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673008 2024-05-08T17:29:03.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673008' 2024-05-08T17:29:03.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:29:04.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673009 -lt 42949673008 2024-05-08T17:29:04.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:04.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509486 2024-05-08T17:29:04.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:04.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:29:04.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509486 2024-05-08T17:29:04.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:04.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509486 2024-05-08T17:29:04.016 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509486 2024-05-08T17:29:04.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509486' 2024-05-08T17:29:04.017 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:29:04.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509486 -lt 64424509486 2024-05-08T17:29:04.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:04.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345963 2024-05-08T17:29:04.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:04.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:29:04.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345963 2024-05-08T17:29:04.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:04.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345963 2024-05-08T17:29:04.440 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345963 2024-05-08T17:29:04.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345963' 2024-05-08T17:29:04.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:29:04.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345963 -lt 85899345963 2024-05-08T17:29:04.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:04.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182440 2024-05-08T17:29:04.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:04.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:29:04.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182440 2024-05-08T17:29:04.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182440 2024-05-08T17:29:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182440' 2024-05-08T17:29:04.859 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182440 2024-05-08T17:29:04.860 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:29:05.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182441 -lt 107374182440 2024-05-08T17:29:05.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:183: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:29:05.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:29:05.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:29:05.284 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:29:05.284 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:29:05.284 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:29:05.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:29:05.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:183: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:29:05.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:183: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:05.379 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:05.379 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:05.379 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:05.379 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:05.379 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:05.379 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:05.379 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:05.380 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:05.381 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:05.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:184: TEST_backfill_priority: ceph pg dump pgs 2024-05-08T17:29:05.771 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T17:29:05.771 INFO:tasks.workunit.client.0.smithi117.stdout:7.0 50 0 50 0 0 524288000 0 0 50 100 50 active+undersized+degraded+remapped+backfilling+forced_backfill 2024-05-08T17:28:52.813861+0000 94'150 105:250 [1,4] 1 [1] 1 0'0 2024-05-08T17:26:41.495828+0000 0'0 2024-05-08T17:26:41.495828+0000 0 0 no scrub is scheduled 0 0 2024-05-08T17:29:05.771 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-05-08T17:27:13.655918+0000 94'150 105:282 [1] 1 [1] 1 0'0 2024-05-08T17:26:29.227710+0000 0'0 2024-05-08T17:26:29.227710+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:01:33.781301+0000 0 0 2024-05-08T17:29:05.772 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 50 0 0 50 0 524288000 0 0 50 100 50 active+remapped+backfill_wait 2024-05-08T17:29:00.726712+0000 94'150 105:302 [1,2] 1 [1,0] 1 0'0 2024-05-08T17:26:23.271260+0000 0'0 2024-05-08T17:26:23.271260+0000 0 0 no scrub is scheduled 0 0 2024-05-08T17:29:05.772 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T17:29:05.772 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T17:29:05.772 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:29:05.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:186: TEST_backfill_priority: ceph osd pool set test3 size 2 2024-05-08T17:29:06.422 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 3 size to 2 2024-05-08T17:29:06.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:187: TEST_backfill_priority: sleep 2 2024-05-08T17:29:08.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:188: TEST_backfill_priority: flush_pg_stats 2024-05-08T17:29:08.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:29:08.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:29:08.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:29:08.890 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:29:08.890 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:29:08.890 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:29:08.890 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T17:29:08.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:29:08.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:08.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:29:09.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836535 2024-05-08T17:29:09.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836535 2024-05-08T17:29:09.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535' 2024-05-08T17:29:09.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:09.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:29:09.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673012 2024-05-08T17:29:09.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673012 2024-05-08T17:29:09.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673012' 2024-05-08T17:29:09.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:09.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:29:09.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509489 2024-05-08T17:29:09.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509489 2024-05-08T17:29:09.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673012 2-64424509489' 2024-05-08T17:29:09.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:09.410 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:29:09.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345967 2024-05-08T17:29:09.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345967 2024-05-08T17:29:09.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673012 2-64424509489 3-85899345967' 2024-05-08T17:29:09.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:09.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:29:09.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182444 2024-05-08T17:29:09.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182444 2024-05-08T17:29:09.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673012 2-64424509489 3-85899345967 4-107374182444' 2024-05-08T17:29:09.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:09.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836535 2024-05-08T17:29:09.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:09.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:29:09.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836535 2024-05-08T17:29:09.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:09.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836535 2024-05-08T17:29:09.721 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836535 2024-05-08T17:29:09.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836535' 2024-05-08T17:29:09.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:29:10.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836533 -lt 21474836535 2024-05-08T17:29:10.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:29:11.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:29:11.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:29:11.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836535 -lt 21474836535 2024-05-08T17:29:11.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:11.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:11.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673012 2024-05-08T17:29:11.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:29:11.545 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673012 2024-05-08T17:29:11.545 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:11.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673012 2024-05-08T17:29:11.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673012' 2024-05-08T17:29:11.547 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673012 2024-05-08T17:29:11.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:29:11.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673012 -lt 42949673012 2024-05-08T17:29:11.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:11.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509489 2024-05-08T17:29:11.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:11.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:29:11.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509489 2024-05-08T17:29:11.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:11.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509489 2024-05-08T17:29:11.980 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509489 2024-05-08T17:29:11.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509489' 2024-05-08T17:29:11.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:29:12.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509490 -lt 64424509489 2024-05-08T17:29:12.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:12.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:12.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345967 2024-05-08T17:29:12.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:29:12.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345967 2024-05-08T17:29:12.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:12.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345967 2024-05-08T17:29:12.381 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345967 2024-05-08T17:29:12.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345967' 2024-05-08T17:29:12.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:29:12.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345967 -lt 85899345967 2024-05-08T17:29:12.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:12.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182444 2024-05-08T17:29:12.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:12.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:29:12.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182444 2024-05-08T17:29:12.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:12.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182444 2024-05-08T17:29:12.805 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182444 2024-05-08T17:29:12.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182444' 2024-05-08T17:29:12.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:29:13.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182445 -lt 107374182444 2024-05-08T17:29:13.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:189: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:29:13.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:29:13.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:29:13.217 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:29:13.217 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:29:13.217 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:29:13.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:29:13.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:189: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:29:13.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:189: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:13.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:190: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:13.336 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:13.336 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:13.336 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:13.336 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:13.336 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:13.337 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:13.338 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:13.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:191: TEST_backfill_priority: ceph pg dump pgs 2024-05-08T17:29:13.736 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T17:29:13.736 INFO:tasks.workunit.client.0.smithi117.stdout:7.0 50 0 50 0 0 524288000 0 0 50 100 50 active+undersized+degraded+remapped+backfilling+forced_backfill 2024-05-08T17:28:52.813861+0000 94'150 109:258 [1,4] 1 [1] 1 0'0 2024-05-08T17:26:41.495828+0000 0'0 2024-05-08T17:26:41.495828+0000 0 0 no scrub is scheduled 0 0 2024-05-08T17:29:13.736 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 50 0 50 0 0 524288000 0 0 50 100 50 active+undersized+degraded+remapped+backfill_wait 2024-05-08T17:29:07.855721+0000 94'150 109:291 [1,2] 1 [1] 1 0'0 2024-05-08T17:26:29.227710+0000 0'0 2024-05-08T17:26:29.227710+0000 0 0 no scrub is scheduled 0 0 2024-05-08T17:29:13.736 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 50 0 0 50 0 524288000 0 0 50 100 50 active+remapped+backfill_wait 2024-05-08T17:29:00.726712+0000 94'150 109:310 [1,2] 1 [1,0] 1 0'0 2024-05-08T17:26:23.271260+0000 0'0 2024-05-08T17:26:23.271260+0000 0 0 no scrub is scheduled 0 0 2024-05-08T17:29:13.736 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T17:29:13.736 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T17:29:13.737 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:29:13.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:193: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:13.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:193: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "1.0")).prio' 2024-05-08T17:29:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:193: TEST_backfill_priority: PRIO=110 2024-05-08T17:29:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:194: TEST_backfill_priority: '[' 110 '!=' 110 ']' 2024-05-08T17:29:13.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:201: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:13.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:201: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2024-05-08T17:29:13.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:201: TEST_backfill_priority: eval 'ITEM="7.0"' 2024-05-08T17:29:13.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:201: TEST_backfill_priority: ITEM=7.0 2024-05-08T17:29:13.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:202: TEST_backfill_priority: '[' 7.0 '!=' 7.0 ']' 2024-05-08T17:29:13.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:207: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:13.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:207: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2024-05-08T17:29:13.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:207: TEST_backfill_priority: PRIO=254 2024-05-08T17:29:13.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:208: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2024-05-08T17:29:13.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:216: TEST_backfill_priority: seq 1 10 2024-05-08T17:29:13.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:216: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2024-05-08T17:29:13.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:218: TEST_backfill_priority: ceph pg force-backfill 3.0 2024-05-08T17:29:13.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:218: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2024-05-08T17:29:14.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:219: TEST_backfill_priority: break 2024-05-08T17:29:14.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:227: TEST_backfill_priority: sleep 2 2024-05-08T17:29:16.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:228: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:29:16.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:29:16.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:29:16.243 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:29:16.243 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:29:16.243 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:29:16.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:29:16.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:228: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:29:16.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:228: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:16.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:229: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:16.369 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:16.369 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:16.369 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:16.369 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:16.369 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:16.369 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:16.369 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 254, 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:16.370 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:16.371 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:16.372 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:16.372 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:16.372 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:16.372 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:16.372 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:16.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:230: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:16.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:230: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "3.0")).prio' 2024-05-08T17:29:16.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:230: TEST_backfill_priority: PRIO=254 2024-05-08T17:29:16.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:231: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2024-05-08T17:29:16.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:236: TEST_backfill_priority: flush_pg_stats 2024-05-08T17:29:16.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:29:16.410 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:29:16.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:29:16.802 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:29:16.802 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:29:16.802 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:29:16.802 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T17:29:16.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:29:16.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:16.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:29:16.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836538 2024-05-08T17:29:16.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836538 2024-05-08T17:29:16.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538' 2024-05-08T17:29:16.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:16.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:29:17.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673016 2024-05-08T17:29:17.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673016 2024-05-08T17:29:17.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673016' 2024-05-08T17:29:17.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:17.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:29:17.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509493 2024-05-08T17:29:17.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509493 2024-05-08T17:29:17.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673016 2-64424509493' 2024-05-08T17:29:17.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:17.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:29:17.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345970 2024-05-08T17:29:17.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345970 2024-05-08T17:29:17.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673016 2-64424509493 3-85899345970' 2024-05-08T17:29:17.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:17.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:29:17.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182448 2024-05-08T17:29:17.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182448 2024-05-08T17:29:17.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673016 2-64424509493 3-85899345970 4-107374182448' 2024-05-08T17:29:17.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:17.610 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836538 2024-05-08T17:29:17.610 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:17.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:29:17.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836538 2024-05-08T17:29:17.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:17.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836538 2024-05-08T17:29:17.612 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836538 2024-05-08T17:29:17.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836538' 2024-05-08T17:29:17.613 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:29:18.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836536 -lt 21474836538 2024-05-08T17:29:18.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:29:19.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:29:19.024 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:29:19.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836539 -lt 21474836538 2024-05-08T17:29:19.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:19.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673016 2024-05-08T17:29:19.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:19.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:29:19.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673016 2024-05-08T17:29:19.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:19.438 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673016 2024-05-08T17:29:19.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673016 2024-05-08T17:29:19.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673016' 2024-05-08T17:29:19.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:29:19.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673016 -lt 42949673016 2024-05-08T17:29:19.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:19.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:19.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509493 2024-05-08T17:29:19.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:29:19.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509493 2024-05-08T17:29:19.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:19.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509493 2024-05-08T17:29:19.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509493' 2024-05-08T17:29:19.848 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509493 2024-05-08T17:29:19.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:29:20.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509493 -lt 64424509493 2024-05-08T17:29:20.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:20.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345970 2024-05-08T17:29:20.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:20.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:29:20.273 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:20.273 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345970 2024-05-08T17:29:20.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345970 2024-05-08T17:29:20.274 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345970 2024-05-08T17:29:20.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345970' 2024-05-08T17:29:20.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:29:20.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345971 -lt 85899345970 2024-05-08T17:29:20.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:20.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182448 2024-05-08T17:29:20.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:20.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:29:20.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182448 2024-05-08T17:29:20.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:20.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182448 2024-05-08T17:29:20.697 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182448 2024-05-08T17:29:20.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182448' 2024-05-08T17:29:20.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:29:21.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182448 -lt 107374182448 2024-05-08T17:29:21.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:239: TEST_backfill_priority: ceph pg cancel-force-backfill 7.0 2024-05-08T17:29:21.571 INFO:tasks.workunit.client.0.smithi117.stderr:instructing pg(s) [7.0] on osd.1 to cancel-force-backfill; 2024-05-08T17:29:21.571 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:29:21.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:240: TEST_backfill_priority: sleep 2 2024-05-08T17:29:23.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:241: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:29:23.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:29:23.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:29:23.595 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:29:23.595 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:29:23.595 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:29:23.596 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:29:23.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:241: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:29:23.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:241: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:23.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:242: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:23.723 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:23.724 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:23.725 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:23.726 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:23.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:243: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:23.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:243: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "7.0")).prio' 2024-05-08T17:29:23.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:243: TEST_backfill_priority: PRIO=151 2024-05-08T17:29:23.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:244: TEST_backfill_priority: '[' 151 '!=' 151 ']' 2024-05-08T17:29:23.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:250: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:23.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:250: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2024-05-08T17:29:23.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:250: TEST_backfill_priority: eval 'ITEM="3.0"' 2024-05-08T17:29:23.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:250: TEST_backfill_priority: ITEM=3.0 2024-05-08T17:29:23.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:251: TEST_backfill_priority: '[' 3.0 '!=' 3.0 ']' 2024-05-08T17:29:23.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:256: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2024-05-08T17:29:23.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:256: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:23.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:256: TEST_backfill_priority: PRIO=254 2024-05-08T17:29:23.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:257: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2024-05-08T17:29:23.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:264: TEST_backfill_priority: ceph pg cancel-force-backfill 3.0 2024-05-08T17:29:24.245 INFO:tasks.workunit.client.0.smithi117.stderr:instructing pg(s) [3.0] on osd.1 to cancel-force-backfill; 2024-05-08T17:29:24.245 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:29:24.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:265: TEST_backfill_priority: sleep 5 2024-05-08T17:29:29.263 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:266: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:29:29.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:29:29.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:29:29.264 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:29:29.265 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:29:29.265 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:29:29.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:29:29.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:266: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:29:29.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:266: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:29.381 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:29.381 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:29.382 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:29.383 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:29.384 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:29.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:269: TEST_backfill_priority: flush_pg_stats 2024-05-08T17:29:29.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:29:29.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:29:29.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:29:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:29:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:29:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:29:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T17:29:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:29:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:29.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:29:30.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836543 2024-05-08T17:29:30.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836543 2024-05-08T17:29:30.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543' 2024-05-08T17:29:30.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:30.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:29:30.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673020 2024-05-08T17:29:30.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673020 2024-05-08T17:29:30.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673020' 2024-05-08T17:29:30.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:30.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:29:30.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509497 2024-05-08T17:29:30.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509497 2024-05-08T17:29:30.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673020 2-64424509497' 2024-05-08T17:29:30.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:30.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:29:30.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345975 2024-05-08T17:29:30.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345975 2024-05-08T17:29:30.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673020 2-64424509497 3-85899345975' 2024-05-08T17:29:30.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:30.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:29:30.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182452 2024-05-08T17:29:30.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182452 2024-05-08T17:29:30.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673020 2-64424509497 3-85899345975 4-107374182452' 2024-05-08T17:29:30.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:30.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:30.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836543 2024-05-08T17:29:30.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:29:30.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:30.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836543 2024-05-08T17:29:30.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836543 2024-05-08T17:29:30.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836543' 2024-05-08T17:29:30.650 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836543 2024-05-08T17:29:30.651 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:29:31.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836543 -lt 21474836543 2024-05-08T17:29:31.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:31.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673020 2024-05-08T17:29:31.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:31.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:29:31.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673020 2024-05-08T17:29:31.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:31.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673020 2024-05-08T17:29:31.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673020' 2024-05-08T17:29:31.075 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673020 2024-05-08T17:29:31.075 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:29:31.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673020 -lt 42949673020 2024-05-08T17:29:31.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:31.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509497 2024-05-08T17:29:31.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:31.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:29:31.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:31.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509497 2024-05-08T17:29:31.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509497 2024-05-08T17:29:31.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509497' 2024-05-08T17:29:31.515 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509497 2024-05-08T17:29:31.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:29:31.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509498 -lt 64424509497 2024-05-08T17:29:31.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:31.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345975 2024-05-08T17:29:31.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:31.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:29:31.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345975 2024-05-08T17:29:31.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:31.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345975 2024-05-08T17:29:31.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345975' 2024-05-08T17:29:31.951 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345975 2024-05-08T17:29:31.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:29:32.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345975 -lt 85899345975 2024-05-08T17:29:32.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:32.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182452 2024-05-08T17:29:32.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:32.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:29:32.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182452 2024-05-08T17:29:32.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:32.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182452 2024-05-08T17:29:32.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182452' 2024-05-08T17:29:32.370 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182452 2024-05-08T17:29:32.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:29:32.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182452 -lt 107374182452 2024-05-08T17:29:32.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:270: TEST_backfill_priority: ceph pg force-backfill 7.0 2024-05-08T17:29:33.177 INFO:tasks.workunit.client.0.smithi117.stderr:instructing pg(s) [7.0] on osd.1 to force-backfill; 2024-05-08T17:29:33.177 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-05-08T17:29:33.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:271: TEST_backfill_priority: sleep 2 2024-05-08T17:29:35.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:273: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:29:35.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:29:35.197 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:29:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:29:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:29:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:29:35.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:29:35.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:273: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:29:35.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:273: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:35.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:274: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:35.328 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:35.328 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:35.328 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:35.328 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:35.328 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:35.328 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:35.328 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:35.329 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:35.330 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:35.331 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:35.331 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:35.331 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:35.331 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:35.331 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:275: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:35.331 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:275: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "3.0")).prio' 2024-05-08T17:29:35.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:275: TEST_backfill_priority: PRIO=151 2024-05-08T17:29:35.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:276: TEST_backfill_priority: '[' 151 '!=' 151 ']' 2024-05-08T17:29:35.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:282: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2024-05-08T17:29:35.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:282: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:282: TEST_backfill_priority: eval 'ITEM="7.0"' 2024-05-08T17:29:35.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:282: TEST_backfill_priority: ITEM=7.0 2024-05-08T17:29:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:283: TEST_backfill_priority: '[' 7.0 '!=' 7.0 ']' 2024-05-08T17:29:35.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:288: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-05-08T17:29:35.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:288: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2024-05-08T17:29:35.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:288: TEST_backfill_priority: PRIO=254 2024-05-08T17:29:35.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:289: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2024-05-08T17:29:35.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:296: TEST_backfill_priority: ceph osd unset noout 2024-05-08T17:29:36.178 INFO:tasks.workunit.client.0.smithi117.stderr:noout is unset 2024-05-08T17:29:36.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:297: TEST_backfill_priority: ceph osd unset nobackfill 2024-05-08T17:29:37.032 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T17:29:37.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:299: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:29:37.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:29:37.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:29:37.057 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:29:37.057 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:29:37.057 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:29:37.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:29:37.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:299: TEST_backfill_priority: wait_for_clean 'CEPH_ARGS='\'''\'' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations' 2024-05-08T17:29:37.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local 'cmd=CEPH_ARGS='\'''\'' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations' 2024-05-08T17:29:37.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:29:37.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:29:37.058 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:29:37.058 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:29:37.059 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:29:37.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:29:37.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:29:37.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:29:37.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:29:37.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:29:37.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:29:37.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:29:37.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:29:37.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:29:37.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:29:37.600 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:29:37.600 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:29:37.600 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:29:37.600 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T17:29:37.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:29:37.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:37.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:29:37.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836546 2024-05-08T17:29:37.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836546 2024-05-08T17:29:37.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546' 2024-05-08T17:29:37.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:37.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:29:37.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673024 2024-05-08T17:29:37.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673024 2024-05-08T17:29:37.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546 1-42949673024' 2024-05-08T17:29:37.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:37.988 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:29:38.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509501 2024-05-08T17:29:38.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509501 2024-05-08T17:29:38.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546 1-42949673024 2-64424509501' 2024-05-08T17:29:38.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:38.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:29:38.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345978 2024-05-08T17:29:38.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345978 2024-05-08T17:29:38.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546 1-42949673024 2-64424509501 3-85899345978' 2024-05-08T17:29:38.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:29:38.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:29:38.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182456 2024-05-08T17:29:38.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182456 2024-05-08T17:29:38.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546 1-42949673024 2-64424509501 3-85899345978 4-107374182456' 2024-05-08T17:29:38.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:38.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836546 2024-05-08T17:29:38.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:38.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:29:38.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836546 2024-05-08T17:29:38.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:38.484 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836546 2024-05-08T17:29:38.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836546 2024-05-08T17:29:38.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836546' 2024-05-08T17:29:38.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:29:38.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836547 -lt 21474836546 2024-05-08T17:29:38.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:38.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673024 2024-05-08T17:29:38.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:38.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:29:38.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673024 2024-05-08T17:29:38.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:38.961 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673024 2024-05-08T17:29:38.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673024 2024-05-08T17:29:38.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673024' 2024-05-08T17:29:38.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:29:39.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673024 -lt 42949673024 2024-05-08T17:29:39.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:39.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509501 2024-05-08T17:29:39.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:39.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:29:39.495 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509501 2024-05-08T17:29:39.495 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:39.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509501 2024-05-08T17:29:39.496 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509501 2024-05-08T17:29:39.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509501' 2024-05-08T17:29:39.497 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:29:40.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509501 -lt 64424509501 2024-05-08T17:29:40.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:40.043 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345978 2024-05-08T17:29:40.043 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:40.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:29:40.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345978 2024-05-08T17:29:40.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:40.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345978 2024-05-08T17:29:40.046 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345978 2024-05-08T17:29:40.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345978' 2024-05-08T17:29:40.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:29:40.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345979 -lt 85899345978 2024-05-08T17:29:40.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:29:40.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182456 2024-05-08T17:29:40.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:29:40.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:29:40.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182456 2024-05-08T17:29:40.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:29:40.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182456 2024-05-08T17:29:40.540 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182456 2024-05-08T17:29:40.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182456' 2024-05-08T17:29:40.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:29:40.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182456 -lt 107374182456 2024-05-08T17:29:40.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:29:40.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:40.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:41.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 3 == 0 2024-05-08T17:29:41.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:41.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:41.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:41.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:41.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:41.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:41.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:41.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:41.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:41.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:41.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:42.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:42.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T17:29:42.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:29:42.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T17:29:42.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:42.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:42.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:42.620 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:42.621 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:42.622 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:42.623 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:42.624 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:42.624 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:42.624 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:42.624 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:42.624 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:42.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:42.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:42.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:42.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:42.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:42.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:42.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:42.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:42.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:43.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:43.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:43.202 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:43.202 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:43.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:43.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:43.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:43.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:43.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:43.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:43.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:43.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:43.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:44.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=9668298 2024-05-08T17:29:44.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 9668298 '!=' null 2024-05-08T17:29:44.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:44.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:44.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:44.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:44.482 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:44.483 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:44.484 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:44.485 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:44.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:44.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:44.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:44.598 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:44.598 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:44.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:44.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:44.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:44.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:45.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:45.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:45.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:45.013 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:45.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:45.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:45.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:45.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:45.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:45.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:45.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:45.553 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:45.553 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:46.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=7862104 2024-05-08T17:29:46.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 7862104 '!=' null 2024-05-08T17:29:46.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:46.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:46.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:46.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:46.240 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:46.240 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:46.240 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:46.241 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:46.242 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:46.243 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:46.244 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:46.244 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:46.244 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:46.244 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:46.244 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:46.244 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:46.244 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:46.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:46.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:46.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:46.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:46.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:46.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:46.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:46.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:46.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:46.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:46.760 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:46.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:46.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:47.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:47.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:47.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:47.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:47.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:47.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:47.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:47.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:47.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:47.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=15811995 2024-05-08T17:29:47.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 15811995 '!=' null 2024-05-08T17:29:47.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:47.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:47.895 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:47.895 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:48.005 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:48.006 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:48.007 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:48.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:48.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:48.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:48.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:48.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:48.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:48.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:48.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:48.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:48.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:48.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:48.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:48.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:49.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:49.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=13466022 2024-05-08T17:29:49.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 13466022 '!=' null 2024-05-08T17:29:49.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:49.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:49.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:49.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:49.965 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:49.966 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:49.967 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:49.968 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:49.968 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:49.968 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:49.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:50.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:50.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:50.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:50.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:50.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:50.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:50.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:50.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:50.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:50.508 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:50.508 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:50.508 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:51.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:51.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:51.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=13103403 2024-05-08T17:29:51.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 13103403 '!=' null 2024-05-08T17:29:51.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:51.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:51.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:51.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:51.912 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:51.913 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:51.914 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:51.915 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:51.915 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:51.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:52.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:52.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:52.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:52.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:52.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:52.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:52.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:52.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:52.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:52.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:52.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:52.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:52.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:52.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:52.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:52.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:52.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:52.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:52.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:52.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:52.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:53.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=20092048 2024-05-08T17:29:53.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 20092048 '!=' null 2024-05-08T17:29:53.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:53.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:53.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:53.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:53.833 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:53.834 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:53.835 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:53.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:53.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:53.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:53.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:53.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:53.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:53.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:53.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:53.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:54.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:54.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:54.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:54.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:54.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:54.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:54.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:54.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:54.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:54.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:54.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:54.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:54.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:55.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14850459 2024-05-08T17:29:55.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14850459 '!=' null 2024-05-08T17:29:55.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:55.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:55.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:55.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:55.624 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:55.624 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:55.624 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:55.624 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:55.624 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:55.625 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:55.626 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:55.627 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:55.627 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:55.627 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:55.627 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:55.627 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:55.627 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:55.627 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:55.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:55.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:55.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:55.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:55.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:55.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:55.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:56.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:56.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:56.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:56.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:56.690 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:57.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22712673 2024-05-08T17:29:57.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22712673 '!=' null 2024-05-08T17:29:57.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:57.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:57.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:57.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:57.419 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:57.419 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:57.419 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:57.419 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:57.419 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:57.420 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:57.421 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:57.422 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:57.422 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:57.422 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:57.422 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:57.422 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:57.422 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:57.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:57.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:57.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:57.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:57.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:57.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:57.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:57.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:57.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:57.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:57.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:57.988 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:57.988 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:29:58.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:29:58.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:29:58.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:29:58.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:29:58.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:29:58.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:29:58.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:29:58.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:29:58.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:29:59.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14850570 2024-05-08T17:29:59.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14850570 '!=' null 2024-05-08T17:29:59.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:29:59.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:59.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:29:59.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:29:59.156 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:29:59.156 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:29:59.156 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:59.156 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:59.157 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:29:59.157 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:59.157 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:29:59.157 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:59.157 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:59.158 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:29:59.158 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:29:59.158 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:59.158 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:59.158 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:59.158 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:59.159 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:59.159 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:29:59.159 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:29:59.159 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:59.159 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:29:59.159 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:29:59.160 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:59.160 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:59.160 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:59.160 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:59.160 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:29:59.160 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:29:59.160 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:29:59.161 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:29:59.161 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:29:59.161 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:29:59.161 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:59.161 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:29:59.161 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:29:59.161 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:29:59.161 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:29:59.162 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:29:59.162 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:29:59.162 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:29:59.162 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:29:59.162 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:29:59.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:29:59.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:29:59.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:29:59.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:29:59.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:29:59.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:29:59.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:29:59.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:29:59.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:29:59.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:29:59.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:29:59.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:29:59.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:00.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:00.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14850570 2024-05-08T17:30:00.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14850570 '!=' null 2024-05-08T17:30:00.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:00.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:00.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:00.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:00.969 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:00.969 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:00.969 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:00.969 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:00.969 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:30:00.970 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:30:00.971 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:00.972 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:00.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:01.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:01.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:01.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:01.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:01.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:01.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:01.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:01.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:01.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:30:01.610 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:01.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:01.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:02.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:30:02.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:30:02.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:02.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:02.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:02.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:02.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:02.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:02.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:02.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14850912 2024-05-08T17:30:02.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14850912 '!=' null 2024-05-08T17:30:02.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:02.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:02.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:02.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:02.959 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:02.960 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:02.961 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:02.962 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:02.963 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:02.963 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:02.963 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:02.963 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:02.963 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:02.963 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:02.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:03.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:03.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:03.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:03.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:03.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:03.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:03.075 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:03.075 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:03.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:30:03.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:03.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:03.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:04.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:30:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:30:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:04.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:04.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:04.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22713078 2024-05-08T17:30:04.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22713078 '!=' null 2024-05-08T17:30:04.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:04.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:04.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:04.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:04.833 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:04.833 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:04.834 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:04.835 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:04.835 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:04.835 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:30:04.835 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:04.835 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:04.835 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:04.836 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:04.836 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:04.836 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:04.836 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:04.836 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:04.836 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:04.836 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:04.837 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:04.837 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:30:04.837 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:30:04.837 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:04.837 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:04.837 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:04.838 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:04.838 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:04.839 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:04.839 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:04.839 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:04.839 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:04.839 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:04.839 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:04.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:04.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:04.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:04.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:04.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:04.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:04.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:04.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:04.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:05.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:30:05.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:05.406 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:05.406 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:05.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:30:05.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:30:05.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:05.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:05.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:05.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:05.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:05.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:05.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:06.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=15724443 2024-05-08T17:30:06.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 15724443 '!=' null 2024-05-08T17:30:06.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:06.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:06.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:06.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:06.749 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 151, 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:06.750 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "7.0", 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 254, 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:06.751 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:06.752 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:06.752 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:06.752 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:06.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:06.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:06.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:06.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:06.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:06.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:06.865 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:06.865 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:06.865 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:07.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:30:07.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:07.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:07.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:07.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:30:07.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:30:07.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:07.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:07.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:07.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:07.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:07.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:07.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:08.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22713181 2024-05-08T17:30:08.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22713181 '!=' null 2024-05-08T17:30:08.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:08.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:08.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:08.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:08.714 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:08.715 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:08.716 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:08.717 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:08.717 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:08.717 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:08.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:08.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:08.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:08.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:08.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:08.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:08.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:08.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:08.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:09.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:30:09.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:09.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:09.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:09.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:10.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22275542 2024-05-08T17:30:10.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22275542 '!=' null 2024-05-08T17:30:10.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:10.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:10.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:10.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:10.714 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:10.715 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:10.716 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:10.716 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:10.716 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:10.716 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:10.716 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:10.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:10.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:10.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:10.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:10.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:10.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:10.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:10.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:10.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:11.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:30:11.250 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:11.250 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:11.250 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 3 2024-05-08T17:30:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:30:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:11.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:11.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:12.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=10482643 2024-05-08T17:30:12.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 10482643 '!=' null 2024-05-08T17:30:12.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:12.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:12.408 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:12.408 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:12.518 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:12.519 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:12.520 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:12.520 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:12.520 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:12.520 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:12.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:12.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:12.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:12.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:12.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:12.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:12.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:12.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:12.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:13.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:13.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:13.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:13.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:13.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:13.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 0 2024-05-08T17:30:13.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:30:13.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=1 2024-05-08T17:30:13.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:13.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:13.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:13.746 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:13.747 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:13.748 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:13.749 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:13.749 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:13.749 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:13.749 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:13.749 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:13.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:13.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:13.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:13.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:13.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:13.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:13.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:13.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:13.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:14.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:14.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:14.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:14.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:14.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:14.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:14.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:14.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:14.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:14.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:14.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:14.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:14.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:15.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=9172536 2024-05-08T17:30:15.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 9172536 '!=' null 2024-05-08T17:30:15.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:15.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:15.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:15.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:15.603 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:15.603 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:15.603 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:15.603 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:15.603 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:15.604 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:15.605 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:15.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:15.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:15.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:15.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:15.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:15.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:15.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:15.718 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:15.718 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:16.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:16.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:16.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:16.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:16.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:16.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:16.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:16.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:16.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:16.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:16.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:16.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:16.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:17.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=17402049 2024-05-08T17:30:17.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 17402049 '!=' null 2024-05-08T17:30:17.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:17.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:17.432 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:17.432 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:17.534 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:17.535 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:17.536 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:17.537 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:17.537 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:17.537 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:17.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:17.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:17.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:17.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:17.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:17.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:17.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:17.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:17.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:18.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:18.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:18.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:18.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:18.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:18.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:18.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:18.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:18.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:18.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:18.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:18.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:18.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:19.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=15397203 2024-05-08T17:30:19.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 15397203 '!=' null 2024-05-08T17:30:19.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:19.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:19.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:19.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:19.555 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:19.556 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:19.557 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:19.557 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:19.557 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:19.557 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:19.557 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:19.557 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:19.557 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:19.557 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:19.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:19.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:19.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:19.668 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:19.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:19.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:19.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:19.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:19.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:20.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:20.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:20.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:20.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:20.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:20.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:20.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:20.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:20.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:20.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:20.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:20.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:20.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:21.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=13977348 2024-05-08T17:30:21.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 13977348 '!=' null 2024-05-08T17:30:21.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:21.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:21.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:21.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:21.321 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:21.321 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:21.321 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:21.321 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:21.322 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:21.323 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:21.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:21.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:21.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:21.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:21.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:21.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:21.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:21.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:21.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:21.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:21.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:21.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:21.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:22.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:22.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:22.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:22.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:22.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:22.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:22.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:22.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:22.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:23.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=21839573 2024-05-08T17:30:23.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 21839573 '!=' null 2024-05-08T17:30:23.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:23.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:23.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:23.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:23.208 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:23.208 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:23.208 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:23.208 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:23.208 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:23.208 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:23.209 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:23.210 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:23.210 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:23.210 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:23.210 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:23.210 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:23.210 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:23.210 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:23.211 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:23.211 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:23.211 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:23.211 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:23.211 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:23.211 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:23.211 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:23.211 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:23.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:23.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:23.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:23.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:23.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:23.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:23.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:23.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:23.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:23.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:23.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:23.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:23.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:24.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:24.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:24.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:24.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:24.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:24.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:24.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:24.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:24.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:25.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=15724457 2024-05-08T17:30:25.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 15724457 '!=' null 2024-05-08T17:30:25.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:25.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:25.134 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:25.134 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:25.238 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:25.238 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:25.238 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:25.238 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:25.238 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:25.239 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:25.240 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:25.241 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:25.241 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:25.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:25.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:25.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:25.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:25.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:25.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:25.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:25.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:25.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:25.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:25.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:25.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:25.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:26.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:26.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:26.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:26.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:26.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:26.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:26.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:26.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:26.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:26.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=15724457 2024-05-08T17:30:26.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 15724457 '!=' null 2024-05-08T17:30:26.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:26.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:26.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:26.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:27.058 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:27.058 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:27.058 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:27.058 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:27.059 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:27.060 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:27.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:27.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:27.172 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:27.172 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:27.172 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:27.172 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:27.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:27.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:27.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:27.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:27.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:27.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:28.228 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:28.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22713071 2024-05-08T17:30:28.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22713071 '!=' null 2024-05-08T17:30:28.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:28.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:28.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:28.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:28.922 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:28.923 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:28.924 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:28.925 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:28.925 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:28.925 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:28.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:29.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:29.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:29.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:29.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:29.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:29.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:29.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:29.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:29.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:29.455 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:29.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:29.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:30.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:30.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:30.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:30.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:30.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:30.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:30.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:30.060 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:30.060 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:30.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14851042 2024-05-08T17:30:30.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14851042 '!=' null 2024-05-08T17:30:30.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:30.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:30.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:30.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:30.716 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:30.716 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:30.716 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:30.716 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:30.716 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:30.717 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:30.718 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:30.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:30.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:30.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:30.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:30.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:30.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:30.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:30.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:30.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:31.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:31.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:31.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:31.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:31.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:31.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:31.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:31.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:31.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:31.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:31.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:31.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:31.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:32.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14850754 2024-05-08T17:30:32.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14850754 '!=' null 2024-05-08T17:30:32.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:32.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:32.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:32.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:32.801 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:32.801 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:32.801 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:32.801 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:32.802 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:32.803 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:32.804 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:32.804 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:32.804 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:32.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:32.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:32.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:32.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:32.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:32.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:32.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:32.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:32.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:33.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:33.344 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:33.344 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:33.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:33.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:33.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:33.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:33.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:33.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:33.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:33.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:33.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:33.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:34.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22713425 2024-05-08T17:30:34.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22713425 '!=' null 2024-05-08T17:30:34.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:34.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:34.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:34.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:34.666 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:34.667 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:34.668 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:34.669 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:34.669 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:34.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:34.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:34.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:34.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:34.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:34.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:34.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:34.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:34.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:35.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:35.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:35.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:35.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:35.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:36.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14851089 2024-05-08T17:30:36.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14851089 '!=' null 2024-05-08T17:30:36.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:36.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:36.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:36.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:36.549 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:36.549 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:36.549 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:36.549 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:36.549 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [ 2024-05-08T17:30:36.549 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:36.549 INFO:tasks.workunit.client.0.smithi117.stdout: "priority": 110, 2024-05-08T17:30:36.549 INFO:tasks.workunit.client.0.smithi117.stdout: "items": [ 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "3.0", 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 151, 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:36.550 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:36.551 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:36.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:36.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:36.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:36.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:36.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:36.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:36.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:36.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:36.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:37.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:37.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:37.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:37.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:37.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:37.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:37.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:37.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:37.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:37.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:37.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:37.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:37.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:38.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=21839376 2024-05-08T17:30:38.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 21839376 '!=' null 2024-05-08T17:30:38.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:38.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:38.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:38.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:38.596 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:38.597 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:38.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:38.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:38.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:38.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:38.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:38.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:38.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:38.712 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:38.712 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:39.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:39.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:39.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:39.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:39.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:39.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:39.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:39.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:39.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:39.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:39.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:39.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:39.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:40.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22275532 2024-05-08T17:30:40.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22275532 '!=' null 2024-05-08T17:30:40.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:40.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:40.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:40.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:40.732 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:40.732 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:40.732 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:40.732 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:40.732 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:40.732 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:40.733 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:40.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:40.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:40.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:40.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:40.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:40.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:40.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:40.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:40.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:41.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:30:41.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:41.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:41.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:41.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 3 2024-05-08T17:30:41.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 1 '!=' 1 2024-05-08T17:30:41.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:41.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:41.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:41.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:41.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:41.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:41.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:42.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=10482380 2024-05-08T17:30:42.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 10482380 '!=' null 2024-05-08T17:30:42.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:42.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:42.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:42.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:42.508 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:42.508 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:42.508 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:42.508 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:42.508 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:42.508 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:42.508 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:42.509 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:42.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:42.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:42.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:42.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:42.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:42.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:42.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:42.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:42.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:43.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:43.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:43.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:43.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:43.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 1 2024-05-08T17:30:43.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:30:43.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=2 2024-05-08T17:30:43.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:43.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:43.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:43.738 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:43.738 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:43.738 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:43.738 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:43.738 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:43.738 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:43.738 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:43.738 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:43.739 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:43.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:43.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:43.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:43.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:43.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:43.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:43.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:43.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:43.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:44.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:44.285 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:44.285 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:44.285 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:44.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:44.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:44.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:44.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:44.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:44.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:44.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:44.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:44.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:45.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=9172567 2024-05-08T17:30:45.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 9172567 '!=' null 2024-05-08T17:30:45.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:45.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:45.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:45.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:45.750 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:45.750 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:45.750 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:45.750 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:45.750 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:45.751 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:45.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:45.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:45.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:45.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:45.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:45.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:45.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:45.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:45.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:46.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:46.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:46.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:46.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:46.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:46.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:46.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:46.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:46.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:46.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:46.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:46.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:46.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:47.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=16592052 2024-05-08T17:30:47.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 16592052 '!=' null 2024-05-08T17:30:47.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:47.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:47.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:47.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:47.549 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:47.550 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:47.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:47.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:47.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:47.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:47.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:47.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:47.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:47.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:47.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:48.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:48.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:48.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:48.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:48.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:48.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:48.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:48.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:48.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:48.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:48.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:48.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:48.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:49.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14521873 2024-05-08T17:30:49.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14521873 '!=' null 2024-05-08T17:30:49.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:49.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:49.427 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:49.427 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:49.532 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:49.532 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:49.533 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:49.534 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:49.534 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:49.534 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:49.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:49.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:49.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:49.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:49.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:49.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:49.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:49.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:49.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:50.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:50.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:50.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:50.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:50.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:50.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:50.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:50.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:50.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:50.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:50.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:50.698 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:50.698 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:51.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=13103953 2024-05-08T17:30:51.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 13103953 '!=' null 2024-05-08T17:30:51.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:51.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:51.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:51.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:51.398 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:51.399 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:51.400 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:51.400 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:51.400 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:51.400 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:51.400 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:51.400 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:51.400 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:51.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:51.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:51.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:51.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:51.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:51.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:51.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:51.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:51.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:51.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:51.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:51.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:51.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:52.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:52.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:53.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=20093040 2024-05-08T17:30:53.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 20093040 '!=' null 2024-05-08T17:30:53.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:53.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:53.134 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:53.134 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:53.239 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:53.239 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:53.240 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:53.241 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:53.241 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:53.241 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:53.241 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:53.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:53.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:53.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:53.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:53.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:53.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:53.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:53.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:53.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:53.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:53.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:53.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:53.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:54.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:54.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:54.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:54.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=20093040 2024-05-08T17:30:54.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 20093040 '!=' null 2024-05-08T17:30:54.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:54.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:54.996 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:54.996 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:55.106 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:55.107 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:55.107 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:55.107 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:55.107 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:55.107 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:55.107 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:55.107 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:55.107 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:55.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:55.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:55.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:55.220 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:55.220 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:55.220 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:55.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:55.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:55.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:55.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:55.715 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:55.715 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:55.715 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:56.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:56.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:56.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:56.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:56.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:56.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:56.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:56.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:56.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:56.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=13978167 2024-05-08T17:30:56.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 13978167 '!=' null 2024-05-08T17:30:56.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:56.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:56.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:56.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:56.922 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:56.922 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:56.922 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:56.922 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:56.922 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:56.922 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:56.922 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:56.923 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:56.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:57.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:57.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:57.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:57.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:57.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:57.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:57.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:57.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:57.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:57.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:57.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:57.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:58.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:58.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:58.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:58.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:58.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:58.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:58.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:58.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:58.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:30:58.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=21840741 2024-05-08T17:30:58.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 21840741 '!=' null 2024-05-08T17:30:58.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:30:58.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:58.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:30:58.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:30:58.738 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:30:58.738 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:30:58.738 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:58.738 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:58.738 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:58.738 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:30:58.738 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:30:58.738 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:30:58.739 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:30:58.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:30:58.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:30:58.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:30:58.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:30:58.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:30:58.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:30:58.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:30:58.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:30:58.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:30:59.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:30:59.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:30:59.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:30:59.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:30:59.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:30:59.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:30:59.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:30:59.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:30:59.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:30:59.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:30:59.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:30:59.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:30:59.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:31:00.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14851880 2024-05-08T17:31:00.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14851880 '!=' null 2024-05-08T17:31:00.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:31:00.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:00.597 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:31:00.597 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:00.705 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:00.705 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:31:00.705 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:00.705 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:00.705 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:00.706 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:00.707 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:00.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:31:00.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:31:00.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:31:00.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:31:00.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:31:00.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:31:00.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:31:00.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:31:00.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:31:01.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:31:01.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:31:01.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:31:01.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:31:01.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:31:01.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:31:01.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:31:01.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:31:01.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:31:01.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:31:01.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:31:01.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:31:01.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:31:02.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14852035 2024-05-08T17:31:02.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14852035 '!=' null 2024-05-08T17:31:02.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:31:02.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:02.804 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:31:02.804 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:02.917 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:02.917 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:31:02.917 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:02.917 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:02.917 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:02.917 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:02.918 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:02.919 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:02.919 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:02.919 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:02.919 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:02.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:31:03.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:31:03.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:31:03.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:31:03.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:31:03.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:31:03.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:31:03.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:31:03.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:31:03.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:31:03.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:31:03.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:31:03.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:31:04.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:31:04.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:31:04.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:31:04.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:31:04.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:31:04.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:31:04.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:31:04.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:31:04.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:31:04.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=21840699 2024-05-08T17:31:04.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 21840699 '!=' null 2024-05-08T17:31:04.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:31:04.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:04.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:31:04.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:04.869 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:04.869 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:31:04.869 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:04.869 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:04.870 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:04.871 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:04.871 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:04.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:31:04.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:31:04.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:31:04.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:31:04.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:31:04.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:31:04.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:31:04.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:31:04.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:31:05.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:31:05.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:31:05.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:31:05.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:31:05.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:31:05.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:31:05.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:31:05.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:31:05.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:31:05.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:31:05.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:31:05.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:31:05.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:31:06.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14851367 2024-05-08T17:31:06.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14851367 '!=' null 2024-05-08T17:31:06.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:31:06.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:06.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:31:06.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [ 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: "item": "1.0", 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: "prio": 110, 2024-05-08T17:31:06.581 INFO:tasks.workunit.client.0.smithi117.stdout: "can_preempt": true 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:06.582 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:06.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:31:06.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:31:06.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:31:06.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:31:06.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:31:06.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:31:06.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:31:06.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:31:06.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:31:07.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:31:07.176 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:31:07.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:31:07.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:31:07.872 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:31:08.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22713594 2024-05-08T17:31:08.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22713594 '!=' null 2024-05-08T17:31:08.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:31:08.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:08.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:31:08.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:08.509 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:08.510 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:08.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:31:08.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:31:08.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:31:08.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:31:08.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:31:08.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:31:08.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:31:08.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:31:08.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:31:09.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:31:09.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:31:09.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:31:09.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:31:09.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:31:09.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:31:09.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:31:09.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:31:09.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:31:09.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:31:09.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:31:09.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:31:09.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:31:10.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=22276440 2024-05-08T17:31:10.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 22276440 '!=' null 2024-05-08T17:31:10.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:31:10.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:10.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:31:10.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:10.363 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:10.363 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:31:10.363 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:10.363 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:10.363 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:10.363 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:10.363 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:10.363 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:31:10.364 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:10.364 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:10.364 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:10.364 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:10.364 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:10.364 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:10.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:31:10.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:31:10.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:31:10.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:31:10.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:31:10.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:31:10.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:31:10.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:31:10.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:31:10.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:31:10.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:31:10.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:31:10.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:31:11.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:31:11.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:31:11.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:31:11.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:31:11.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:31:11.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:31:11.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:31:11.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:31:11.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:31:11.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=11793730 2024-05-08T17:31:11.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 11793730 '!=' null 2024-05-08T17:31:11.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:31:11.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:11.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:31:11.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:12.058 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:12.058 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:12.059 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:12.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:31:12.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:31:12.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:31:12.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:31:12.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:31:12.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:31:12.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:31:12.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:31:12.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:31:12.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T17:31:12.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:31:12.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:31:12.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:31:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 3 2024-05-08T17:31:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 2 '!=' 2 2024-05-08T17:31:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:31:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:31:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:31:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:31:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:31:13.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:31:13.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:31:13.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=14414604 2024-05-08T17:31:13.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 14414604 '!=' null 2024-05-08T17:31:13.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:31:13.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:13.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: CEPH_ARGS= 2024-05-08T17:31:13.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_recovery_reservations 2024-05-08T17:31:13.775 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:13.775 INFO:tasks.workunit.client.0.smithi117.stdout: "local_reservations": { 2024-05-08T17:31:13.775 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:13.775 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:13.775 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout: "remote_reservations": { 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout: "max_allowed": 1, 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout: "min_priority": 0, 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout: "queues": [], 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout: "in_progress": [] 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:13.776 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:13.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:31:13.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:31:13.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:31:13.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:31:13.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:31:13.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:31:13.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:31:13.889 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:31:13.889 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:31:14.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=3 2024-05-08T17:31:14.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:31:14.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:31:14.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:31:14.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 3 = 3 2024-05-08T17:31:14.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:31:14.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:31:14.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:301: TEST_backfill_priority: ceph pg dump pgs 2024-05-08T17:31:15.256 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T17:31:15.256 INFO:tasks.workunit.client.0.smithi117.stdout:7.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-05-08T17:30:08.393752+0000 94'150 119:390 [1,4] 1 [1,4] 1 0'0 2024-05-08T17:26:41.495828+0000 0'0 2024-05-08T17:26:41.495828+0000 0 0 periodic scrub scheduled @ 2024-05-09T21:22:42.803573+0000 0 0 2024-05-08T17:31:15.256 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-05-08T17:30:38.487735+0000 94'150 119:425 [1,2] 1 [1,2] 1 0'0 2024-05-08T17:26:29.227710+0000 0'0 2024-05-08T17:26:29.227710+0000 0 0 periodic scrub scheduled @ 2024-05-10T04:08:19.158679+0000 0 0 2024-05-08T17:31:15.256 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-05-08T17:31:08.974394+0000 94'150 119:439 [1,2] 1 [1,2] 1 0'0 2024-05-08T17:26:23.271260+0000 0'0 2024-05-08T17:26:23.271260+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:26:09.111386+0000 0 0 2024-05-08T17:31:15.256 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T17:31:15.256 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T17:31:15.256 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:31:15.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:303: TEST_backfill_priority: get_asok_path osd.1 2024-05-08T17:31:15.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2024-05-08T17:31:15.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2024-05-08T17:31:15.273 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:31:15.273 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:15.273 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:31:15.273 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.20310/ceph-osd.1.asok 2024-05-08T17:31:15.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:303: TEST_backfill_priority: CEPH_ARGS= 2024-05-08T17:31:15.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:303: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.20310/ceph-osd.1.asok dump_pgstate_history 2024-05-08T17:31:15.380 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:31:15.380 INFO:tasks.workunit.client.0.smithi117.stdout: "pgs": [ 2024-05-08T17:31:15.380 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.380 INFO:tasks.workunit.client.0.smithi117.stdout: "pg": "7.0", 2024-05-08T17:31:15.380 INFO:tasks.workunit.client.0.smithi117.stdout: "currently": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.380 INFO:tasks.workunit.client.0.smithi117.stdout: "history": [ 2024-05-08T17:31:15.380 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "62", 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:41.816128+0000", 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:41.816144+0000" 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:41.816154+0000", 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:41.969141+0000" 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.381 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:41.969143+0000", 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:41.969273+0000" 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:41.969274+0000", 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:41.969296+0000" 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:41.969296+0000", 2024-05-08T17:31:15.382 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:42.287336+0000" 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:41.816149+0000", 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:42.287363+0000" 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:42.287972+0000", 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:43.001223+0000" 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.383 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:43.001224+0000", 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:43.001373+0000" 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:43.001374+0000", 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:43.980033+0000" 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:42.287365+0000", 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:43.980078+0000" 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.384 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:41.816145+0000", 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:43.980161+0000" 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:41.816124+0000", 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:43.980168+0000" 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "63", 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.385 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:43.980169+0000", 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:43.980619+0000" 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "92", 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:43.980626+0000", 2024-05-08T17:31:15.386 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:43.980647+0000" 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:43.980660+0000", 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:44.124325+0000" 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:44.124327+0000", 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:44.124605+0000" 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.387 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:44.124606+0000", 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:44.124667+0000" 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:44.124668+0000", 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:44.490945+0000" 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:43.980654+0000", 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:44.490963+0000" 2024-05-08T17:31:15.388 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:44.491256+0000", 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:45.154301+0000" 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:45.154302+0000", 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:45.154399+0000" 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:45.154400+0000", 2024-05-08T17:31:15.389 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.943335+0000" 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:44.490965+0000", 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.943370+0000" 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:43.980648+0000", 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.943473+0000" 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:43.980619+0000", 2024-05-08T17:31:15.390 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.943484+0000" 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "92", 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.943485+0000", 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.943872+0000" 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.391 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "99", 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.943880+0000", 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.943907+0000" 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.943924+0000", 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:14.056694+0000" 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.392 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:14.056696+0000", 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:14.056830+0000" 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:14.056831+0000", 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:14.056862+0000" 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:14.056862+0000", 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:14.697053+0000" 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.393 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.943916+0000", 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:14.697070+0000" 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:14.697185+0000", 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:14.813649+0000" 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:14.813650+0000", 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:14.813679+0000" 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.394 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:14.813680+0000", 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.247573+0000" 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:14.697071+0000", 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.247610+0000" 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.943908+0000", 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.247742+0000" 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.395 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.943873+0000", 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.247751+0000" 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "99", 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.247752+0000", 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.248481+0000" 2024-05-08T17:31:15.396 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "101", 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.248495+0000", 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.248525+0000" 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.397 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.248546+0000", 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.249508+0000" 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.249509+0000", 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.249647+0000" 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.248535+0000", 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.249666+0000" 2024-05-08T17:31:15.398 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/WaitActingChange", 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.249667+0000", 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.633932+0000" 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.248526+0000", 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.633997+0000" 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.248482+0000", 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.634007+0000" 2024-05-08T17:31:15.399 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "101", 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.634008+0000", 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.634510+0000" 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.400 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "114", 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.634523+0000", 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.634555+0000" 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.634574+0000", 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.734694+0000" 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.401 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.734695+0000", 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.734878+0000" 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.734879+0000", 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:48.734917+0000" 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.734918+0000", 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:49.044408+0000" 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.402 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.634565+0000", 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:49.044429+0000" 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:49.044913+0000", 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:50.048704+0000" 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:50.048706+0000", 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:50.049190+0000" 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.403 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:50.049191+0000", 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:50.050155+0000" 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Backfilling", 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:50.050158+0000", 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:21.478656+0000" 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/NotBackfilling", 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:21.478658+0000", 2024-05-08T17:31:15.404 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:21.479144+0000" 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:21.479144+0000", 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:33.093160+0000" 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:33.093160+0000", 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:33.093943+0000" 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Backfilling", 2024-05-08T17:31:15.405 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:33.093944+0000", 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:06.970514+0000" 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:06.970515+0000", 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:06.970954+0000" 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:06.970954+0000", 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:07.396030+0000" 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.406 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:49.044431+0000", 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:07.396092+0000" 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.634556+0000", 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:07.396203+0000" 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.407 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:48.634510+0000", 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:07.396213+0000" 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "114", 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:07.396215+0000", 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:07.396814+0000" 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.408 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: "pg": "3.0", 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: "currently": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: "history": [ 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "39", 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.133656+0000", 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:30.133695+0000" 2024-05-08T17:31:15.409 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.133722+0000", 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:30.281252+0000" 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.281254+0000", 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:30.281382+0000" 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.410 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.281383+0000", 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:30.281431+0000" 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.281431+0000", 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:30.634807+0000" 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.133706+0000", 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:30.634823+0000" 2024-05-08T17:31:15.411 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.635159+0000", 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.381797+0000" 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.381799+0000", 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.381993+0000" 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.381994+0000", 2024-05-08T17:31:15.412 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.716285+0000" 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.634825+0000", 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.716323+0000" 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.133696+0000", 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.716406+0000" 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:30.133628+0000", 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.716413+0000" 2024-05-08T17:31:15.413 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "39", 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.716420+0000", 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.716832+0000" 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "89", 2024-05-08T17:31:15.414 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.716841+0000", 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.716865+0000" 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.716883+0000", 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.850629+0000" 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.850630+0000", 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.850745+0000" 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.415 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.850746+0000", 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:31.850764+0000" 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.850764+0000", 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:32.268282+0000" 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.716874+0000", 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:32.268304+0000" 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:32.268584+0000", 2024-05-08T17:31:15.416 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:33.225491+0000" 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:33.225493+0000", 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:33.225683+0000" 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:33.225684+0000", 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.069147+0000" 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.417 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:32.268305+0000", 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.069173+0000" 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.716866+0000", 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.069251+0000" 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:31.716833+0000", 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.069257+0000" 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.418 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "89", 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.069258+0000", 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.069629+0000" 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "106", 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.419 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.069643+0000", 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.069667+0000" 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.069693+0000", 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.069942+0000" 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.069944+0000", 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.070066+0000" 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.070067+0000", 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.070093+0000" 2024-05-08T17:31:15.420 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.070093+0000", 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.558390+0000" 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.069677+0000", 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.558409+0000" 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.421 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.558563+0000", 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.655817+0000" 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.655818+0000", 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:27:13.655904+0000" 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.655905+0000", 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.715356+0000" 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.422 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.558411+0000", 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.715420+0000" 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.069668+0000", 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.715583+0000" 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:27:13.069630+0000", 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.715592+0000" 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.423 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "106", 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:06.715593+0000", 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.716209+0000" 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "108", 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.424 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:06.716219+0000", 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.716258+0000" 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:06.716281+0000", 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.717358+0000" 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:06.717359+0000", 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.717496+0000" 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.425 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:06.716272+0000", 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:06.717516+0000" 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/WaitActingChange", 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:06.717517+0000", 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.133911+0000" 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:06.716259+0000", 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.133974+0000" 2024-05-08T17:31:15.426 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:06.716210+0000", 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.133984+0000" 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "108", 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.133985+0000", 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.134467+0000" 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.427 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "116", 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.134481+0000", 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.134512+0000" 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.134531+0000", 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.320073+0000" 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.428 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.320074+0000", 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.320235+0000" 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.320236+0000", 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.320274+0000" 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.320275+0000", 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.586699+0000" 2024-05-08T17:31:15.429 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.134522+0000", 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.586742+0000" 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.587335+0000", 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:07.855631+0000" 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.855633+0000", 2024-05-08T17:31:15.430 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:21.478885+0000" 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:21.478887+0000", 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:21.479772+0000" 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Backfilling", 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:21.479773+0000", 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:33.092886+0000" 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/NotBackfilling", 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:33.092888+0000", 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:33.093328+0000" 2024-05-08T17:31:15.431 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:33.093332+0000", 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:06.971470+0000" 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:06.971472+0000", 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:06.972173+0000" 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Backfilling", 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:06.972173+0000", 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.132616+0000" 2024-05-08T17:31:15.432 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:37.132617+0000", 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.132791+0000" 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:37.132792+0000", 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.496210+0000" 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.586744+0000", 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.496258+0000" 2024-05-08T17:31:15.433 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.134513+0000", 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.496346+0000" 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:07.134468+0000", 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.496355+0000" 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.434 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "116", 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:37.496356+0000", 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.496894+0000" 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: "pg": "1.0", 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: "currently": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.435 INFO:tasks.workunit.client.0.smithi117.stdout: "history": [ 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "27", 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Initial", 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.116819+0000", 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:24.117060+0000" 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "27", 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.436 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.117061+0000", 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:24.117144+0000" 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "29", 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.117151+0000", 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:24.117170+0000" 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.437 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.117184+0000", 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:24.259953+0000" 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.259954+0000", 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:24.260093+0000" 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.260094+0000", 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:24.260117+0000" 2024-05-08T17:31:15.438 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.260117+0000", 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:24.493953+0000" 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.117176+0000", 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:24.493968+0000" 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.494383+0000", 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.165142+0000" 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.439 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.165144+0000", 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.165314+0000" 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.165315+0000", 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.683144+0000" 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.493970+0000", 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.683189+0000" 2024-05-08T17:31:15.440 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.117170+0000", 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.683281+0000" 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:24.117144+0000", 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.683288+0000" 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.441 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "29", 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.683290+0000", 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.683747+0000" 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "103", 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.683757+0000", 2024-05-08T17:31:15.442 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.683782+0000" 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.683802+0000", 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.818867+0000" 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.818869+0000", 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.819052+0000" 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.443 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.819053+0000", 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:25.819081+0000" 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.819081+0000", 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:26.316605+0000" 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.683791+0000", 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:26.316622+0000" 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.444 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:26.316903+0000", 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:27.084338+0000" 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:27.084340+0000", 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:26:27.084524+0000" 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:27.084525+0000", 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.746601+0000" 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.445 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:26.316623+0000", 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.746684+0000" 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.683783+0000", 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.746898+0000" 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:26:25.683748+0000", 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.746915+0000" 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.446 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "103", 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:59.746917+0000", 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.747932+0000" 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "104", 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.447 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:59.747953+0000", 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.748015+0000" 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:59.748058+0000", 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.771637+0000" 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:59.771638+0000", 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.771812+0000" 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.448 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:59.748040+0000", 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:28:59.771832+0000" 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/WaitActingChange", 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:59.771833+0000", 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.039822+0000" 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:59.748016+0000", 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.039946+0000" 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.449 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:28:59.747934+0000", 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.039966+0000" 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "104", 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.039967+0000", 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.040929+0000" 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.450 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "118", 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Start", 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.040953+0000", 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.041017+0000" 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.451 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.041056+0000", 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.165781+0000" 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetLog", 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.165783+0000", 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.165986+0000" 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.165987+0000", 2024-05-08T17:31:15.452 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.166039+0000" 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.166040+0000", 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.478812+0000" 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Peering", 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.041036+0000", 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.478828+0000" 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Activating", 2024-05-08T17:31:15.453 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.479215+0000", 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:29:00.726663+0000" 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.726664+0000", 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.133088+0000" 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:37.133088+0000", 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:30:37.133670+0000" 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.454 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Backfilling", 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:30:37.133670+0000", 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:31:08.002396+0000" 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Recovered", 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:31:08.002397+0000", 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:31:08.002496+0000" 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active/Clean", 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:31:08.002496+0000", 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:31:08.347333+0000" 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.455 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary/Active", 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.478828+0000", 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:31:08.347404+0000" 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started/Primary", 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.041018+0000", 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:31:08.347583+0000" 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Started", 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:29:00.040930+0000", 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:31:08.347600+0000" 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.456 INFO:tasks.workunit.client.0.smithi117.stdout: "epoch": "118", 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: "states": [ 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: "state": "Reset", 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: "enter": "2024-05-08T17:31:08.347602+0000", 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: "exit": "2024-05-08T17:31:08.348617+0000" 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:31:15.457 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:31:15.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:305: TEST_backfill_priority: '[' 0 '!=' 0 ']' 2024-05-08T17:31:15.458 INFO:tasks.workunit.client.0.smithi117.stdout:TEST PASSED 2024-05-08T17:31:15.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:309: TEST_backfill_priority: echo TEST PASSED 2024-05-08T17:31:15.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:312: TEST_backfill_priority: delete_pool test1 2024-05-08T17:31:15.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test1 2024-05-08T17:31:15.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-05-08T17:31:15.917 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' does not exist 2024-05-08T17:31:15.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:313: TEST_backfill_priority: delete_pool test3 2024-05-08T17:31:15.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test3 2024-05-08T17:31:15.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2024-05-08T17:31:16.568 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test3' does not exist 2024-05-08T17:31:16.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:314: TEST_backfill_priority: delete_pool test7 2024-05-08T17:31:16.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test7 2024-05-08T17:31:16.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2024-05-08T17:31:17.370 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test7' does not exist 2024-05-08T17:31:17.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:315: TEST_backfill_priority: kill_daemons td/osd-backfill-prio 2024-05-08T17:31:17.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:31:17.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:31:17.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:31:17.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:31:17.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:31:22.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:31:22.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:316: TEST_backfill_priority: return 0 2024-05-08T17:31:22.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:43: run: teardown td/osd-backfill-prio 2024-05-08T17:31:22.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2024-05-08T17:31:22.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:31:22.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2024-05-08T17:31:22.708 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:31:22.708 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:31:22.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:31:22.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:31:22.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:31:22.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:31:22.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:31:22.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:31:22.718 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:31:22.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:31:22.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:31:22.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:31:22.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:31:22.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:31:22.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:31:22.721 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:31:22.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:31:22.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:31:22.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2024-05-08T17:31:22.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:31:22.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:22.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:31:22.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.20310 2024-05-08T17:31:22.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:31:22.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:31:22.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2314: main: code=0 2024-05-08T17:31:22.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: teardown td/osd-backfill-prio 0 2024-05-08T17:31:22.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-prio 2024-05-08T17:31:22.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2024-05-08T17:31:22.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-prio KILL 2024-05-08T17:31:22.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:31:22.762 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:31:22.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:31:22.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:31:22.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:31:22.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:31:22.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:31:22.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:31:22.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:31:22.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:31:22.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:31:22.765 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:31:22.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:31:22.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:31:22.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:31:22.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:31:22.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:31:22.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2024-05-08T17:31:22.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-prio 2024-05-08T17:31:22.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:31:22.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:22.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.20310 2024-05-08T17:31:22.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.20310 2024-05-08T17:31:22.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:31:22.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:31:22.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2319: main: return 0 2024-05-08T17:31:22.771 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T17:31:22.772 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T17:31:22.781 INFO:tasks.workunit:Running workunit osd-backfill/osd-backfill-recovery-log.sh... 2024-05-08T17:31:22.782 DEBUG:teuthology.orchestra.run.smithi117:workunit test osd-backfill/osd-backfill-recovery-log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=95a4ad3c90f2f12f920e87725ad8d9002f948722 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh 2024-05-08T17:31:22.832 INFO:tasks.workunit.client.0.smithi117.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2307: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2307: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2308: main: export PYTHONWARNINGS=ignore 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2308: main: PYTHONWARNINGS=ignore 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2309: main: export CEPH_CONF=/dev/null 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2309: main: CEPH_CONF=/dev/null 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2310: main: unset CEPH_ARGS 2024-05-08T17:31:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2312: main: local code 2024-05-08T17:31:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2313: main: run td/osd-backfill-recovery-log 2024-05-08T17:31:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:21: run: local dir=td/osd-backfill-recovery-log 2024-05-08T17:31:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:22: run: shift 2024-05-08T17:31:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:25: run: export CEPH_MON=127.0.0.1:7129 2024-05-08T17:31:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:25: run: CEPH_MON=127.0.0.1:7129 2024-05-08T17:31:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:26: run: export CEPH_ARGS 2024-05-08T17:31:22.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:27: run: uuidgen 2024-05-08T17:31:22.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:27: run: CEPH_ARGS+='--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none ' 2024-05-08T17:31:22.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2024-05-08T17:31:22.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:29: run: CEPH_ARGS+='--osd_mclock_override_recovery_settings=true ' 2024-05-08T17:31:22.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:31: run: set 2024-05-08T17:31:22.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-05-08T17:31:22.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:31: run: local 'funcs=TEST_backfill_log_1 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_log_2 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_recovery_1 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_recovery_2' 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:32: run: for func in $funcs 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:33: run: setup td/osd-backfill-recovery-log 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-recovery-log 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-recovery-log 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:31:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:31:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:31:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:31:22.842 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:31:22.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:31:22.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:31:22.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:31:22.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:31:22.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:31:22.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:31:22.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:31:22.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:31:22.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:31:22.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:31:22.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:31:22.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:31:22.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:31:22.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:22.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:31:22.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:31:22.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:31:22.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:31:22.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-recovery-log 2024-05-08T17:31:22.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T17:31:22.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:22.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:31:22.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.47083 2024-05-08T17:31:22.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T17:31:22.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2024-05-08T17:31:22.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2024-05-08T17:31:22.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T17:31:22.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2024-05-08T17:31:22.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:34: run: TEST_backfill_log_1 td/osd-backfill-recovery-log 2024-05-08T17:31:22.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:106: TEST_backfill_log_1: local dir=td/osd-backfill-recovery-log 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:108: TEST_backfill_log_1: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2 8 150 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:41: _common_test: local dir=td/osd-backfill-recovery-log 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:42: _common_test: local 'extra_opts=--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:43: _common_test: local loglen=2 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:44: _common_test: local dupslen=8 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:45: _common_test: local objects=150 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:46: _common_test: local moreobjects=0 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:48: _common_test: local OSDS=6 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:50: _common_test: run_mon td/osd-backfill-recovery-log a 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-recovery-log 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T17:31:22.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T17:31:22.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T17:31:22.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-recovery-log/a 2024-05-08T17:31:22.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2024-05-08T17:31:23.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T17:31:23.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:31:23.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:31:23.232 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:31:23.232 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:23.232 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:31:23.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:31:23.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T17:31:23.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T17:31:23.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T17:31:23.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:31:23.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:31:23.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T17:31:23.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T17:31:23.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:31:23.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:31:23.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:31:23.487 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:31:23.487 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:23.487 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:31:23.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.47083/ceph-mon.a.asok 2024-05-08T17:31:23.488 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:31:23.488 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.47083/ceph-mon.a.asok config get fsid 2024-05-08T17:31:23.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T17:31:23.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:31:23.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:31:23.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T17:31:23.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T17:31:23.604 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:31:23.604 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:31:23.604 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:31:23.605 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:31:23.605 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:23.605 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:31:23.605 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.47083/ceph-mon.a.asok 2024-05-08T17:31:23.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:31:23.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.47083/ceph-mon.a.asok config get mon_host 2024-05-08T17:31:23.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:51: _common_test: run_mgr td/osd-backfill-recovery-log x 2024-05-08T17:31:23.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-recovery-log 2024-05-08T17:31:23.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T17:31:23.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T17:31:23.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T17:31:23.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-recovery-log/x 2024-05-08T17:31:23.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T17:31:24.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T17:31:24.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:31:24.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:31:24.640 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:31:24.640 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:24.640 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:31:24.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:31:24.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:31:24.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:31:24.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:52: _common_test: export CEPH_ARGS 2024-05-08T17:31:24.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:31:24.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:31:24.676 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: expr 6 - 1 2024-05-08T17:31:24.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: seq 0 5 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 0 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:31:24.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:31:24.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2024-05-08T17:31:24.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:31:24.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b2cc1049-2355-4e3d-ac0f-6222e44615bf 2024-05-08T17:31:24.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 b2cc1049-2355-4e3d-ac0f-6222e44615bf' 2024-05-08T17:31:24.683 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 b2cc1049-2355-4e3d-ac0f-6222e44615bf 2024-05-08T17:31:24.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:31:24.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDstjtmyK0oKhAAs+w4fWfWgcTZI0nsTkxqRg== 2024-05-08T17:31:24.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDstjtmyK0oKhAAs+w4fWfWgcTZI0nsTkxqRg=="}' 2024-05-08T17:31:24.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b2cc1049-2355-4e3d-ac0f-6222e44615bf -i td/osd-backfill-recovery-log/0/new.json 2024-05-08T17:31:25.013 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:31:25.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2024-05-08T17:31:25.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDstjtmyK0oKhAAs+w4fWfWgcTZI0nsTkxqRg== --osd-uuid b2cc1049-2355-4e3d-ac0f-6222e44615bf 2024-05-08T17:31:25.073 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:25.076+0000 7fe35d3707c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:31:25.089 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:25.092+0000 7fe35d3707c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:31:25.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:25.096+0000 7fe35d3707c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:31:25.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:25.096+0000 7fe35d3707c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:31:25.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:25.096+0000 7fe35d3707c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:31:25.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:25.096+0000 7fe35d3707c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:31:25.121 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:25.124+0000 7fe35d3707c0 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2024-05-08T17:31:31.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2024-05-08T17:31:31.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:31:31.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T17:31:31.523 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T17:31:31.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:31:32.063 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:31:32.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T17:31:32.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:31:32.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:31:32.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:31:32.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:31:32.098 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:32.104+0000 7f12cf7237c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:31:32.100 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:32.104+0000 7f12cf7237c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:31:32.101 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:32.104+0000 7f12cf7237c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:31:32.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T17:31:32.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:31:32.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:31:32.485 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:31:32.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:31:32.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:31:32.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:32.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:31:32.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:32.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:32.652 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:32.656+0000 7f12cf7237c0 -1 Falling back to public interface 2024-05-08T17:31:32.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:33.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:33.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:33.946 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:31:33.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:31:33.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:33.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:34.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:35.343 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:31:35.348+0000 7f12cf7237c0 -1 osd.0 0 log_to_monitors true 2024-05-08T17:31:35.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:35.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:35.353 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:31:35.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:31:35.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:35.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:36.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:37.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:37.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:37.067 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:31:37.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:31:37.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:37.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:37.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:38.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:38.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:38.493 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:31:38.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:31:38.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:38.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:38.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:39.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:39.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:39.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:31:39.923 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:31:39.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:39.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:40.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:41.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:41.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:41.440 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:31:41.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:31:41.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:41.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:41.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:42.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:42.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:42.861 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:31:42.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:31:42.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:42.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:43.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:44.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:44.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:44.330 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:31:44.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:31:44.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:44.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:44.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:45.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:45.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:45.750 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:31:45.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:31:45.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:45.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:46.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:47.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:47.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:47.307 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:31:47.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:31:47.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:47.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:47.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:48.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:48.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:48.736 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:31:48.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:31:48.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:48.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:49.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:50.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:50.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:50.158 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:31:50.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:31:50.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:50.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:50.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:51.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:51.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:51.990 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:31:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:31:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:53.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:54.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:54.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:54.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:31:54.044 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:31:54.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:54.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:55.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:56.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:56.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:56.205 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:31:56.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:31:56.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:56.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:57.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:31:58.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:31:58.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:31:58.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:31:58.062 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:31:58.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:31:58.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:31:59.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:00.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:00.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:00.035 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:32:00.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:32:00.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:00.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:32:00.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:01.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:01.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:01.450 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:32:01.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:32:01.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:01.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:32:01.881 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1553504495,v1:127.0.0.1:6803/1553504495] [v2:127.0.0.1:6804/1553504495,v1:127.0.0.1:6805/1553504495] exists,up b2cc1049-2355-4e3d-ac0f-6222e44615bf 2024-05-08T17:32:01.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:32:01.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:32:01.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:32:01.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:32:01.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 1 2024-05-08T17:32:01.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:32:01.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:32:01.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T17:32:01.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:32:01.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2024-05-08T17:32:01.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:32:01.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:32:01.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:32:01.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:32:01.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2024-05-08T17:32:01.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2024-05-08T17:32:01.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:32:01.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:32:01.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:32:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:32:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=70a8ab9a-edf4-43bf-9e1a-d907da00f614 2024-05-08T17:32:01.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 70a8ab9a-edf4-43bf-9e1a-d907da00f614' 2024-05-08T17:32:01.890 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 70a8ab9a-edf4-43bf-9e1a-d907da00f614 2024-05-08T17:32:01.890 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:32:01.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQARtztmW9KhNhAAtvX5De5uRlydv529zlB4AQ== 2024-05-08T17:32:01.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQARtztmW9KhNhAAtvX5De5uRlydv529zlB4AQ=="}' 2024-05-08T17:32:01.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 70a8ab9a-edf4-43bf-9e1a-d907da00f614 -i td/osd-backfill-recovery-log/1/new.json 2024-05-08T17:32:02.405 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:32:02.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2024-05-08T17:32:02.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQARtztmW9KhNhAAtvX5De5uRlydv529zlB4AQ== --osd-uuid 70a8ab9a-edf4-43bf-9e1a-d907da00f614 2024-05-08T17:32:02.459 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:02.463+0000 7f27280e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:02.500 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:02.503+0000 7f27280e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:02.502 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:02.503+0000 7f27280e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:02.502 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:02.507+0000 7f27280e07c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:32:02.503 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:02.507+0000 7f27280e07c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:32:02.503 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:02.507+0000 7f27280e07c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:32:02.546 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:02.547+0000 7f27280e07c0 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2024-05-08T17:32:09.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2024-05-08T17:32:09.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:32:09.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T17:32:09.469 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T17:32:09.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:32:10.031 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T17:32:10.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T17:32:10.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:32:10.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:32:10.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:32:10.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:32:10.069 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:10.071+0000 7f4c96dc27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:10.070 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:10.075+0000 7f4c96dc27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:10.072 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:10.075+0000 7f4c96dc27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:10.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T17:32:10.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:32:10.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T17:32:10.486 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:32:10.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:32:10.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:32:10.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:10.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:32:10.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:10.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:10.624 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:10.627+0000 7f4c96dc27c0 -1 Falling back to public interface 2024-05-08T17:32:10.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:11.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:11.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:11.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:32:11.918 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:32:11.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:11.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:12.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:13.238 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:13.239+0000 7f4c96dc27c0 -1 osd.1 0 log_to_monitors true 2024-05-08T17:32:13.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:13.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:13.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:32:13.318 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:32:13.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:13.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:14.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:15.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:15.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:15.016 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:32:15.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:32:15.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:15.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:15.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:16.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:16.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:16.586 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:32:16.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:32:16.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:16.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:17.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:18.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:18.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:18.151 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:32:18.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:32:18.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:18.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:18.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:19.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:19.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:19.699 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:32:19.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:32:19.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:19.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:20.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:21.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:21.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:21.128 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:32:21.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:32:21.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:21.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:22.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:22.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:22.541 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:32:22.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:32:22.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:22.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:22.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:23.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:23.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:23.958 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:32:23.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:32:23.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:23.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:24.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:25.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:25.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:25.546 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:32:25.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:32:25.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:25.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:26.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:27.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:27.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:27.054 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:32:27.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:32:27.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:27.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:27.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:28.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:28.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:28.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:32:28.688 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:32:28.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:28.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:29.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:30.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:30.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:30.497 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:32:30.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:32:30.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:30.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:31.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:32.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:32.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:32.237 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:32:32.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:32:32.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:32.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:33.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:34.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:34.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:34.375 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:32:34.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:32:34.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:34.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:35.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:36.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:36.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:36.249 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:32:36.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:32:36.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:36.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:37.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:38.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:38.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:38.223 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:32:38.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:32:38.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:38.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:38.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:39.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:39.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:39.809 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:32:39.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:32:39.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:39.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:32:40.231 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1954779048,v1:127.0.0.1:6811/1954779048] [v2:127.0.0.1:6812/1954779048,v1:127.0.0.1:6813/1954779048] exists,up 70a8ab9a-edf4-43bf-9e1a-d907da00f614 2024-05-08T17:32:40.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 2 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:32:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:32:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:32:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2024-05-08T17:32:40.237 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:32:40.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=243988ef-62c3-4c51-b4c8-bba6c0b19c69 2024-05-08T17:32:40.237 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 243988ef-62c3-4c51-b4c8-bba6c0b19c69 2024-05-08T17:32:40.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 243988ef-62c3-4c51-b4c8-bba6c0b19c69' 2024-05-08T17:32:40.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:32:40.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA4tztmo6PTDxAARK5xxQhfEHSB1wGg0QpX2A== 2024-05-08T17:32:40.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA4tztmo6PTDxAARK5xxQhfEHSB1wGg0QpX2A=="}' 2024-05-08T17:32:40.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 243988ef-62c3-4c51-b4c8-bba6c0b19c69 -i td/osd-backfill-recovery-log/2/new.json 2024-05-08T17:32:40.708 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:32:40.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2024-05-08T17:32:40.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA4tztmo6PTDxAARK5xxQhfEHSB1wGg0QpX2A== --osd-uuid 243988ef-62c3-4c51-b4c8-bba6c0b19c69 2024-05-08T17:32:40.755 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:40.758+0000 7fd83c7647c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:40.796 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:40.798+0000 7fd83c7647c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:40.797 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:40.798+0000 7fd83c7647c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:40.798 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:40.798+0000 7fd83c7647c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:32:40.798 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:40.798+0000 7fd83c7647c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:32:40.798 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:40.798+0000 7fd83c7647c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:32:40.834 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:40.838+0000 7fd83c7647c0 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2024-05-08T17:32:47.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2024-05-08T17:32:47.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:32:47.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T17:32:47.545 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T17:32:47.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:32:48.099 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T17:32:48.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T17:32:48.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:32:48.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:32:48.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:32:48.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:32:48.135 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:48.142+0000 7f56676277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:48.165 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:48.170+0000 7f56676277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:48.167 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:48.174+0000 7f56676277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:32:48.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T17:32:48.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:32:48.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T17:32:48.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:32:48.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:32:48.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:48.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:32:48.552 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:32:48.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:48.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:32:48.748 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:48.754+0000 7f56676277c0 -1 Falling back to public interface 2024-05-08T17:32:48.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:49.976 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:32:49.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:49.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:49.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:32:49.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:49.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:32:50.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:51.189 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:32:51.194+0000 7f56676277c0 -1 osd.2 0 log_to_monitors true 2024-05-08T17:32:51.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:51.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:51.404 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:32:51.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:32:51.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:51.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:32:51.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:52.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:52.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:52.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:32:52.975 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:32:52.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:52.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:32:53.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:54.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:54.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:54.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:32:54.541 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:32:54.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:54.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:32:55.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:56.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:56.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:56.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:32:56.151 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:32:56.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:56.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:32:56.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:57.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:57.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:57.694 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:32:57.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:32:57.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:57.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:32:58.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:32:59.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:32:59.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:32:59.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:32:59.148 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:32:59.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:32:59.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:32:59.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:00.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:00.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:00.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:33:00.616 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:33:00.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:00.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:01.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:02.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:02.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:02.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:33:02.156 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:33:02.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:02.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:02.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:03.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:03.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:03.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:33:03.625 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:33:03.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:03.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:04.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:05.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:05.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:05.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:33:05.193 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:33:05.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:05.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:05.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:06.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:06.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:06.900 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:33:06.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:33:06.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:06.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:07.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:08.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:08.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:08.705 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:33:08.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:33:08.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:08.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:09.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:10.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:10.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:10.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:33:10.629 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:33:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:11.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:12.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:12.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:12.456 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:33:12.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:33:12.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:12.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:13.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:14.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:14.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:14.321 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:33:14.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:33:14.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:14.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:14.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:15.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:15.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:15.918 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:33:15.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:33:15.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:15.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:16.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:17.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:17.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:17.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:33:17.382 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:33:17.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:17.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:33:17.791 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4184299399,v1:127.0.0.1:6819/4184299399] [v2:127.0.0.1:6820/4184299399,v1:127.0.0.1:6821/4184299399] exists,up 243988ef-62c3-4c51-b4c8-bba6c0b19c69 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 3 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:33:17.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:33:17.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:33:17.797 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:33:17.797 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:33:17.797 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:33:17.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:33:17.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:33:17.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8bd9da5e-9487-4710-9d30-926c2f8bcabd 2024-05-08T17:33:17.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 8bd9da5e-9487-4710-9d30-926c2f8bcabd' 2024-05-08T17:33:17.799 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 8bd9da5e-9487-4710-9d30-926c2f8bcabd 2024-05-08T17:33:17.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:33:17.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBdtztmxrp/MRAAqVrGcyrYtmcPyyzxCRX6Tw== 2024-05-08T17:33:17.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBdtztmxrp/MRAAqVrGcyrYtmcPyyzxCRX6Tw=="}' 2024-05-08T17:33:17.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8bd9da5e-9487-4710-9d30-926c2f8bcabd -i td/osd-backfill-recovery-log/3/new.json 2024-05-08T17:33:18.343 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:33:18.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2024-05-08T17:33:18.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBdtztmxrp/MRAAqVrGcyrYtmcPyyzxCRX6Tw== --osd-uuid 8bd9da5e-9487-4710-9d30-926c2f8bcabd 2024-05-08T17:33:18.399 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:18.406+0000 7f3caff157c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:18.401 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:18.406+0000 7f3caff157c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:18.402 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:18.406+0000 7f3caff157c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:18.403 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:18.410+0000 7f3caff157c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:33:18.404 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:18.410+0000 7f3caff157c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:33:18.404 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:18.410+0000 7f3caff157c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:33:18.486 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:18.490+0000 7f3caff157c0 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2024-05-08T17:33:25.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2024-05-08T17:33:25.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:33:25.360 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T17:33:25.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T17:33:25.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:33:25.931 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T17:33:25.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T17:33:25.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:33:25.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:33:25.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:33:25.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:33:25.970 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:25.973+0000 7f1923fd07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:26.009 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:26.013+0000 7f1923fd07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:26.011 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:26.017+0000 7f1923fd07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:26.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T17:33:26.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:33:26.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T17:33:26.373 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:33:26.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:33:26.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:33:26.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:26.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:33:26.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:26.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:26.589 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:26.593+0000 7f1923fd07c0 -1 Falling back to public interface 2024-05-08T17:33:26.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:27.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:27.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:27.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:33:27.810 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:33:27.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:27.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:28.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:29.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:29.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:29.212 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:33:29.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:33:29.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:29.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:29.229 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:29.233+0000 7f1923fd07c0 -1 osd.3 0 log_to_monitors true 2024-05-08T17:33:29.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:30.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:30.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:30.807 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:33:30.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:33:30.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:30.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:31.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:32.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:32.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:32.242 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:33:32.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:33:32.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:32.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:32.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:33.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:33.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:33.707 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:33:33.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:33:33.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:33.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:34.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:35.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:35.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:35.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:33:35.216 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:33:35.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:35.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:35.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:36.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:36.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:36.743 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:33:36.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:33:36.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:36.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:37.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:38.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:38.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:38.310 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:33:38.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:33:38.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:38.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:38.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:39.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:39.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:39.798 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:33:39.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:33:39.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:39.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:40.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:41.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:41.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:41.424 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:33:41.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:33:41.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:41.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:41.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:42.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:42.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:42.845 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:33:42.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:33:42.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:42.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:43.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:44.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:44.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:44.459 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:33:44.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:33:44.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:44.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:45.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:46.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:46.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:46.241 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:33:46.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:33:46.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:46.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:47.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:48.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:48.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:48.092 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:33:48.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:33:48.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:48.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:49.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:50.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:50.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:50.077 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:33:50.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:33:50.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:50.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:50.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:51.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:51.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:51.974 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:33:51.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:33:51.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:51.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:52.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:53.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:53.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:53.578 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:33:53.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:33:53.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:53.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:54.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:33:55.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:33:55.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:33:55.495 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:33:55.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:33:55.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:33:55.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:33:55.920 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3651627351,v1:127.0.0.1:6827/3651627351] [v2:127.0.0.1:6828/3651627351,v1:127.0.0.1:6829/3651627351] exists,up 8bd9da5e-9487-4710-9d30-926c2f8bcabd 2024-05-08T17:33:55.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:33:55.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:33:55.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:33:55.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 4 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:33:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:33:55.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:33:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:33:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:33:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:33:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:33:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:33:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:33:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:33:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2024-05-08T17:33:55.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:33:55.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=09c2fb7e-4146-4d71-b140-f0af45c9474a 2024-05-08T17:33:55.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 09c2fb7e-4146-4d71-b140-f0af45c9474a' 2024-05-08T17:33:55.928 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 09c2fb7e-4146-4d71-b140-f0af45c9474a 2024-05-08T17:33:55.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:33:55.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCDtztmF1QiORAAYvAE4joYZFP+aIw2a6AHIQ== 2024-05-08T17:33:55.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCDtztmF1QiORAAYvAE4joYZFP+aIw2a6AHIQ=="}' 2024-05-08T17:33:55.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 09c2fb7e-4146-4d71-b140-f0af45c9474a -i td/osd-backfill-recovery-log/4/new.json 2024-05-08T17:33:56.639 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:33:56.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2024-05-08T17:33:56.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCDtztmF1QiORAAYvAE4joYZFP+aIw2a6AHIQ== --osd-uuid 09c2fb7e-4146-4d71-b140-f0af45c9474a 2024-05-08T17:33:56.695 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:56.701+0000 7fe0e82fe7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:56.697 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:56.701+0000 7fe0e82fe7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:56.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:56.701+0000 7fe0e82fe7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:33:56.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:56.705+0000 7fe0e82fe7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:33:56.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:56.705+0000 7fe0e82fe7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:33:56.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:56.705+0000 7fe0e82fe7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:33:56.781 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:33:56.785+0000 7fe0e82fe7c0 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2024-05-08T17:34:03.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2024-05-08T17:34:03.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:34:03.486 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T17:34:03.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T17:34:03.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:34:04.046 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T17:34:04.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T17:34:04.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:34:04.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:34:04.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:34:04.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:34:04.081 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:04.085+0000 7fcbc76e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:04.083 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:04.089+0000 7fcbc76e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:04.084 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:04.089+0000 7fcbc76e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:04.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T17:34:04.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:34:04.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T17:34:04.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:34:04.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:34:04.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:04.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:34:04.504 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:34:04.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:04.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:04.629 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:04.633+0000 7fcbc76e07c0 -1 Falling back to public interface 2024-05-08T17:34:04.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:05.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:05.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:05.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:34:05.924 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:34:05.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:05.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:06.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:07.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:07.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:07.350 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:34:07.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:34:07.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:07.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:07.368 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:07.373+0000 7fcbc76e07c0 -1 osd.4 0 log_to_monitors true 2024-05-08T17:34:07.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:08.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:08.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:08.763 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:34:08.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:34:08.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:08.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:09.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:10.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:10.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:10.294 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:34:10.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:34:10.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:10.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:10.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:11.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:11.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:11.753 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:34:11.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:34:11.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:11.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:12.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:13.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:13.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:13.188 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:34:13.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:34:13.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:13.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:13.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:14.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:14.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:14.619 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:34:14.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:34:14.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:14.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:15.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:16.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:16.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:16.057 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:34:16.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:34:16.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:16.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:16.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:17.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:17.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:17.690 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:34:17.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:34:17.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:17.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:18.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:19.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:19.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:19.207 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:34:19.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:34:19.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:19.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:19.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:20.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:20.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:20.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:34:20.715 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:34:20.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:20.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:21.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:22.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:22.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:22.347 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:34:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:34:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:22.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:23.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:23.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:23.973 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:34:23.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:34:23.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:23.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:25.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:26.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:26.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:26.186 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:34:26.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:34:26.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:26.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:26.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:27.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:27.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:27.911 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:34:27.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:34:27.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:27.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:28.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:29.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:29.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:29.460 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:34:29.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:34:29.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:29.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:30.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:31.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:31.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:31.009 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:34:31.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:34:31.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:31.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:31.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:32.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:32.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:32.810 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:34:32.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:34:32.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:32.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:33.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:34.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:34.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:34.576 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T17:34:34.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T17:34:34.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:34.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:34:34.979 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1451618887,v1:127.0.0.1:6835/1451618887] [v2:127.0.0.1:6836/1451618887,v1:127.0.0.1:6837/1451618887] exists,up 09c2fb7e-4146-4d71-b140-f0af45c9474a 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 5 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:34:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:34:34.984 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:34:34.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2024-05-08T17:34:34.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:34:34.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=09b8f5cc-76fc-4f0f-b769-430a508e1995 2024-05-08T17:34:34.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 09b8f5cc-76fc-4f0f-b769-430a508e1995' 2024-05-08T17:34:34.986 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 09b8f5cc-76fc-4f0f-b769-430a508e1995 2024-05-08T17:34:34.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:34:35.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCrtztm/gfmABAAgpVvF4ovSDYY0In61nKrYA== 2024-05-08T17:34:35.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCrtztm/gfmABAAgpVvF4ovSDYY0In61nKrYA=="}' 2024-05-08T17:34:35.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 09b8f5cc-76fc-4f0f-b769-430a508e1995 -i td/osd-backfill-recovery-log/5/new.json 2024-05-08T17:34:35.598 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:34:35.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2024-05-08T17:34:35.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCrtztm/gfmABAAgpVvF4ovSDYY0In61nKrYA== --osd-uuid 09b8f5cc-76fc-4f0f-b769-430a508e1995 2024-05-08T17:34:35.652 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:35.656+0000 7fa56eba97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:35.654 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:35.656+0000 7fa56eba97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:35.655 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:35.660+0000 7fa56eba97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:35.656 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:35.660+0000 7fa56eba97c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:34:35.656 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:35.660+0000 7fa56eba97c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:34:35.656 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:35.660+0000 7fa56eba97c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:34:35.740 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:35.744+0000 7fa56eba97c0 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2024-05-08T17:34:42.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2024-05-08T17:34:42.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:34:42.538 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T17:34:42.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T17:34:42.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:34:43.093 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T17:34:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T17:34:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:34:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:34:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:34:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:34:43.131 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:43.136+0000 7f6b3c7657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:43.183 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:43.188+0000 7f6b3c7657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:43.184 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:43.188+0000 7f6b3c7657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:34:43.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T17:34:43.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:34:43.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T17:34:43.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:34:43.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:34:43.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:43.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:34:43.517 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:34:43.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:43.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:43.744 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:43.748+0000 7f6b3c7657c0 -1 Falling back to public interface 2024-05-08T17:34:43.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:44.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:44.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:44.993 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:34:44.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:34:44.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:44.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:45.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:46.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:46.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:46.408 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:34:46.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:34:46.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:46.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:46.474 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:34:46.476+0000 7f6b3c7657c0 -1 osd.5 0 log_to_monitors true 2024-05-08T17:34:47.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:48.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:48.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:48.098 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:34:48.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:34:48.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:48.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:48.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:49.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:49.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:49.650 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:34:49.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:34:49.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:49.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:50.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:51.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:51.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:51.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:34:51.128 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:34:51.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:51.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:51.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:52.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:52.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:52.732 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:34:52.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:34:52.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:52.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:53.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:54.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:54.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:54.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:34:54.194 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:34:54.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:54.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:54.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:55.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:55.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:55.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:34:55.617 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:34:55.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:55.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:56.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:57.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:57.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:57.190 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:34:57.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:34:57.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:57.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:57.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:34:58.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:34:58.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:34:58.740 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:34:58.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:34:58.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:34:58.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:34:59.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:00.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:00.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:00.177 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:35:00.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:35:00.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:00.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:00.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:01.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:01.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:01.722 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:35:01.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:35:01.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:01.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:02.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:03.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:03.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:03.500 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:35:03.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:35:03.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:03.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:04.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:05.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:05.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:05.264 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:35:05.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:35:05.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:05.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:06.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:07.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:07.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:07.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:35:07.207 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:35:07.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:07.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:08.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:09.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:09.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:09.149 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:35:09.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:35:09.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:09.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:09.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:10.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:10.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:10.951 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:35:10.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:35:10.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:10.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:11.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:12.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:12.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:12.712 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:35:12.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:35:12.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:12.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:13.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:35:14.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:35:14.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:35:14.216 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T17:35:14.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T17:35:14.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:35:14.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:35:14.642 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3782878237,v1:127.0.0.1:6843/3782878237] [v2:127.0.0.1:6844/3782878237,v1:127.0.0.1:6845/3782878237] exists,up 09b8f5cc-76fc-4f0f-b769-430a508e1995 2024-05-08T17:35:14.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:35:14.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:35:14.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:35:14.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:60: _common_test: create_pool test 1 1 2024-05-08T17:35:14.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T17:35:15.443 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T17:35:15.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:35:16.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: seq 1 150 2024-05-08T17:35:16.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:16.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-1 /etc/passwd 2024-05-08T17:35:17.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:17.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-2 /etc/passwd 2024-05-08T17:35:17.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:17.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-3 /etc/passwd 2024-05-08T17:35:17.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:17.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-4 /etc/passwd 2024-05-08T17:35:17.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:17.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-5 /etc/passwd 2024-05-08T17:35:18.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:18.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-6 /etc/passwd 2024-05-08T17:35:18.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:18.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-7 /etc/passwd 2024-05-08T17:35:18.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:18.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-8 /etc/passwd 2024-05-08T17:35:18.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:18.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-9 /etc/passwd 2024-05-08T17:35:18.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:18.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-10 /etc/passwd 2024-05-08T17:35:19.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:19.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-11 /etc/passwd 2024-05-08T17:35:19.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:19.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-12 /etc/passwd 2024-05-08T17:35:19.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:19.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-13 /etc/passwd 2024-05-08T17:35:19.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:19.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-14 /etc/passwd 2024-05-08T17:35:19.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:19.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-15 /etc/passwd 2024-05-08T17:35:20.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:20.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-16 /etc/passwd 2024-05-08T17:35:20.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:20.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-17 /etc/passwd 2024-05-08T17:35:20.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:20.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-18 /etc/passwd 2024-05-08T17:35:20.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:20.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-19 /etc/passwd 2024-05-08T17:35:20.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:20.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-20 /etc/passwd 2024-05-08T17:35:21.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:21.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-21 /etc/passwd 2024-05-08T17:35:21.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:21.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-22 /etc/passwd 2024-05-08T17:35:21.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:21.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-23 /etc/passwd 2024-05-08T17:35:21.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:21.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-24 /etc/passwd 2024-05-08T17:35:21.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:21.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-25 /etc/passwd 2024-05-08T17:35:22.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:22.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-26 /etc/passwd 2024-05-08T17:35:22.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:22.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-27 /etc/passwd 2024-05-08T17:35:22.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:22.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-28 /etc/passwd 2024-05-08T17:35:22.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:22.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-29 /etc/passwd 2024-05-08T17:35:22.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:22.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-30 /etc/passwd 2024-05-08T17:35:22.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:22.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-31 /etc/passwd 2024-05-08T17:35:23.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:23.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-32 /etc/passwd 2024-05-08T17:35:23.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:23.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-33 /etc/passwd 2024-05-08T17:35:23.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:23.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-34 /etc/passwd 2024-05-08T17:35:23.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:23.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-35 /etc/passwd 2024-05-08T17:35:23.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:23.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-36 /etc/passwd 2024-05-08T17:35:24.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:24.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-37 /etc/passwd 2024-05-08T17:35:24.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:24.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-38 /etc/passwd 2024-05-08T17:35:24.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:24.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-39 /etc/passwd 2024-05-08T17:35:24.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:24.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-40 /etc/passwd 2024-05-08T17:35:24.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:24.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-41 /etc/passwd 2024-05-08T17:35:24.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:24.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-42 /etc/passwd 2024-05-08T17:35:25.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:25.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-43 /etc/passwd 2024-05-08T17:35:25.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:25.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-44 /etc/passwd 2024-05-08T17:35:25.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:25.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-45 /etc/passwd 2024-05-08T17:35:25.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:25.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-46 /etc/passwd 2024-05-08T17:35:25.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:25.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-47 /etc/passwd 2024-05-08T17:35:26.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:26.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-48 /etc/passwd 2024-05-08T17:35:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-49 /etc/passwd 2024-05-08T17:35:26.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:26.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-50 /etc/passwd 2024-05-08T17:35:26.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:26.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-51 /etc/passwd 2024-05-08T17:35:26.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:26.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-52 /etc/passwd 2024-05-08T17:35:26.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:26.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-53 /etc/passwd 2024-05-08T17:35:27.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:27.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-54 /etc/passwd 2024-05-08T17:35:27.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:27.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-55 /etc/passwd 2024-05-08T17:35:27.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:27.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-56 /etc/passwd 2024-05-08T17:35:27.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:27.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-57 /etc/passwd 2024-05-08T17:35:27.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:27.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-58 /etc/passwd 2024-05-08T17:35:28.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:28.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-59 /etc/passwd 2024-05-08T17:35:28.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:28.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-60 /etc/passwd 2024-05-08T17:35:28.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:28.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-61 /etc/passwd 2024-05-08T17:35:28.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:28.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-62 /etc/passwd 2024-05-08T17:35:28.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:28.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-63 /etc/passwd 2024-05-08T17:35:28.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:28.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-64 /etc/passwd 2024-05-08T17:35:29.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:29.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-65 /etc/passwd 2024-05-08T17:35:29.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:29.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-66 /etc/passwd 2024-05-08T17:35:29.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:29.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-67 /etc/passwd 2024-05-08T17:35:29.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:29.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-68 /etc/passwd 2024-05-08T17:35:29.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:29.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-69 /etc/passwd 2024-05-08T17:35:30.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:30.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-70 /etc/passwd 2024-05-08T17:35:30.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:30.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-71 /etc/passwd 2024-05-08T17:35:30.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:30.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-72 /etc/passwd 2024-05-08T17:35:30.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:30.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-73 /etc/passwd 2024-05-08T17:35:30.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:30.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-74 /etc/passwd 2024-05-08T17:35:30.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:30.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-75 /etc/passwd 2024-05-08T17:35:31.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:31.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-76 /etc/passwd 2024-05-08T17:35:31.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:31.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-77 /etc/passwd 2024-05-08T17:35:31.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:31.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-78 /etc/passwd 2024-05-08T17:35:31.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:31.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-79 /etc/passwd 2024-05-08T17:35:31.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:31.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-80 /etc/passwd 2024-05-08T17:35:32.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:32.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-81 /etc/passwd 2024-05-08T17:35:32.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:32.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-82 /etc/passwd 2024-05-08T17:35:32.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:32.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-83 /etc/passwd 2024-05-08T17:35:32.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:32.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-84 /etc/passwd 2024-05-08T17:35:32.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:32.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-85 /etc/passwd 2024-05-08T17:35:32.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:32.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-86 /etc/passwd 2024-05-08T17:35:33.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:33.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-87 /etc/passwd 2024-05-08T17:35:33.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:33.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-88 /etc/passwd 2024-05-08T17:35:33.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:33.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-89 /etc/passwd 2024-05-08T17:35:33.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:33.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-90 /etc/passwd 2024-05-08T17:35:33.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:33.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-91 /etc/passwd 2024-05-08T17:35:34.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:34.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-92 /etc/passwd 2024-05-08T17:35:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-93 /etc/passwd 2024-05-08T17:35:34.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:34.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-94 /etc/passwd 2024-05-08T17:35:34.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:34.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-95 /etc/passwd 2024-05-08T17:35:34.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:34.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-96 /etc/passwd 2024-05-08T17:35:35.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:35.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-97 /etc/passwd 2024-05-08T17:35:35.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:35.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-98 /etc/passwd 2024-05-08T17:35:35.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:35.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-99 /etc/passwd 2024-05-08T17:35:35.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:35.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-100 /etc/passwd 2024-05-08T17:35:35.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:35.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-101 /etc/passwd 2024-05-08T17:35:35.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:35.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-102 /etc/passwd 2024-05-08T17:35:36.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:36.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-103 /etc/passwd 2024-05-08T17:35:36.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:36.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-104 /etc/passwd 2024-05-08T17:35:36.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:36.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-105 /etc/passwd 2024-05-08T17:35:36.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:36.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-106 /etc/passwd 2024-05-08T17:35:36.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:36.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-107 /etc/passwd 2024-05-08T17:35:36.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:36.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-108 /etc/passwd 2024-05-08T17:35:37.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:37.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-109 /etc/passwd 2024-05-08T17:35:37.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:37.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-110 /etc/passwd 2024-05-08T17:35:37.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:37.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-111 /etc/passwd 2024-05-08T17:35:37.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:37.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-112 /etc/passwd 2024-05-08T17:35:37.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:37.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-113 /etc/passwd 2024-05-08T17:35:38.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:38.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-114 /etc/passwd 2024-05-08T17:35:38.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:38.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-115 /etc/passwd 2024-05-08T17:35:38.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:38.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-116 /etc/passwd 2024-05-08T17:35:38.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:38.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-117 /etc/passwd 2024-05-08T17:35:38.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:38.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-118 /etc/passwd 2024-05-08T17:35:38.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:38.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-119 /etc/passwd 2024-05-08T17:35:39.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:39.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-120 /etc/passwd 2024-05-08T17:35:39.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:39.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-121 /etc/passwd 2024-05-08T17:35:39.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:39.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-122 /etc/passwd 2024-05-08T17:35:39.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:39.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-123 /etc/passwd 2024-05-08T17:35:39.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:39.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-124 /etc/passwd 2024-05-08T17:35:40.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:40.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-125 /etc/passwd 2024-05-08T17:35:40.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:40.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-126 /etc/passwd 2024-05-08T17:35:40.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:40.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-127 /etc/passwd 2024-05-08T17:35:40.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:40.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-128 /etc/passwd 2024-05-08T17:35:40.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:40.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-129 /etc/passwd 2024-05-08T17:35:40.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:40.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-130 /etc/passwd 2024-05-08T17:35:41.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:41.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-131 /etc/passwd 2024-05-08T17:35:41.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:41.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-132 /etc/passwd 2024-05-08T17:35:41.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:41.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-133 /etc/passwd 2024-05-08T17:35:41.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:41.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-134 /etc/passwd 2024-05-08T17:35:41.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:41.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-135 /etc/passwd 2024-05-08T17:35:42.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:42.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-136 /etc/passwd 2024-05-08T17:35:42.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:42.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-137 /etc/passwd 2024-05-08T17:35:42.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:42.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-138 /etc/passwd 2024-05-08T17:35:42.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:42.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-139 /etc/passwd 2024-05-08T17:35:42.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:42.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-140 /etc/passwd 2024-05-08T17:35:42.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:42.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-141 /etc/passwd 2024-05-08T17:35:43.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:43.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-142 /etc/passwd 2024-05-08T17:35:43.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:43.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-143 /etc/passwd 2024-05-08T17:35:43.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:43.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-144 /etc/passwd 2024-05-08T17:35:43.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:43.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-145 /etc/passwd 2024-05-08T17:35:43.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:43.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-146 /etc/passwd 2024-05-08T17:35:44.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:44.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-147 /etc/passwd 2024-05-08T17:35:44.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:44.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-148 /etc/passwd 2024-05-08T17:35:44.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:44.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-149 /etc/passwd 2024-05-08T17:35:44.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:35:44.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-150 /etc/passwd 2024-05-08T17:35:44.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph pg dump pgs --format=json 2024-05-08T17:35:44.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: jq '.pg_stats[0].up[]' 2024-05-08T17:35:45.155 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:35:45.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph osd out 1 0 2 2024-05-08T17:35:45.833 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2024-05-08T17:35:45.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:69: _common_test: '[' 0 '!=' 0 ']' 2024-05-08T17:35:45.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:75: _common_test: sleep 1 2024-05-08T17:35:46.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:76: _common_test: wait_for_clean 2024-05-08T17:35:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:35:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:35:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:35:46.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:35:46.853 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:35:46.853 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:35:46.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:35:46.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:35:46.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:35:46.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:35:46.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:35:46.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:35:46.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:35:46.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:35:46.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:35:47.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:35:47.409 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:35:47.410 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:35:47.410 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:35:47.410 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T17:35:47.410 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T17:35:47.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:35:47.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:35:47.410 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:35:47.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836533 2024-05-08T17:35:47.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836533 2024-05-08T17:35:47.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836533' 2024-05-08T17:35:47.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:35:47.685 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:35:47.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673002 2024-05-08T17:35:47.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673002 2024-05-08T17:35:47.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836533 1-42949673002' 2024-05-08T17:35:47.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:35:47.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:35:48.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509477 2024-05-08T17:35:48.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509477 2024-05-08T17:35:48.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836533 1-42949673002 2-64424509477' 2024-05-08T17:35:48.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:35:48.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:35:48.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345950 2024-05-08T17:35:48.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345950 2024-05-08T17:35:48.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836533 1-42949673002 2-64424509477 3-85899345950' 2024-05-08T17:35:48.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:35:48.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:35:48.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182424 2024-05-08T17:35:48.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182424 2024-05-08T17:35:48.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836533 1-42949673002 2-64424509477 3-85899345950 4-107374182424' 2024-05-08T17:35:48.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:35:48.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T17:35:48.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018897 2024-05-08T17:35:48.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018897 2024-05-08T17:35:48.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836533 1-42949673002 2-64424509477 3-85899345950 4-107374182424 5-128849018897' 2024-05-08T17:35:48.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:35:48.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836533 2024-05-08T17:35:48.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:35:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:35:48.568 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836533 2024-05-08T17:35:48.568 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:35:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836533 2024-05-08T17:35:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836533' 2024-05-08T17:35:48.570 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836533 2024-05-08T17:35:48.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:35:49.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836531 -lt 21474836533 2024-05-08T17:35:49.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:35:50.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:35:50.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:35:50.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836533 -lt 21474836533 2024-05-08T17:35:50.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:35:50.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673002 2024-05-08T17:35:50.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:35:50.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:35:50.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673002 2024-05-08T17:35:50.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:35:50.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673002 2024-05-08T17:35:50.637 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673002 2024-05-08T17:35:50.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673002' 2024-05-08T17:35:50.637 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:35:51.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673002 -lt 42949673002 2024-05-08T17:35:51.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:35:51.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509477 2024-05-08T17:35:51.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:35:51.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:35:51.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509477 2024-05-08T17:35:51.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:35:51.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509477 2024-05-08T17:35:51.322 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509477 2024-05-08T17:35:51.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509477' 2024-05-08T17:35:51.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:35:51.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509477 -lt 64424509477 2024-05-08T17:35:51.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:35:51.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345950 2024-05-08T17:35:51.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:35:51.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:35:51.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:35:51.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345950 2024-05-08T17:35:51.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345950 2024-05-08T17:35:51.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345950' 2024-05-08T17:35:51.923 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345950 2024-05-08T17:35:51.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:35:52.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345951 -lt 85899345950 2024-05-08T17:35:52.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:35:52.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182424 2024-05-08T17:35:52.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:35:52.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:35:52.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182424 2024-05-08T17:35:52.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:35:52.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182424 2024-05-08T17:35:52.395 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182424 2024-05-08T17:35:52.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182424' 2024-05-08T17:35:52.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:35:52.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182425 -lt 107374182424 2024-05-08T17:35:52.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:35:52.988 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018897 2024-05-08T17:35:52.989 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:35:52.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T17:35:52.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018897 2024-05-08T17:35:52.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:35:52.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018897 2024-05-08T17:35:52.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018897' 2024-05-08T17:35:52.993 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018897 2024-05-08T17:35:52.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T17:35:53.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018898 -lt 128849018897 2024-05-08T17:35:53.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:35:53.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:35:53.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:35:54.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T17:35:54.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:35:54.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:35:54.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:35:54.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:35:54.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:35:54.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:35:54.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:35:54.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:35:54.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:35:54.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:35:54.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:35:55.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:35:55.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T17:35:55.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:35:55.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T17:35:55.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:35:55.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:35:55.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:35:55.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:35:55.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:35:55.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:35:55.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:35:55.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:35:55.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:35:55.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:35:55.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:35:55.641 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:35:55.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:35:55.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:35:56.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:35:56.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:35:56.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:35:56.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:35:56.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:35:56.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:35:56.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:35:56.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:35:56.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:35:56.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=10649 2024-05-08T17:35:56.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 10649 '!=' null 2024-05-08T17:35:56.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:35:56.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:35:56.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:35:56.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:35:56.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:35:56.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:35:56.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:35:56.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:35:56.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:35:56.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:35:56.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:35:57.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:35:57.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:35:57.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:35:57.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:35:57.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:35:57.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:35:57.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:35:57.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:35:57.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:35:57.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:35:57.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:35:57.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:35:57.920 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:35:58.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=37307 2024-05-08T17:35:58.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 37307 '!=' null 2024-05-08T17:35:58.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:35:58.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:35:58.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:35:58.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:35:58.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:35:58.748 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:35:58.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:35:58.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:35:58.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:35:58.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:35:58.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:35:59.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:35:59.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:35:59.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:35:59.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:35:59.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:35:59.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:35:59.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:35:59.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:35:59.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:35:59.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:35:59.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:35:59.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:35:59.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:00.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=32335 2024-05-08T17:36:00.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 32335 '!=' null 2024-05-08T17:36:00.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:00.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:00.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:00.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:00.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:00.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:00.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:00.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:00.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:00.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:00.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:00.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:00.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:01.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:01.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:02.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=52744 2024-05-08T17:36:02.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 52744 '!=' null 2024-05-08T17:36:02.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:02.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:02.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:02.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:02.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:02.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:02.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:02.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:02.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:02.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:02.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:02.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:02.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:02.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:02.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:03.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:03.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:03.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:03.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:03.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:03.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:03.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:03.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:03.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:04.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=45644 2024-05-08T17:36:04.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 45644 '!=' null 2024-05-08T17:36:04.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:04.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:04.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:04.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:04.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:04.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:04.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:04.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:04.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:04.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:04.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:04.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:04.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:04.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:04.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:05.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:05.415 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:05.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:05.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=45644 2024-05-08T17:36:05.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 45644 '!=' null 2024-05-08T17:36:05.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:05.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:05.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:06.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:06.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:06.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:06.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:06.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:06.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:06.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:06.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:06.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:06.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:06.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:06.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:07.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:07.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:07.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:07.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:07.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:07.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:07.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=68974 2024-05-08T17:36:07.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 68974 '!=' null 2024-05-08T17:36:07.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:07.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:07.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:07.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:07.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:07.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:07.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:07.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:07.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:07.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:07.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:08.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:08.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:08.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:08.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:08.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:08.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:08.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:08.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:08.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:08.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:08.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:08.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:08.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:09.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=68974 2024-05-08T17:36:09.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 68974 '!=' null 2024-05-08T17:36:09.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:09.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:09.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:09.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:09.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:09.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:09.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:09.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:09.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:09.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:09.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:09.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:09.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:09.926 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:09.926 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:10.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:10.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:10.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:10.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:10.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:10.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:10.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:10.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:10.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:11.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=46658 2024-05-08T17:36:11.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 46658 '!=' null 2024-05-08T17:36:11.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:11.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:11.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:11.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:11.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:11.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:11.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:11.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:11.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:11.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:11.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:11.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:11.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:11.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:11.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:12.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:12.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:12.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:12.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:12.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:12.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:12.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:12.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:12.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:13.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=71002 2024-05-08T17:36:13.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 71002 '!=' null 2024-05-08T17:36:13.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:13.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:13.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:13.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:13.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:13.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:13.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:13.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:13.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:13.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:13.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:13.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:13.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:13.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:13.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:14.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:14.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:14.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=47673 2024-05-08T17:36:14.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 47673 '!=' null 2024-05-08T17:36:14.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:14.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:14.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:14.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:14.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:14.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:14.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:14.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:14.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:15.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:15.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:15.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:15.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:16.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:16.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:16.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:16.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:16.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:16.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:16.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:16.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:16.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:16.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=47672 2024-05-08T17:36:16.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 47672 '!=' null 2024-05-08T17:36:16.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:16.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:16.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:16.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:16.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:16.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:16.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:16.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:16.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:16.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:16.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:17.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:17.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:17.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:17.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:17.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:17.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:17.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:17.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:17.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:17.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:17.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:17.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:17.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:18.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=71001 2024-05-08T17:36:18.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 71001 '!=' null 2024-05-08T17:36:18.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:18.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:18.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:18.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:18.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:18.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:18.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:18.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:18.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:18.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:18.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:18.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:18.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:18.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:18.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:19.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:19.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:19.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:19.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:19.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:19.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:19.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:19.691 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:19.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:20.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=47672 2024-05-08T17:36:20.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 47672 '!=' null 2024-05-08T17:36:20.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:20.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:20.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:20.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:20.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:20.424 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:20.424 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:20.424 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:20.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:20.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:20.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:20.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:20.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:20.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:20.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:21.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:21.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:21.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:21.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:21.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:21.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:21.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:21.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:21.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:22.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=71001 2024-05-08T17:36:22.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 71001 '!=' null 2024-05-08T17:36:22.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:22.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:22.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:22.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:22.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:22.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:22.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:22.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:22.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:22.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:22.662 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:23.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:23.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:23.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:23.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:23.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:23.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:23.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:23.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:23.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:23.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:23.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:23.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:23.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=69988 2024-05-08T17:36:24.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 69988 '!=' null 2024-05-08T17:36:24.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:24.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:24.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:24.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:24.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:24.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:24.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:24.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:24.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:24.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:24.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:24.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:36:24.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:24.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:24.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:25.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:36:25.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:36:25.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:36:25.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:36:25.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:36:25.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:36:25.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:36:25.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:36:25.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:36:25.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=42602 2024-05-08T17:36:25.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 42602 '!=' null 2024-05-08T17:36:25.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:36:25.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:36:25.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:36:26.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:36:26.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:36:26.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:36:26.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:36:26.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:36:26.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:36:26.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:36:26.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:36:26.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:36:26.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:36:26.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:36:26.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:36:27.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T17:36:27.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:36:27.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:36:27.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:78: _common_test: flush_pg_stats 2024-05-08T17:36:27.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:36:27.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:36:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:36:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:36:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:36:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:36:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T17:36:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T17:36:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:36:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:36:27.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:36:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836543 2024-05-08T17:36:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836543 2024-05-08T17:36:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543' 2024-05-08T17:36:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:36:27.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:36:27.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673012 2024-05-08T17:36:27.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673012 2024-05-08T17:36:27.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673012' 2024-05-08T17:36:27.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:36:27.886 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:36:28.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509487 2024-05-08T17:36:28.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509487 2024-05-08T17:36:28.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673012 2-64424509487' 2024-05-08T17:36:28.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:36:28.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:36:28.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345960 2024-05-08T17:36:28.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345960 2024-05-08T17:36:28.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673012 2-64424509487 3-85899345960' 2024-05-08T17:36:28.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:36:28.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:36:28.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182434 2024-05-08T17:36:28.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182434 2024-05-08T17:36:28.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673012 2-64424509487 3-85899345960 4-107374182434' 2024-05-08T17:36:28.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:36:28.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T17:36:28.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018907 2024-05-08T17:36:28.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018907 2024-05-08T17:36:28.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673012 2-64424509487 3-85899345960 4-107374182434 5-128849018907' 2024-05-08T17:36:28.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:36:28.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836543 2024-05-08T17:36:28.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:36:28.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:36:28.508 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836543 2024-05-08T17:36:28.508 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:36:28.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836543 2024-05-08T17:36:28.509 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836543 2024-05-08T17:36:28.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836543' 2024-05-08T17:36:28.509 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:36:28.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836541 -lt 21474836543 2024-05-08T17:36:28.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:36:29.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:36:29.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:36:30.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836543 -lt 21474836543 2024-05-08T17:36:30.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:36:30.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673012 2024-05-08T17:36:30.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:36:30.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:36:30.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673012 2024-05-08T17:36:30.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:36:30.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673012 2024-05-08T17:36:30.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673012' 2024-05-08T17:36:30.340 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673012 2024-05-08T17:36:30.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:36:30.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673012 -lt 42949673012 2024-05-08T17:36:30.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:36:30.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509487 2024-05-08T17:36:30.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:36:30.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:36:30.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509487 2024-05-08T17:36:30.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:36:30.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509487 2024-05-08T17:36:30.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509487' 2024-05-08T17:36:30.781 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509487 2024-05-08T17:36:30.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:36:31.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509487 -lt 64424509487 2024-05-08T17:36:31.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:36:31.197 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345960 2024-05-08T17:36:31.197 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:36:31.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:36:31.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345960 2024-05-08T17:36:31.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:36:31.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345960 2024-05-08T17:36:31.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345960' 2024-05-08T17:36:31.200 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345960 2024-05-08T17:36:31.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:36:31.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345961 -lt 85899345960 2024-05-08T17:36:31.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:36:31.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:36:31.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182434 2024-05-08T17:36:31.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:36:31.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182434 2024-05-08T17:36:31.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:36:31.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182434 2024-05-08T17:36:31.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182434' 2024-05-08T17:36:31.653 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182434 2024-05-08T17:36:31.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:36:32.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182435 -lt 107374182434 2024-05-08T17:36:32.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:36:32.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018907 2024-05-08T17:36:32.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:36:32.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T17:36:32.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018907 2024-05-08T17:36:32.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:36:32.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018907 2024-05-08T17:36:32.083 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018907 2024-05-08T17:36:32.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018907' 2024-05-08T17:36:32.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T17:36:32.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018908 -lt 128849018907 2024-05-08T17:36:32.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: ceph pg dump pgs --format=json 2024-05-08T17:36:32.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: jq '.pg_stats[0].up_primary' 2024-05-08T17:36:32.975 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:36:32.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: newprimary=4 2024-05-08T17:36:32.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:81: _common_test: kill_daemons 2024-05-08T17:36:32.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:36:32.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:36:32.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:36:32.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:36:32.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:36:38.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:36:38.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:83: _common_test: ERRORS=0 2024-05-08T17:36:38.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2024-05-08T17:36:38.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:38.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T17:36:38.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=4 2024-05-08T17:36:38.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T17:36:38.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: tee td/osd-backfill-recovery-log/result.log 2024-05-08T17:36:38.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2024-05-08T17:36:38.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2024-05-08T17:36:40.132 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:36:40.132 INFO:tasks.workunit.client.0.smithi117.stdout: "pg_log_t": { 2024-05-08T17:36:40.132 INFO:tasks.workunit.client.0.smithi117.stdout: "head": "34'150", 2024-05-08T17:36:40.132 INFO:tasks.workunit.client.0.smithi117.stdout: "tail": "34'148", 2024-05-08T17:36:40.132 INFO:tasks.workunit.client.0.smithi117.stdout: "log": [ 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:e9c179f9:::obj-149:head", 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'149", 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4841.0:1", 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:35:44.443741+0000", 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:36:40.133 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:cb39fd60:::obj-150:head", 2024-05-08T17:36:40.134 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'150", 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4844.0:1", 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:35:44.621754+0000", 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:36:40.135 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: "dups": [ 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4817.0:1", 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'141", 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "141", 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4820.0:1", 2024-05-08T17:36:40.136 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'142", 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "142", 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4823.0:1", 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'143", 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "143", 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4826.0:1", 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'144", 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "144", 2024-05-08T17:36:40.137 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4829.0:1", 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'145", 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "145", 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4832.0:1", 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'146", 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "146", 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.138 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4835.0:1", 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'147", 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "147", 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4838.0:1", 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'148", 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "148", 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:36:40.139 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:36:40.140 INFO:tasks.workunit.client.0.smithi117.stdout: "pg_missing_t": { 2024-05-08T17:36:40.140 INFO:tasks.workunit.client.0.smithi117.stdout: "missing": [], 2024-05-08T17:36:40.140 INFO:tasks.workunit.client.0.smithi117.stdout: "may_include_deletes": true 2024-05-08T17:36:40.140 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:36:40.140 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:36:40.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2024-05-08T17:36:40.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: LOGLEN=2 2024-05-08T17:36:40.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:86: _common_test: '[' 2 '!=' 2 ']' 2024-05-08T17:36:40.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2024-05-08T17:36:40.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: DUPSLEN=8 2024-05-08T17:36:40.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:91: _common_test: '[' 8 '!=' 8 ']' 2024-05-08T17:36:40.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:95: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2024-05-08T17:36:40.221 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=7 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to copy log version 34'150 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to copy log version 34'149 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'142 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'143 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'144 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'145 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'146 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'147 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'148 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to END max 2 dups.size()=8 other.dups.size()=7 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=7 2024-05-08T17:36:40.222 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to copy log version 34'150 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to copy log version 34'149 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'142 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'143 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'144 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'145 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'146 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'147 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'148 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to END max 2 dups.size()=8 other.dups.size()=7 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=7 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to copy log version 34'150 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to copy log version 34'149 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:36:40.223 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'142 2024-05-08T17:36:40.224 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'143 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'144 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'145 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'146 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'147 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'148 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:35:48.559+0000 7f12b36ad640 20 copy_up_to END max 2 dups.size()=8 other.dups.size()=7 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_after v 34'150 dups.size()=0 other.dups.size()=7 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'142 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'143 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'144 2024-05-08T17:36:40.255 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'145 2024-05-08T17:36:40.256 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'146 2024-05-08T17:36:40.256 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'147 2024-05-08T17:36:40.256 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'148 2024-05-08T17:36:40.256 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'149 2024-05-08T17:36:40.256 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_up_to/copy_after copy dup from log version 34'150 2024-05-08T17:36:40.256 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:36:22.823+0000 7f12b36ad640 20 copy_after END v 34'150 dups.size()=10 other.dups.size()=7 2024-05-08T17:36:40.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:96: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2024-05-08T17:36:40.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:97: _common_test: '[' 0 '!=' 0 ']' 2024-05-08T17:36:40.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:35: run: teardown td/osd-backfill-recovery-log 2024-05-08T17:36:40.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:40.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:36:40.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:36:40.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:36:40.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:36:40.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:36:40.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:36:40.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:36:40.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:36:40.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:36:40.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:36:40.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:36:40.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:36:40.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:36:40.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:36:40.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:36:40.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:36:40.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:36:40.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:36:40.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:36:40.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:36:40.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:36:40.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:36:40.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:36:40.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:36:40.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:32: run: for func in $funcs 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:33: run: setup td/osd-backfill-recovery-log 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-recovery-log 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:36:40.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:36:40.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:36:40.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:36:40.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:36:40.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:36:40.312 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:36:40.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:36:40.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:36:40.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:36:40.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:36:40.314 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:36:40.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:36:40.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:36:40.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:36:40.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:36:40.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:36:40.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:36:40.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:36:40.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:36:40.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:36:40.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:36:40.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:36:40.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:36:40.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:36:40.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-recovery-log 2024-05-08T17:36:40.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T17:36:40.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:36:40.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:36:40.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.47083 2024-05-08T17:36:40.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T17:36:40.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T17:36:40.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T17:36:40.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:34: run: TEST_backfill_log_2 td/osd-backfill-recovery-log 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:114: TEST_backfill_log_2: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:116: TEST_backfill_log_2: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2 148 150 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:41: _common_test: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:42: _common_test: local 'extra_opts=--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:43: _common_test: local loglen=2 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:44: _common_test: local dupslen=148 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:45: _common_test: local objects=150 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:46: _common_test: local moreobjects=0 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:48: _common_test: local OSDS=6 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:50: _common_test: run_mon td/osd-backfill-recovery-log a 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T17:36:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T17:36:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T17:36:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-recovery-log/a 2024-05-08T17:36:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2024-05-08T17:36:40.701 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T17:36:40.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:36:40.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:36:40.703 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:36:40.703 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:36:40.703 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:36:40.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:36:40.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T17:36:40.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T17:36:40.922 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T17:36:40.922 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:36:40.922 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:36:40.922 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T17:36:40.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.47083/ceph-mon.a.asok 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:36:40.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.47083/ceph-mon.a.asok config get fsid 2024-05-08T17:36:41.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T17:36:41.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:36:41.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:36:41.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T17:36:41.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.47083/ceph-mon.a.asok 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:36:41.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.47083/ceph-mon.a.asok config get mon_host 2024-05-08T17:36:41.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:51: _common_test: run_mgr td/osd-backfill-recovery-log x 2024-05-08T17:36:41.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:41.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T17:36:41.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T17:36:41.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T17:36:41.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-recovery-log/x 2024-05-08T17:36:41.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T17:36:42.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T17:36:42.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:36:42.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:36:42.081 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:36:42.081 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:36:42.081 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:36:42.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:36:42.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:36:42.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:36:42.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:52: _common_test: export CEPH_ARGS 2024-05-08T17:36:42.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:36:42.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:36:42.151 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: expr 6 - 1 2024-05-08T17:36:42.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: seq 0 5 2024-05-08T17:36:42.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:36:42.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 0 2024-05-08T17:36:42.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:36:42.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:36:42.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:36:42.156 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:36:42.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:36:42.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:36:42.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:36:42.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2024-05-08T17:36:42.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:36:42.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=efac72f5-fd62-4b1e-8d9b-cf88cf84be1e 2024-05-08T17:36:42.158 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 efac72f5-fd62-4b1e-8d9b-cf88cf84be1e 2024-05-08T17:36:42.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 efac72f5-fd62-4b1e-8d9b-cf88cf84be1e' 2024-05-08T17:36:42.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:36:42.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAquDtmOwoLCxAA/vYe6cOh3OQLfisnYOcfwQ== 2024-05-08T17:36:42.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAquDtmOwoLCxAA/vYe6cOh3OQLfisnYOcfwQ=="}' 2024-05-08T17:36:42.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new efac72f5-fd62-4b1e-8d9b-cf88cf84be1e -i td/osd-backfill-recovery-log/0/new.json 2024-05-08T17:36:42.507 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:36:42.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2024-05-08T17:36:42.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAquDtmOwoLCxAA/vYe6cOh3OQLfisnYOcfwQ== --osd-uuid efac72f5-fd62-4b1e-8d9b-cf88cf84be1e 2024-05-08T17:36:42.568 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:42.570+0000 7fa1723eb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:36:42.584 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:42.586+0000 7fa1723eb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:36:42.586 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:42.586+0000 7fa1723eb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:36:42.586 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:42.590+0000 7fa1723eb7c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:36:42.586 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:42.590+0000 7fa1723eb7c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:36:42.586 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:42.590+0000 7fa1723eb7c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:36:42.624 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:42.626+0000 7fa1723eb7c0 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2024-05-08T17:36:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2024-05-08T17:36:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:36:49.054 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T17:36:49.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T17:36:49.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:36:49.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T17:36:49.591 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:36:49.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:36:49.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:36:49.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:36:49.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:36:49.628 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:49.634+0000 7f03422937c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:36:49.629 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:49.634+0000 7f03422937c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:36:49.631 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:49.638+0000 7f03422937c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:36:50.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T17:36:50.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:36:50.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:36:50.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:36:50.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:36:50.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:36:50.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:36:50.021 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:36:50.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:36:50.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:36:50.199 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:50.206+0000 7f03422937c0 -1 Falling back to public interface 2024-05-08T17:36:50.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:36:51.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:36:51.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:36:51.426 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:36:51.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:36:51.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:36:51.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:36:51.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:36:52.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:36:52.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:36:52.846 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:36:52.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:36:52.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:36:52.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:36:52.937 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:36:52.942+0000 7f03422937c0 -1 osd.0 0 log_to_monitors true 2024-05-08T17:36:53.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:36:54.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:36:54.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:36:54.265 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:36:54.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:36:54.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:36:54.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:36:54.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:36:55.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:36:55.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:36:55.789 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:36:55.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:36:55.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:36:55.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:36:56.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:36:57.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:36:57.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:36:57.240 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:36:57.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:36:57.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:36:57.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:36:57.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:36:58.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:36:58.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:36:58.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:36:58.714 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:36:58.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:36:58.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:36:59.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:00.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:00.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:00.119 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:37:00.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:37:00.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:00.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:00.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:01.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:01.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:01.564 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:37:01.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:37:01.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:01.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:02.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:03.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:03.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:03.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:37:03.118 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:37:03.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:03.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:03.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:04.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:04.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:04.595 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:37:04.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:37:04.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:04.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:05.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:06.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:06.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:06.175 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:37:06.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:37:06.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:06.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:06.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:07.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:07.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:07.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:37:07.790 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:37:07.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:07.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:08.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:09.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:09.542 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:37:09.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:37:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:10.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:11.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:11.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:11.122 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:37:11.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:37:11.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:11.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:11.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:12.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:12.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:12.903 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:37:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:37:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:14.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:15.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:15.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:15.140 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:37:15.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:37:15.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:15.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:15.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:37:16.790 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:37:16.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:16.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:17.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:18.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:18.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:18.680 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:37:18.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:37:18.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:18.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:37:19.081 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1942353206,v1:127.0.0.1:6803/1942353206] [v2:127.0.0.1:6804/1942353206,v1:127.0.0.1:6805/1942353206] exists,up efac72f5-fd62-4b1e-8d9b-cf88cf84be1e 2024-05-08T17:37:19.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:37:19.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:37:19.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 1 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:37:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:37:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:37:19.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=aba960b7-5505-4bb8-87bd-78fce394fafe 2024-05-08T17:37:19.092 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 aba960b7-5505-4bb8-87bd-78fce394fafe 2024-05-08T17:37:19.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 aba960b7-5505-4bb8-87bd-78fce394fafe' 2024-05-08T17:37:19.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:37:19.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBPuDtmuxgcBxAA9Kg/3l55PB/TqLlTenPT5Q== 2024-05-08T17:37:19.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBPuDtmuxgcBxAA9Kg/3l55PB/TqLlTenPT5Q=="}' 2024-05-08T17:37:19.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new aba960b7-5505-4bb8-87bd-78fce394fafe -i td/osd-backfill-recovery-log/1/new.json 2024-05-08T17:37:19.765 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:37:19.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2024-05-08T17:37:19.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBPuDtmuxgcBxAA9Kg/3l55PB/TqLlTenPT5Q== --osd-uuid aba960b7-5505-4bb8-87bd-78fce394fafe 2024-05-08T17:37:19.819 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:19.825+0000 7f1eeb06f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:19.851 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:19.857+0000 7f1eeb06f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:19.853 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:19.857+0000 7f1eeb06f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:19.853 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:19.857+0000 7f1eeb06f7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:37:19.853 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:19.857+0000 7f1eeb06f7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:37:19.853 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:19.857+0000 7f1eeb06f7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:37:19.891 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:19.897+0000 7f1eeb06f7c0 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2024-05-08T17:37:26.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2024-05-08T17:37:26.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:37:26.604 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T17:37:26.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T17:37:26.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:37:27.164 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T17:37:27.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T17:37:27.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:37:27.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:37:27.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:37:27.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:37:27.200 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:27.205+0000 7f96bbb067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:27.203 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:27.209+0000 7f96bbb067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:27.204 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:27.209+0000 7f96bbb067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:27.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T17:37:27.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:37:27.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T17:37:27.576 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:37:27.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:37:27.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:37:27.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:27.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:37:27.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:27.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:27.800 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:27.805+0000 7f96bbb067c0 -1 Falling back to public interface 2024-05-08T17:37:28.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:29.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:29.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:29.072 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:37:29.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:37:29.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:29.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:29.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:30.484 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:30.489+0000 7f96bbb067c0 -1 osd.1 0 log_to_monitors true 2024-05-08T17:37:30.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:30.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:30.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:37:30.499 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:37:30.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:30.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:30.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:31.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:31.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:31.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:37:31.916 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:37:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:32.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:33.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:33.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:33.350 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:37:33.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:37:33.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:33.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:33.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:34.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:34.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:34.810 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:37:34.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:37:34.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:34.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:35.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:36.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:36.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:36.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:37:36.244 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:37:36.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:36.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:36.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:37.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:37.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:37.743 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:37:37.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:37:37.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:37.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:38.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:39.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:39.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:39.171 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:37:39.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:37:39.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:39.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:39.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:40.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:40.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:40.627 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:37:40.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:37:40.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:40.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:41.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:42.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:42.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:42.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:37:42.050 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:37:42.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:42.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:42.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:43.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:43.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:43.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:37:43.598 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:37:43.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:43.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:44.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:45.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:45.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:45.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:37:45.182 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:37:45.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:45.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:46.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:47.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:47.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:47.136 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:37:47.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:37:47.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:47.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:48.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:49.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:49.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:49.332 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:37:49.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:37:49.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:49.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:50.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:51.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:51.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:51.211 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:37:51.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:37:51.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:51.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:52.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:53.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:53.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:53.071 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:37:53.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:37:53.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:53.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:53.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:54.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:54.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:54.773 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:37:54.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:37:54.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:54.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:55.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:37:56.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:37:56.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:37:56.946 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:37:56.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:37:56.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:37:56.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:37:57.361 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/426708338,v1:127.0.0.1:6811/426708338] [v2:127.0.0.1:6812/426708338,v1:127.0.0.1:6813/426708338] exists,up aba960b7-5505-4bb8-87bd-78fce394fafe 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 2 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:37:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:37:57.366 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:37:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:37:57.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:37:57.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2024-05-08T17:37:57.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:37:57.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=aa474f27-a4b5-4381-a9da-0126ef299f5c 2024-05-08T17:37:57.369 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 aa474f27-a4b5-4381-a9da-0126ef299f5c 2024-05-08T17:37:57.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 aa474f27-a4b5-4381-a9da-0126ef299f5c' 2024-05-08T17:37:57.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:37:57.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB1uDtmURpuFxAACWyITJImDfrppRIL/lr8yQ== 2024-05-08T17:37:57.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB1uDtmURpuFxAACWyITJImDfrppRIL/lr8yQ=="}' 2024-05-08T17:37:57.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new aa474f27-a4b5-4381-a9da-0126ef299f5c -i td/osd-backfill-recovery-log/2/new.json 2024-05-08T17:37:57.926 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:37:57.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2024-05-08T17:37:57.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB1uDtmURpuFxAACWyITJImDfrppRIL/lr8yQ== --osd-uuid aa474f27-a4b5-4381-a9da-0126ef299f5c 2024-05-08T17:37:57.979 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:57.984+0000 7fa99b2427c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:57.995 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:58.000+0000 7fa99b2427c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:57.996 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:58.000+0000 7fa99b2427c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:37:57.997 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:58.000+0000 7fa99b2427c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:37:57.997 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:58.000+0000 7fa99b2427c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:37:57.997 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:58.000+0000 7fa99b2427c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:37:58.035 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:37:58.040+0000 7fa99b2427c0 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2024-05-08T17:38:04.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2024-05-08T17:38:04.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:38:04.946 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T17:38:04.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T17:38:04.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:38:05.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T17:38:05.504 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T17:38:05.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:38:05.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:38:05.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:38:05.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:38:05.539 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:05.544+0000 7f8f1e1137c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:05.575 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:05.580+0000 7f8f1e1137c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:05.577 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:05.580+0000 7f8f1e1137c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:05.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T17:38:05.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:38:05.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T17:38:05.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:38:05.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:38:05.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:05.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:38:05.938 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:38:05.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:05.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:06.149 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:06.152+0000 7f8f1e1137c0 -1 Falling back to public interface 2024-05-08T17:38:06.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:07.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:07.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:07.405 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:38:07.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:38:07.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:07.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:07.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:08.758 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:08.760+0000 7f8f1e1137c0 -1 osd.2 0 log_to_monitors true 2024-05-08T17:38:08.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:08.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:08.811 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:38:08.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:38:08.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:08.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:09.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:10.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:10.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:10.357 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:38:10.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:38:10.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:10.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:10.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:11.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:11.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:11.832 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:38:11.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:38:11.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:11.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:12.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:13.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:13.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:13.273 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:38:13.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:38:13.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:13.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:13.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:14.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:14.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:14.909 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:38:14.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:38:14.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:14.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:15.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:16.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:16.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:16.313 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:38:16.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:38:16.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:16.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:16.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:17.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:17.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:17.841 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:38:17.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:38:17.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:17.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:18.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:19.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:19.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:19.260 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:38:19.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:38:19.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:19.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:19.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:20.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:20.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:20.863 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:38:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:38:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:21.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:22.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:22.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:22.323 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:38:22.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:38:22.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:22.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:22.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:23.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:23.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:23.956 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:38:23.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:38:23.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:23.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:24.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:25.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:25.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:25.885 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:38:25.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:38:25.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:25.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:26.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:27.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:27.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:27.693 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:38:27.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:38:27.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:27.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:28.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:29.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:29.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:29.409 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:38:29.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:38:29.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:29.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:30.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:31.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:31.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:31.315 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:38:31.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:38:31.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:31.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:32.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:33.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:33.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:33.088 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:38:33.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:38:33.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:33.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:34.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:35.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:35.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:35.102 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:38:35.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:38:35.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:35.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:38:35.528 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3693009401,v1:127.0.0.1:6819/3693009401] [v2:127.0.0.1:6820/3693009401,v1:127.0.0.1:6821/3693009401] exists,up aa474f27-a4b5-4381-a9da-0126ef299f5c 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 3 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:38:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:38:35.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:38:35.533 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:38:35.533 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:38:35.533 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:38:35.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:38:35.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:38:35.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:38:35.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2024-05-08T17:38:35.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:38:35.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=3c535d40-7f49-4098-8279-6c75e531fa70 2024-05-08T17:38:35.535 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 3c535d40-7f49-4098-8279-6c75e531fa70 2024-05-08T17:38:35.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 3c535d40-7f49-4098-8279-6c75e531fa70' 2024-05-08T17:38:35.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:38:35.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCbuDtmV8aiIRAA0TOuON9LpuN4e7oD+/53ew== 2024-05-08T17:38:35.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCbuDtmV8aiIRAA0TOuON9LpuN4e7oD+/53ew=="}' 2024-05-08T17:38:35.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 3c535d40-7f49-4098-8279-6c75e531fa70 -i td/osd-backfill-recovery-log/3/new.json 2024-05-08T17:38:36.028 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:38:36.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2024-05-08T17:38:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCbuDtmV8aiIRAA0TOuON9LpuN4e7oD+/53ew== --osd-uuid 3c535d40-7f49-4098-8279-6c75e531fa70 2024-05-08T17:38:36.084 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:36.088+0000 7ff6341347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:36.085 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:36.088+0000 7ff6341347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:36.087 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:36.092+0000 7ff6341347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:36.087 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:36.092+0000 7ff6341347c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:38:36.087 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:36.092+0000 7ff6341347c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:38:36.087 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:36.092+0000 7ff6341347c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:38:36.128 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:36.132+0000 7ff6341347c0 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2024-05-08T17:38:42.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2024-05-08T17:38:42.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:38:42.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T17:38:42.797 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T17:38:42.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:38:43.362 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T17:38:43.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T17:38:43.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:38:43.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:38:43.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:38:43.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:38:43.398 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:43.399+0000 7f1d061087c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:43.410 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:43.411+0000 7f1d061087c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:43.411 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:43.415+0000 7f1d061087c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:38:43.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T17:38:43.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:38:43.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T17:38:43.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:38:43.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:38:43.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:43.768 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:38:43.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:38:43.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:43.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:43.976 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:43.979+0000 7f1d061087c0 -1 Falling back to public interface 2024-05-08T17:38:44.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:45.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:45.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:45.200 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:38:45.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:38:45.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:45.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:45.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:46.462 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:38:46.463+0000 7f1d061087c0 -1 osd.3 0 log_to_monitors true 2024-05-08T17:38:46.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:46.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:46.616 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:38:46.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:38:46.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:46.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:47.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:48.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:48.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:48.218 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:38:48.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:38:48.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:48.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:48.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:49.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:49.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:49.667 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:38:49.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:38:49.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:49.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:50.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:51.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:51.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:51.116 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:38:51.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:38:51.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:51.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:51.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:52.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:52.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:52.740 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:38:52.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:38:52.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:52.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:53.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:54.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:54.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:54.355 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:38:54.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:38:54.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:54.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:55.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:55.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:55.767 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:38:55.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:38:55.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:55.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:56.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:57.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:57.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:57.397 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:38:57.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:38:57.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:57.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:57.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:38:58.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:38:58.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:38:58.873 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:38:58.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:38:58.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:38:58.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:38:59.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:00.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:00.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:00.373 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:39:00.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:39:00.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:00.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:39:00.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:01.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:01.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:01.962 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:39:01.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:39:01.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:01.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:39:03.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:04.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:04.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:04.173 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:39:04.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:39:04.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:04.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:39:05.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:06.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:06.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:06.093 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:39:06.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:39:06.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:06.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:39:06.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:07.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:07.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:07.968 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:39:07.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:39:07.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:07.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:39:08.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:09.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:09.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:09.874 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:39:09.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:39:09.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:09.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:39:10.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:11.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:11.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:11.590 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:39:11.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:39:11.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:11.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:39:12.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:13.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:13.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:13.328 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:39:13.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:39:13.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:13.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:39:13.764 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2255085115,v1:127.0.0.1:6827/2255085115] [v2:127.0.0.1:6828/2255085115,v1:127.0.0.1:6829/2255085115] exists,up 3c535d40-7f49-4098-8279-6c75e531fa70 2024-05-08T17:39:13.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:39:13.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:39:13.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:39:13.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:39:13.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 4 2024-05-08T17:39:13.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:39:13.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:39:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:39:13.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:39:13.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:39:13.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:39:13.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:39:13.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2024-05-08T17:39:13.771 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:39:13.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f64c9207-4fe8-4c57-9c72-23feb0d951d4 2024-05-08T17:39:13.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 f64c9207-4fe8-4c57-9c72-23feb0d951d4' 2024-05-08T17:39:13.772 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 f64c9207-4fe8-4c57-9c72-23feb0d951d4 2024-05-08T17:39:13.772 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:39:13.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDBuDtmwmJqLxAAddjzcIRbMks9zXGvXXdAvA== 2024-05-08T17:39:13.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDBuDtmwmJqLxAAddjzcIRbMks9zXGvXXdAvA=="}' 2024-05-08T17:39:13.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f64c9207-4fe8-4c57-9c72-23feb0d951d4 -i td/osd-backfill-recovery-log/4/new.json 2024-05-08T17:39:14.306 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:39:14.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2024-05-08T17:39:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDBuDtmwmJqLxAAddjzcIRbMks9zXGvXXdAvA== --osd-uuid f64c9207-4fe8-4c57-9c72-23feb0d951d4 2024-05-08T17:39:14.359 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:14.363+0000 7f61f5bcc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:14.400 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:14.403+0000 7f61f5bcc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:14.402 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:14.403+0000 7f61f5bcc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:14.402 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:14.403+0000 7f61f5bcc7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:39:14.402 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:14.403+0000 7f61f5bcc7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:39:14.402 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:14.403+0000 7f61f5bcc7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:39:14.431 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:14.435+0000 7f61f5bcc7c0 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2024-05-08T17:39:21.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2024-05-08T17:39:21.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:39:21.402 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T17:39:21.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T17:39:21.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:39:21.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T17:39:21.958 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T17:39:21.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:39:21.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:39:21.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:39:21.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:39:21.992 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:21.995+0000 7f09174ff7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:21.994 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:21.995+0000 7f09174ff7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:21.995 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:21.999+0000 7f09174ff7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:22.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T17:39:22.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:39:22.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T17:39:22.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:39:22.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:39:22.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:22.339 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:39:22.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:39:22.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:22.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:22.549 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:22.551+0000 7f09174ff7c0 -1 Falling back to public interface 2024-05-08T17:39:22.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:23.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:23.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:23.788 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:39:23.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:39:23.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:23.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:24.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:25.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:25.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:25.196 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:39:25.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:39:25.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:25.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:25.202 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:25.202+0000 7f09174ff7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T17:39:25.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:26.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:26.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:26.620 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:39:26.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:39:26.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:26.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:27.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:28.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:28.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:28.359 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:39:28.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:39:28.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:28.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:28.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:29.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:29.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:29.799 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:39:29.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:39:29.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:29.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:30.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:31.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:31.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:31.241 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:39:31.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:39:31.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:31.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:31.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:32.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:32.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:32.817 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:39:32.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:39:32.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:32.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:33.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:34.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:34.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:34.309 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:39:34.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:39:34.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:34.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:34.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:35.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:35.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:35.731 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:39:35.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:39:35.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:35.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:36.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:37.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:37.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:37.299 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:39:37.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:39:37.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:37.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:37.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:38.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:38.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:38.832 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:39:38.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:39:38.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:38.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:39.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:40.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:40.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:40.313 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:39:40.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:39:40.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:40.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:40.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:41.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:41.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:41.930 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:39:41.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:39:41.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:41.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:42.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:43.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:43.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:43.790 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:39:43.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:39:43.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:43.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:44.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:45.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:45.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:45.704 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:39:45.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:39:45.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:45.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:46.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:47.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:47.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:47.595 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:39:47.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:39:47.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:47.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:48.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:49.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:49.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:49.551 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:39:49.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:39:49.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:49.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:50.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:39:51.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:39:51.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:39:51.378 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:39:51.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:39:51.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:39:51.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:39:51.893 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1788593871,v1:127.0.0.1:6835/1788593871] [v2:127.0.0.1:6836/1788593871,v1:127.0.0.1:6837/1788593871] exists,up f64c9207-4fe8-4c57-9c72-23feb0d951d4 2024-05-08T17:39:51.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:39:51.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:39:51.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 5 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:39:51.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:39:51.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:39:51.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:39:51.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:39:51.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:39:51.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:39:51.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:39:51.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b5e2e030-e760-4d9f-b4c7-3a11a16818d7 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 b5e2e030-e760-4d9f-b4c7-3a11a16818d7' 2024-05-08T17:39:51.900 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 b5e2e030-e760-4d9f-b4c7-3a11a16818d7 2024-05-08T17:39:51.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:39:51.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDnuDtmplNhNxAA/PYjl1j8ozSMQ7EElW9lig== 2024-05-08T17:39:51.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDnuDtmplNhNxAA/PYjl1j8ozSMQ7EElW9lig=="}' 2024-05-08T17:39:51.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b5e2e030-e760-4d9f-b4c7-3a11a16818d7 -i td/osd-backfill-recovery-log/5/new.json 2024-05-08T17:39:52.566 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:39:52.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2024-05-08T17:39:52.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnuDtmplNhNxAA/PYjl1j8ozSMQ7EElW9lig== --osd-uuid b5e2e030-e760-4d9f-b4c7-3a11a16818d7 2024-05-08T17:39:52.624 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:52.630+0000 7f40e1fcd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:52.627 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:52.634+0000 7f40e1fcd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:52.628 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:52.634+0000 7f40e1fcd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:39:52.629 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:52.634+0000 7f40e1fcd7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:39:52.629 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:52.634+0000 7f40e1fcd7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:39:52.629 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:52.634+0000 7f40e1fcd7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:39:52.705 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:39:52.710+0000 7f40e1fcd7c0 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2024-05-08T17:39:59.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2024-05-08T17:39:59.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:39:59.627 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T17:39:59.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T17:39:59.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:40:00.167 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T17:40:00.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T17:40:00.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:40:00.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:40:00.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:40:00.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:40:00.202 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:40:00.206+0000 7fd2c31627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:40:00.204 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:40:00.210+0000 7fd2c31627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:40:00.205 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:40:00.210+0000 7fd2c31627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:40:00.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T17:40:00.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:40:00.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T17:40:00.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:40:00.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:40:00.564 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:40:00.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:00.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:40:00.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:00.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:00.781 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:40:00.786+0000 7fd2c31627c0 -1 Falling back to public interface 2024-05-08T17:40:01.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:02.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:02.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:02.027 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:40:02.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:40:02.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:02.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:02.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:03.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:03.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:03.456 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:40:03.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:40:03.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:03.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:03.508 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:40:03.514+0000 7fd2c31627c0 -1 osd.5 0 log_to_monitors true 2024-05-08T17:40:03.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:04.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:04.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:04.919 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:40:04.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:40:04.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:04.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:05.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:06.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:06.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:06.521 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:40:06.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:40:06.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:06.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:06.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:07.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:07.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:07.955 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:40:07.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:40:07.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:07.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:08.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:09.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:09.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:09.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:40:09.466 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:40:09.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:09.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:09.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:10.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:10.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:10.948 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:40:10.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:40:10.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:10.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:11.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:12.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:12.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:12.485 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:40:12.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:40:12.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:12.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:12.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:13.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:13.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:13.950 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:40:13.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:40:13.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:13.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:14.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:15.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:15.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:15.427 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:40:15.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:40:15.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:15.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:15.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:16.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:16.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:16.899 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:40:16.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:40:16.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:16.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:17.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:18.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:18.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:18.470 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:40:18.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:40:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:19.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:20.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:20.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:20.267 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:40:20.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:40:20.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:20.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:21.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:22.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:22.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:22.127 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:40:22.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:40:22.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:22.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:22.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:23.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:23.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:23.967 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:40:23.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:40:23.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:23.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:24.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:25.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:25.680 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:40:25.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:25.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:40:25.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:25.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:26.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:27.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:27.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:27.737 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:40:27.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:40:27.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:27.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:28.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:29.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:29.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:29.720 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:40:29.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:40:29.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:29.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:30.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:40:31.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:40:31.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:40:31.204 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T17:40:31.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T17:40:31.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:40:31.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:40:31.660 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/183594417,v1:127.0.0.1:6843/183594417] [v2:127.0.0.1:6844/183594417,v1:127.0.0.1:6845/183594417] exists,up b5e2e030-e760-4d9f-b4c7-3a11a16818d7 2024-05-08T17:40:31.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:40:31.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:40:31.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:40:31.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:60: _common_test: create_pool test 1 1 2024-05-08T17:40:31.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T17:40:32.269 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T17:40:32.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:40:33.290 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: seq 1 150 2024-05-08T17:40:33.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:33.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-1 /etc/passwd 2024-05-08T17:40:33.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:33.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-2 /etc/passwd 2024-05-08T17:40:34.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:34.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-3 /etc/passwd 2024-05-08T17:40:34.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:34.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-4 /etc/passwd 2024-05-08T17:40:34.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:34.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-5 /etc/passwd 2024-05-08T17:40:34.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:34.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-6 /etc/passwd 2024-05-08T17:40:35.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:35.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-7 /etc/passwd 2024-05-08T17:40:35.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:35.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-8 /etc/passwd 2024-05-08T17:40:35.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:35.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-9 /etc/passwd 2024-05-08T17:40:35.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:35.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-10 /etc/passwd 2024-05-08T17:40:35.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:35.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-11 /etc/passwd 2024-05-08T17:40:36.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:36.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-12 /etc/passwd 2024-05-08T17:40:36.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:36.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-13 /etc/passwd 2024-05-08T17:40:36.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:36.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-14 /etc/passwd 2024-05-08T17:40:36.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:36.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-15 /etc/passwd 2024-05-08T17:40:36.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:36.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-16 /etc/passwd 2024-05-08T17:40:37.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:37.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-17 /etc/passwd 2024-05-08T17:40:37.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:37.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-18 /etc/passwd 2024-05-08T17:40:37.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:37.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-19 /etc/passwd 2024-05-08T17:40:37.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:37.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-20 /etc/passwd 2024-05-08T17:40:37.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:37.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-21 /etc/passwd 2024-05-08T17:40:37.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:37.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-22 /etc/passwd 2024-05-08T17:40:38.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:38.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-23 /etc/passwd 2024-05-08T17:40:38.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:38.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-24 /etc/passwd 2024-05-08T17:40:38.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:38.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-25 /etc/passwd 2024-05-08T17:40:38.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:38.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-26 /etc/passwd 2024-05-08T17:40:38.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:38.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-27 /etc/passwd 2024-05-08T17:40:39.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:39.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-28 /etc/passwd 2024-05-08T17:40:39.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:39.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-29 /etc/passwd 2024-05-08T17:40:39.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:39.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-30 /etc/passwd 2024-05-08T17:40:39.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:39.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-31 /etc/passwd 2024-05-08T17:40:39.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:39.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-32 /etc/passwd 2024-05-08T17:40:40.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:40.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-33 /etc/passwd 2024-05-08T17:40:40.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:40.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-34 /etc/passwd 2024-05-08T17:40:40.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:40.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-35 /etc/passwd 2024-05-08T17:40:40.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:40.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-36 /etc/passwd 2024-05-08T17:40:40.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:40.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-37 /etc/passwd 2024-05-08T17:40:40.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:40.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-38 /etc/passwd 2024-05-08T17:40:41.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:41.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-39 /etc/passwd 2024-05-08T17:40:41.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:41.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-40 /etc/passwd 2024-05-08T17:40:41.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:41.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-41 /etc/passwd 2024-05-08T17:40:41.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:41.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-42 /etc/passwd 2024-05-08T17:40:41.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:41.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-43 /etc/passwd 2024-05-08T17:40:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-44 /etc/passwd 2024-05-08T17:40:42.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:42.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-45 /etc/passwd 2024-05-08T17:40:42.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:42.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-46 /etc/passwd 2024-05-08T17:40:42.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:42.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-47 /etc/passwd 2024-05-08T17:40:42.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:42.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-48 /etc/passwd 2024-05-08T17:40:43.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:43.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-49 /etc/passwd 2024-05-08T17:40:43.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:43.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-50 /etc/passwd 2024-05-08T17:40:43.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:43.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-51 /etc/passwd 2024-05-08T17:40:43.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:43.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-52 /etc/passwd 2024-05-08T17:40:43.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:43.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-53 /etc/passwd 2024-05-08T17:40:43.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:43.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-54 /etc/passwd 2024-05-08T17:40:44.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:44.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-55 /etc/passwd 2024-05-08T17:40:44.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:44.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-56 /etc/passwd 2024-05-08T17:40:44.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:44.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-57 /etc/passwd 2024-05-08T17:40:44.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:44.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-58 /etc/passwd 2024-05-08T17:40:44.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:44.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-59 /etc/passwd 2024-05-08T17:40:45.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:45.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-60 /etc/passwd 2024-05-08T17:40:45.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:45.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-61 /etc/passwd 2024-05-08T17:40:45.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:45.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-62 /etc/passwd 2024-05-08T17:40:45.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:45.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-63 /etc/passwd 2024-05-08T17:40:45.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:45.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-64 /etc/passwd 2024-05-08T17:40:45.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:45.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-65 /etc/passwd 2024-05-08T17:40:46.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:46.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-66 /etc/passwd 2024-05-08T17:40:46.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:46.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-67 /etc/passwd 2024-05-08T17:40:46.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:46.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-68 /etc/passwd 2024-05-08T17:40:46.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:46.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-69 /etc/passwd 2024-05-08T17:40:46.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:46.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-70 /etc/passwd 2024-05-08T17:40:47.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:47.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-71 /etc/passwd 2024-05-08T17:40:47.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:47.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-72 /etc/passwd 2024-05-08T17:40:47.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:47.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-73 /etc/passwd 2024-05-08T17:40:47.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:47.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-74 /etc/passwd 2024-05-08T17:40:47.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:47.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-75 /etc/passwd 2024-05-08T17:40:48.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:48.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-76 /etc/passwd 2024-05-08T17:40:48.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:48.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-77 /etc/passwd 2024-05-08T17:40:48.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:48.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-78 /etc/passwd 2024-05-08T17:40:48.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:48.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-79 /etc/passwd 2024-05-08T17:40:48.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:48.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-80 /etc/passwd 2024-05-08T17:40:49.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:49.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-81 /etc/passwd 2024-05-08T17:40:49.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:49.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-82 /etc/passwd 2024-05-08T17:40:49.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:49.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-83 /etc/passwd 2024-05-08T17:40:49.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:49.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-84 /etc/passwd 2024-05-08T17:40:49.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:49.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-85 /etc/passwd 2024-05-08T17:40:49.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:49.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-86 /etc/passwd 2024-05-08T17:40:50.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:50.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-87 /etc/passwd 2024-05-08T17:40:50.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:50.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-88 /etc/passwd 2024-05-08T17:40:50.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:50.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-89 /etc/passwd 2024-05-08T17:40:50.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:50.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-90 /etc/passwd 2024-05-08T17:40:50.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:50.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-91 /etc/passwd 2024-05-08T17:40:51.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:51.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-92 /etc/passwd 2024-05-08T17:40:51.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:51.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-93 /etc/passwd 2024-05-08T17:40:51.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:51.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-94 /etc/passwd 2024-05-08T17:40:51.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:51.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-95 /etc/passwd 2024-05-08T17:40:51.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:51.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-96 /etc/passwd 2024-05-08T17:40:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-97 /etc/passwd 2024-05-08T17:40:52.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:52.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-98 /etc/passwd 2024-05-08T17:40:52.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:52.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-99 /etc/passwd 2024-05-08T17:40:52.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:52.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-100 /etc/passwd 2024-05-08T17:40:52.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:52.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-101 /etc/passwd 2024-05-08T17:40:53.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:53.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-102 /etc/passwd 2024-05-08T17:40:53.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:53.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-103 /etc/passwd 2024-05-08T17:40:53.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:53.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-104 /etc/passwd 2024-05-08T17:40:53.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:53.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-105 /etc/passwd 2024-05-08T17:40:53.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:53.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-106 /etc/passwd 2024-05-08T17:40:54.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:54.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-107 /etc/passwd 2024-05-08T17:40:54.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:54.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-108 /etc/passwd 2024-05-08T17:40:54.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:54.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-109 /etc/passwd 2024-05-08T17:40:54.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:54.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-110 /etc/passwd 2024-05-08T17:40:54.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:54.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-111 /etc/passwd 2024-05-08T17:40:54.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:54.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-112 /etc/passwd 2024-05-08T17:40:55.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:55.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-113 /etc/passwd 2024-05-08T17:40:55.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:55.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-114 /etc/passwd 2024-05-08T17:40:55.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:55.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-115 /etc/passwd 2024-05-08T17:40:55.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:55.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-116 /etc/passwd 2024-05-08T17:40:55.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:55.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-117 /etc/passwd 2024-05-08T17:40:56.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:56.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-118 /etc/passwd 2024-05-08T17:40:56.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:56.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-119 /etc/passwd 2024-05-08T17:40:56.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:56.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-120 /etc/passwd 2024-05-08T17:40:56.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:56.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-121 /etc/passwd 2024-05-08T17:40:56.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:56.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-122 /etc/passwd 2024-05-08T17:40:56.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:56.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-123 /etc/passwd 2024-05-08T17:40:57.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:57.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-124 /etc/passwd 2024-05-08T17:40:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-125 /etc/passwd 2024-05-08T17:40:57.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:57.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-126 /etc/passwd 2024-05-08T17:40:57.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:57.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-127 /etc/passwd 2024-05-08T17:40:57.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:57.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-128 /etc/passwd 2024-05-08T17:40:58.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:58.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-129 /etc/passwd 2024-05-08T17:40:58.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:58.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-130 /etc/passwd 2024-05-08T17:40:58.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:58.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-131 /etc/passwd 2024-05-08T17:40:58.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:58.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-132 /etc/passwd 2024-05-08T17:40:58.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:58.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-133 /etc/passwd 2024-05-08T17:40:59.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:59.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-134 /etc/passwd 2024-05-08T17:40:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-135 /etc/passwd 2024-05-08T17:40:59.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:59.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-136 /etc/passwd 2024-05-08T17:40:59.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:59.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-137 /etc/passwd 2024-05-08T17:40:59.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:40:59.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-138 /etc/passwd 2024-05-08T17:41:00.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:00.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-139 /etc/passwd 2024-05-08T17:41:00.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:00.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-140 /etc/passwd 2024-05-08T17:41:00.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:00.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-141 /etc/passwd 2024-05-08T17:41:00.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:00.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-142 /etc/passwd 2024-05-08T17:41:00.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:00.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-143 /etc/passwd 2024-05-08T17:41:00.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:01.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-144 /etc/passwd 2024-05-08T17:41:01.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:01.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-145 /etc/passwd 2024-05-08T17:41:01.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:01.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-146 /etc/passwd 2024-05-08T17:41:01.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:01.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-147 /etc/passwd 2024-05-08T17:41:01.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:01.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-148 /etc/passwd 2024-05-08T17:41:01.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:01.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-149 /etc/passwd 2024-05-08T17:41:02.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:41:02.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-150 /etc/passwd 2024-05-08T17:41:02.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph pg dump pgs --format=json 2024-05-08T17:41:02.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: jq '.pg_stats[0].up[]' 2024-05-08T17:41:02.673 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:41:02.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph osd out 1 0 2 2024-05-08T17:41:03.228 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2024-05-08T17:41:03.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:69: _common_test: '[' 0 '!=' 0 ']' 2024-05-08T17:41:03.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:75: _common_test: sleep 1 2024-05-08T17:41:04.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:76: _common_test: wait_for_clean 2024-05-08T17:41:04.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:41:04.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:41:04.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:41:04.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:41:04.247 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:41:04.247 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:41:04.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:41:04.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:41:04.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:41:04.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:41:04.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:41:04.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:41:04.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:41:04.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:41:04.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:41:05.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:41:05.041 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:41:05.041 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:41:05.041 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:41:05.041 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T17:41:05.041 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T17:41:05.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:41:05.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:05.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:41:05.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836537 2024-05-08T17:41:05.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836537 2024-05-08T17:41:05.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537' 2024-05-08T17:41:05.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:05.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:41:05.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673003 2024-05-08T17:41:05.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673003 2024-05-08T17:41:05.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673003' 2024-05-08T17:41:05.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:05.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:41:05.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509479 2024-05-08T17:41:05.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509479 2024-05-08T17:41:05.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673003 2-64424509479' 2024-05-08T17:41:05.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:05.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:41:05.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345948 2024-05-08T17:41:05.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345948 2024-05-08T17:41:05.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673003 2-64424509479 3-85899345948' 2024-05-08T17:41:05.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:05.678 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:41:05.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182422 2024-05-08T17:41:05.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182422 2024-05-08T17:41:05.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673003 2-64424509479 3-85899345948 4-107374182422' 2024-05-08T17:41:05.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:05.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T17:41:05.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018897 2024-05-08T17:41:05.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018897 2024-05-08T17:41:05.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673003 2-64424509479 3-85899345948 4-107374182422 5-128849018897' 2024-05-08T17:41:05.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:05.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836537 2024-05-08T17:41:05.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:05.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:41:05.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836537 2024-05-08T17:41:05.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:05.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836537 2024-05-08T17:41:05.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2024-05-08T17:41:05.994 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836537 2024-05-08T17:41:05.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:41:06.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836535 -lt 21474836537 2024-05-08T17:41:06.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:41:07.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:41:07.424 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:41:07.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836537 -lt 21474836537 2024-05-08T17:41:07.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:07.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673003 2024-05-08T17:41:07.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:07.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:41:07.865 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673003 2024-05-08T17:41:07.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:07.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673003 2024-05-08T17:41:07.867 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673003 2024-05-08T17:41:07.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673003' 2024-05-08T17:41:07.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:41:08.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673003 -lt 42949673003 2024-05-08T17:41:08.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:08.389 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509479 2024-05-08T17:41:08.390 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:08.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:41:08.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509479 2024-05-08T17:41:08.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:08.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509479 2024-05-08T17:41:08.394 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509479 2024-05-08T17:41:08.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509479' 2024-05-08T17:41:08.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:41:08.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509479 -lt 64424509479 2024-05-08T17:41:08.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:08.914 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345948 2024-05-08T17:41:08.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:08.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:41:08.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345948 2024-05-08T17:41:08.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:08.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345948 2024-05-08T17:41:08.918 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345948 2024-05-08T17:41:08.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345948' 2024-05-08T17:41:08.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:41:09.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345949 -lt 85899345948 2024-05-08T17:41:09.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:09.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182422 2024-05-08T17:41:09.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:09.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:41:09.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182422 2024-05-08T17:41:09.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:09.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182422 2024-05-08T17:41:09.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182422' 2024-05-08T17:41:09.399 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182422 2024-05-08T17:41:09.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:41:10.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182423 -lt 107374182422 2024-05-08T17:41:10.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:10.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018897 2024-05-08T17:41:10.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:10.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T17:41:10.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018897 2024-05-08T17:41:10.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:10.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018897 2024-05-08T17:41:10.048 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018897 2024-05-08T17:41:10.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018897' 2024-05-08T17:41:10.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T17:41:10.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018898 -lt 128849018897 2024-05-08T17:41:10.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:41:10.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:10.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:11.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T17:41:11.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:11.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:11.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:11.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:11.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:11.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:11.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:11.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:11.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:11.876 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:11.876 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:12.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:12.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T17:41:12.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:41:12.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T17:41:12.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:12.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:12.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:12.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:12.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:12.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:12.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:12.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:12.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:12.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:13.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:13.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:13.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:13.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:13.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:13.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:13.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:13.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:13.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:13.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:13.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:13.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:13.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:14.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=15720 2024-05-08T17:41:14.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 15720 '!=' null 2024-05-08T17:41:14.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:14.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:14.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:14.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:14.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:14.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:14.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:14.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:14.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:14.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:14.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:15.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:15.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:15.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:15.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:15.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:15.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:15.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:15.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:15.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:15.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:15.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:15.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:15.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:16.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=42506 2024-05-08T17:41:16.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 42506 '!=' null 2024-05-08T17:41:16.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:16.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:16.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:16.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:16.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:16.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:16.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:16.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:16.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:16.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:16.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:16.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:16.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:16.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:16.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:17.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:17.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:17.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:17.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:17.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:17.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:17.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:17.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:17.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:18.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=35500 2024-05-08T17:41:18.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 35500 '!=' null 2024-05-08T17:41:18.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:18.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:18.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:18.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:18.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:18.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:18.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:18.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:18.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:18.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:18.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:18.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:18.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:18.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:18.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:19.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:19.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:19.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:19.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:19.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:19.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:19.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:19.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:19.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:20.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=58829 2024-05-08T17:41:20.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 58829 '!=' null 2024-05-08T17:41:20.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:20.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:20.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:20.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:20.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:20.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:20.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:20.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:20.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:20.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:20.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:20.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:20.709 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:20.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:20.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:21.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:21.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:21.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:21.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:21.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:21.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:21.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:21.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:21.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:21.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=47673 2024-05-08T17:41:21.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 47673 '!=' null 2024-05-08T17:41:21.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:21.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:21.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:22.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:22.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:22.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:22.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:22.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:22.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:22.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:22.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:22.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:22.548 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:22.548 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:22.548 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:23.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:23.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:23.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:23.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=47674 2024-05-08T17:41:23.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 47674 '!=' null 2024-05-08T17:41:23.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:23.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:23.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:23.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:23.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:23.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:23.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:23.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:23.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:23.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:23.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:24.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:24.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:24.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:24.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:24.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:24.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:24.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:24.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:24.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:24.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:24.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:24.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:24.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:25.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=71005 2024-05-08T17:41:25.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 71005 '!=' null 2024-05-08T17:41:25.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:25.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:25.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:25.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:25.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:25.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:25.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:25.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:25.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:26.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:26.188 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:26.188 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:26.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:26.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:26.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:26.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:26.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:26.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:26.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:26.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:26.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:26.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=46660 2024-05-08T17:41:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 46660 '!=' null 2024-05-08T17:41:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:27.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:27.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:27.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:27.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:27.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:27.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:27.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:27.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:27.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:28.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:28.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:28.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:28.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:28.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:28.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:29.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=68976 2024-05-08T17:41:29.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 68976 '!=' null 2024-05-08T17:41:29.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:29.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:29.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:29.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:29.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:29.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:29.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:29.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:29.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:29.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:29.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:30.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:30.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:30.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:30.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:30.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:30.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:30.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:30.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:30.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:30.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:30.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:30.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:30.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:31.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=45645 2024-05-08T17:41:31.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 45645 '!=' null 2024-05-08T17:41:31.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:31.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:31.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:31.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:31.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:31.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:31.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:31.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:31.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:31.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:31.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:32.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:32.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:32.029 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:32.029 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:32.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:32.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:32.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:32.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:32.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:32.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:32.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:32.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:32.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:33.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=45644 2024-05-08T17:41:33.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 45644 '!=' null 2024-05-08T17:41:33.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:33.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:33.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:33.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:33.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:33.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:33.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:33.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:33.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:33.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:33.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:33.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:33.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:33.678 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:33.678 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:34.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:34.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:34.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:34.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:34.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:34.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:34.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:34.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:34.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:35.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=67959 2024-05-08T17:41:35.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 67959 '!=' null 2024-05-08T17:41:35.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:35.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:35.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:35.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:35.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:35.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:35.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:35.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:35.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:35.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:35.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:35.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:35.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:35.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:36.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:36.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:36.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:36.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:36.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:36.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:36.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:36.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:36.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:37.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=67959 2024-05-08T17:41:37.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 67959 '!=' null 2024-05-08T17:41:37.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:37.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:37.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:37.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:37.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:37.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:37.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:37.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:37.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:37.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:37.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:37.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:37.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:37.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:37.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:38.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:38.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:38.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:38.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:38.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:38.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:38.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:38.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:38.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:38.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=68972 2024-05-08T17:41:38.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 68972 '!=' null 2024-05-08T17:41:38.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:38.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:38.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:39.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:39.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:39.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:39.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:39.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:39.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:39.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:39.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:39.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:39.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:39.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:39.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:40.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:40.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:40.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:40.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:40.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:40.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:40.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:40.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:40.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:40.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=68972 2024-05-08T17:41:40.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 68972 '!=' null 2024-05-08T17:41:40.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:40.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:40.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:40.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:40.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:40.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:40.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:40.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:40.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:40.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:40.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:41.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:41.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:41.288 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:41.288 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:41.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:41.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:41.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:41.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:41.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:41.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:41.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:41.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:41.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:42.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=69986 2024-05-08T17:41:42.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 69986 '!=' null 2024-05-08T17:41:42.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:42.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:42.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:42.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:42.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:42.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:42.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:42.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:42.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:42.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:42.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:43.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:41:43.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:43.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:43.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:41:43.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:41:44.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=36514 2024-05-08T17:41:44.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 36514 '!=' null 2024-05-08T17:41:44.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:41:44.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:41:44.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:41:44.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:41:44.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:41:44.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:41:44.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:41:44.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:41:44.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:41:44.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:41:44.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:41:44.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:41:44.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:41:44.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:41:44.698 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:41:45.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T17:41:45.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:41:45.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:41:45.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:78: _common_test: flush_pg_stats 2024-05-08T17:41:45.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:41:45.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:41:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:41:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:41:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:41:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:41:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T17:41:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T17:41:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:41:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:45.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:41:45.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836547 2024-05-08T17:41:45.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836547 2024-05-08T17:41:45.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836547' 2024-05-08T17:41:45.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:45.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:41:45.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673013 2024-05-08T17:41:45.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673013 2024-05-08T17:41:45.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836547 1-42949673013' 2024-05-08T17:41:45.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:45.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:41:46.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509489 2024-05-08T17:41:46.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509489 2024-05-08T17:41:46.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836547 1-42949673013 2-64424509489' 2024-05-08T17:41:46.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:46.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:41:46.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345958 2024-05-08T17:41:46.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345958 2024-05-08T17:41:46.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836547 1-42949673013 2-64424509489 3-85899345958' 2024-05-08T17:41:46.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:46.290 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:41:46.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182432 2024-05-08T17:41:46.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182432 2024-05-08T17:41:46.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836547 1-42949673013 2-64424509489 3-85899345958 4-107374182432' 2024-05-08T17:41:46.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:41:46.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T17:41:46.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018908 2024-05-08T17:41:46.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018908 2024-05-08T17:41:46.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836547 1-42949673013 2-64424509489 3-85899345958 4-107374182432 5-128849018908' 2024-05-08T17:41:46.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:46.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836547 2024-05-08T17:41:46.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:46.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:41:46.596 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836547 2024-05-08T17:41:46.596 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:46.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836547 2024-05-08T17:41:46.597 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836547 2024-05-08T17:41:46.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836547' 2024-05-08T17:41:46.597 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:41:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836547 -lt 21474836547 2024-05-08T17:41:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:47.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673013 2024-05-08T17:41:47.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:47.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:41:47.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673013 2024-05-08T17:41:47.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:47.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673013 2024-05-08T17:41:47.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673013' 2024-05-08T17:41:47.086 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673013 2024-05-08T17:41:47.087 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:41:47.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673013 -lt 42949673013 2024-05-08T17:41:47.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:47.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509489 2024-05-08T17:41:47.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:47.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:41:47.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509489 2024-05-08T17:41:47.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:47.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509489 2024-05-08T17:41:47.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509489' 2024-05-08T17:41:47.538 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509489 2024-05-08T17:41:47.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:41:47.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509489 -lt 64424509489 2024-05-08T17:41:47.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:47.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:47.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345958 2024-05-08T17:41:47.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:41:47.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345958 2024-05-08T17:41:47.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:47.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345958 2024-05-08T17:41:47.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345958' 2024-05-08T17:41:47.957 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345958 2024-05-08T17:41:47.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:41:48.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345958 -lt 85899345958 2024-05-08T17:41:48.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:48.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:48.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182432 2024-05-08T17:41:48.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:41:48.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182432 2024-05-08T17:41:48.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:48.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182432 2024-05-08T17:41:48.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182432' 2024-05-08T17:41:48.406 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182432 2024-05-08T17:41:48.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:41:48.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182433 -lt 107374182432 2024-05-08T17:41:48.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:41:48.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018908 2024-05-08T17:41:48.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:41:48.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T17:41:48.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018908 2024-05-08T17:41:48.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:41:48.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018908 2024-05-08T17:41:48.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018908' 2024-05-08T17:41:48.815 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018908 2024-05-08T17:41:48.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T17:41:49.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018908 -lt 128849018908 2024-05-08T17:41:49.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: ceph pg dump pgs --format=json 2024-05-08T17:41:49.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: jq '.pg_stats[0].up_primary' 2024-05-08T17:41:49.607 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:41:49.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: newprimary=4 2024-05-08T17:41:49.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:81: _common_test: kill_daemons 2024-05-08T17:41:49.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:41:49.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:41:49.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:41:49.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:41:49.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:41:54.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:41:54.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:83: _common_test: ERRORS=0 2024-05-08T17:41:54.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2024-05-08T17:41:54.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:54.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T17:41:54.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=4 2024-05-08T17:41:54.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T17:41:54.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2024-05-08T17:41:54.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: tee td/osd-backfill-recovery-log/result.log 2024-05-08T17:41:54.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2024-05-08T17:41:56.326 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:41:56.326 INFO:tasks.workunit.client.0.smithi117.stdout: "pg_log_t": { 2024-05-08T17:41:56.326 INFO:tasks.workunit.client.0.smithi117.stdout: "head": "34'150", 2024-05-08T17:41:56.326 INFO:tasks.workunit.client.0.smithi117.stdout: "tail": "34'148", 2024-05-08T17:41:56.326 INFO:tasks.workunit.client.0.smithi117.stdout: "log": [ 2024-05-08T17:41:56.326 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.326 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:41:56.326 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:e9c179f9:::obj-149:head", 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'149", 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4839.0:1", 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:41:01.948763+0000", 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.327 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:cb39fd60:::obj-150:head", 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'150", 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4842.0:1", 2024-05-08T17:41:56.328 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:41:02.126437+0000", 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:41:56.329 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: "dups": [ 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4395.0:1", 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "33'1", 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "1", 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.330 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4398.0:1", 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'2", 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "2", 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4401.0:1", 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'3", 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "3", 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4404.0:1", 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'4", 2024-05-08T17:41:56.331 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "4", 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4407.0:1", 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'5", 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "5", 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4410.0:1", 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'6", 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "6", 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.332 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4413.0:1", 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'7", 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "7", 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4416.0:1", 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'8", 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "8", 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4419.0:1", 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'9", 2024-05-08T17:41:56.333 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "9", 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4422.0:1", 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'10", 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "10", 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4425.0:1", 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'11", 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "11", 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.334 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4428.0:1", 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'12", 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "12", 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4431.0:1", 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'13", 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "13", 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.335 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4434.0:1", 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'14", 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "14", 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4437.0:1", 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'15", 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "15", 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4440.0:1", 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'16", 2024-05-08T17:41:56.336 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "16", 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4443.0:1", 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'17", 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "17", 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4446.0:1", 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'18", 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "18", 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.337 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4449.0:1", 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'19", 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "19", 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4452.0:1", 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'20", 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "20", 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.338 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4455.0:1", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'21", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "21", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4458.0:1", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'22", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "22", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4461.0:1", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'23", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "23", 2024-05-08T17:41:56.339 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4464.0:1", 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'24", 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "24", 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4467.0:1", 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'25", 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "25", 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.340 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4470.0:1", 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'26", 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "26", 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4473.0:1", 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'27", 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "27", 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4476.0:1", 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'28", 2024-05-08T17:41:56.341 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "28", 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4479.0:1", 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'29", 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "29", 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4482.0:1", 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'30", 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "30", 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.342 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4485.0:1", 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'31", 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "31", 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4488.0:1", 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'32", 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "32", 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4491.0:1", 2024-05-08T17:41:56.343 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'33", 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "33", 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4494.0:1", 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'34", 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "34", 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4497.0:1", 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'35", 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "35", 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.344 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4500.0:1", 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'36", 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "36", 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4503.0:1", 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'37", 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "37", 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.345 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4506.0:1", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'38", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "38", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4509.0:1", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'39", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "39", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4512.0:1", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'40", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "40", 2024-05-08T17:41:56.346 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4515.0:1", 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'41", 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "41", 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4518.0:1", 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'42", 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "42", 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.347 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4521.0:1", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'43", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "43", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4524.0:1", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'44", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "44", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4527.0:1", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'45", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "45", 2024-05-08T17:41:56.348 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4530.0:1", 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'46", 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "46", 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4533.0:1", 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'47", 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "47", 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.349 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4536.0:1", 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'48", 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "48", 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4539.0:1", 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'49", 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "49", 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4542.0:1", 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'50", 2024-05-08T17:41:56.350 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "50", 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4545.0:1", 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'51", 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "51", 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4548.0:1", 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'52", 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "52", 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.351 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4551.0:1", 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'53", 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "53", 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4554.0:1", 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'54", 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "54", 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4557.0:1", 2024-05-08T17:41:56.352 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'55", 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "55", 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4560.0:1", 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'56", 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "56", 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4563.0:1", 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'57", 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "57", 2024-05-08T17:41:56.353 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4566.0:1", 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'58", 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "58", 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4569.0:1", 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'59", 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "59", 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.354 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4572.0:1", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'60", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "60", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4575.0:1", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'61", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "61", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4578.0:1", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'62", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "62", 2024-05-08T17:41:56.355 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4581.0:1", 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'63", 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "63", 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4584.0:1", 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'64", 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "64", 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.356 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4587.0:1", 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'65", 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "65", 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4590.0:1", 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'66", 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "66", 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4593.0:1", 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'67", 2024-05-08T17:41:56.357 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "67", 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4596.0:1", 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'68", 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "68", 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4599.0:1", 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'69", 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "69", 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.358 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4602.0:1", 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'70", 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "70", 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4605.0:1", 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'71", 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "71", 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4608.0:1", 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'72", 2024-05-08T17:41:56.359 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "72", 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4611.0:1", 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'73", 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "73", 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4614.0:1", 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'74", 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "74", 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.360 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4617.0:1", 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'75", 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "75", 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4620.0:1", 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'76", 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "76", 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4623.0:1", 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'77", 2024-05-08T17:41:56.361 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "77", 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4626.0:1", 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'78", 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "78", 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4629.0:1", 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'79", 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "79", 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.362 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4632.0:1", 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'80", 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "80", 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4635.0:1", 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'81", 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "81", 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.363 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4638.0:1", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'82", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "82", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4641.0:1", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'83", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "83", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4644.0:1", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'84", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "84", 2024-05-08T17:41:56.364 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4647.0:1", 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'85", 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "85", 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4650.0:1", 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'86", 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "86", 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.365 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4653.0:1", 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'87", 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "87", 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4656.0:1", 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'88", 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "88", 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4659.0:1", 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'89", 2024-05-08T17:41:56.366 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "89", 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4662.0:1", 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'90", 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "90", 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4665.0:1", 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'91", 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "91", 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.367 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4668.0:1", 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'92", 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "92", 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4671.0:1", 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'93", 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "93", 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.368 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4674.0:1", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'94", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "94", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4677.0:1", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'95", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "95", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4680.0:1", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'96", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "96", 2024-05-08T17:41:56.369 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4683.0:1", 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'97", 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "97", 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4686.0:1", 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'98", 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "98", 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.370 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4689.0:1", 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'99", 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "99", 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4692.0:1", 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'100", 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "100", 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4695.0:1", 2024-05-08T17:41:56.371 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'101", 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "101", 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4698.0:1", 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'102", 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "102", 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4701.0:1", 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'103", 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "103", 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.372 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4704.0:1", 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'104", 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "104", 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4707.0:1", 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'105", 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "105", 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.373 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4710.0:1", 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'106", 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "106", 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4713.0:1", 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'107", 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "107", 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.374 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4716.0:1", 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'108", 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "108", 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4719.0:1", 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'109", 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "109", 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4722.0:1", 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'110", 2024-05-08T17:41:56.375 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "110", 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4725.0:1", 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'111", 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "111", 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4728.0:1", 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'112", 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "112", 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.376 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4731.0:1", 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'113", 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "113", 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4734.0:1", 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'114", 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "114", 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4737.0:1", 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'115", 2024-05-08T17:41:56.377 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "115", 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4740.0:1", 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'116", 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "116", 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4743.0:1", 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'117", 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "117", 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.378 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4746.0:1", 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'118", 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "118", 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4749.0:1", 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'119", 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "119", 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.379 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4752.0:1", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'120", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "120", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4755.0:1", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'121", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "121", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4758.0:1", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'122", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "122", 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.380 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4761.0:1", 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'123", 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "123", 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4764.0:1", 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'124", 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "124", 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.381 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4767.0:1", 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'125", 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "125", 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4770.0:1", 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'126", 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "126", 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4773.0:1", 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'127", 2024-05-08T17:41:56.382 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "127", 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4776.0:1", 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'128", 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "128", 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4779.0:1", 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'129", 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "129", 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.383 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4782.0:1", 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'130", 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "130", 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4785.0:1", 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'131", 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "131", 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4788.0:1", 2024-05-08T17:41:56.384 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'132", 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "132", 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4791.0:1", 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'133", 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "133", 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4794.0:1", 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'134", 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "134", 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.385 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4797.0:1", 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'135", 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "135", 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4800.0:1", 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'136", 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "136", 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.386 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4803.0:1", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'137", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "137", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4806.0:1", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'138", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "138", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4809.0:1", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'139", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "139", 2024-05-08T17:41:56.387 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4812.0:1", 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'140", 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "140", 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4815.0:1", 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'141", 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "141", 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.388 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4818.0:1", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'142", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "142", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4821.0:1", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'143", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "143", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4824.0:1", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'144", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "144", 2024-05-08T17:41:56.389 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4827.0:1", 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'145", 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "145", 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4830.0:1", 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'146", 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "146", 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.390 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4833.0:1", 2024-05-08T17:41:56.391 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'147", 2024-05-08T17:41:56.608 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "147", 2024-05-08T17:41:56.608 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.608 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.608 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:41:56.608 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4836.0:1", 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'148", 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "148", 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: "pg_missing_t": { 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: "missing": [], 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: "may_include_deletes": true 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:41:56.609 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:41:56.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2024-05-08T17:41:56.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: LOGLEN=2 2024-05-08T17:41:56.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:86: _common_test: '[' 2 '!=' 2 ']' 2024-05-08T17:41:56.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2024-05-08T17:41:56.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: DUPSLEN=148 2024-05-08T17:41:56.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:91: _common_test: '[' 148 '!=' 148 ']' 2024-05-08T17:41:56.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:95: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=100 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to copy log version 34'150 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to copy log version 34'149 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 33'1 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'2 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'3 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'4 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'5 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'6 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'7 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'8 2024-05-08T17:41:56.699 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'9 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'10 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'11 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'12 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'13 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'14 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'15 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'16 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'17 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'18 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'19 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'20 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'21 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'22 2024-05-08T17:41:56.700 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'23 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'24 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'25 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'26 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'27 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'28 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'29 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'30 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'31 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'32 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'33 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'34 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'35 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'36 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'37 2024-05-08T17:41:56.701 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'38 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'39 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'40 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'41 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'42 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'43 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'44 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'45 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'46 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'47 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'48 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'49 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'50 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'51 2024-05-08T17:41:56.702 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'52 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'53 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'54 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'55 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'56 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'57 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'58 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'59 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'60 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'61 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'62 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'63 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'64 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'65 2024-05-08T17:41:56.703 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'66 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'67 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'68 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'69 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'70 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'71 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'72 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'73 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'74 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'75 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'76 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'77 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'78 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'79 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'80 2024-05-08T17:41:56.704 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'81 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'82 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'83 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'84 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'85 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'86 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'87 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'88 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'89 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'90 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'91 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'92 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'93 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'94 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'95 2024-05-08T17:41:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'96 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'97 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'98 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'99 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'100 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'101 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'102 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'103 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'104 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'105 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'106 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'107 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'108 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'109 2024-05-08T17:41:56.706 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'110 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'111 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'112 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'113 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'114 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'115 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'116 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'117 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'118 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'119 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'120 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'121 2024-05-08T17:41:56.707 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'122 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'123 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'124 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'125 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'126 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'127 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'128 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'129 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'130 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'131 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'132 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'133 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'134 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'135 2024-05-08T17:41:56.708 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'136 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'137 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'138 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'139 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'140 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'142 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'143 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'144 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'145 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'146 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'147 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'148 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to END max 2 dups.size()=148 other.dups.size()=100 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=100 2024-05-08T17:41:56.709 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to copy log version 34'150 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to copy log version 34'149 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 33'1 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'2 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'3 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'4 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'5 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'6 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'7 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'8 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'9 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'10 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'11 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'12 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'13 2024-05-08T17:41:56.710 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'14 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'15 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'16 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'17 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'18 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'19 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'20 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'21 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'22 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'23 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'24 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'25 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'26 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'27 2024-05-08T17:41:56.711 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'28 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'29 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'30 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'31 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'32 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'33 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'34 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'35 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'36 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'37 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'38 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'39 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'40 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'41 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'42 2024-05-08T17:41:56.712 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'43 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'44 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'45 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'46 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'47 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'48 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'49 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'50 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'51 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'52 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'53 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'54 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'55 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'56 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'57 2024-05-08T17:41:56.713 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'58 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'59 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'60 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'61 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'62 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'63 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'64 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'65 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'66 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'67 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'68 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'69 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'70 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'71 2024-05-08T17:41:56.714 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'72 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'73 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'74 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'75 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'76 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'77 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'78 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'79 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'80 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'81 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'82 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'83 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'84 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'85 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'86 2024-05-08T17:41:56.715 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'87 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'88 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'89 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'90 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'91 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'92 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'93 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'94 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'95 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'96 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'97 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'98 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'99 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'100 2024-05-08T17:41:56.716 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'101 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'102 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'103 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'104 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'105 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'106 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'107 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'108 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'109 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'110 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'111 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'112 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'113 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'114 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'115 2024-05-08T17:41:56.717 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'116 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'117 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'118 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'119 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'120 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'121 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'122 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'123 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'124 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'125 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'126 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'127 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'128 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'129 2024-05-08T17:41:56.718 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'130 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'131 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'132 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'133 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'134 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'135 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'136 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'137 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'138 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'139 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'140 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'142 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'143 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'144 2024-05-08T17:41:56.719 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'145 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'146 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'147 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'148 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to END max 2 dups.size()=148 other.dups.size()=100 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=100 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to copy log version 34'150 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to copy log version 34'149 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 33'1 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'2 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'3 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'4 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'5 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'6 2024-05-08T17:41:56.720 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'7 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'8 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'9 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'10 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'11 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'12 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'13 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'14 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'15 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'16 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'17 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'18 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'19 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'20 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'21 2024-05-08T17:41:56.721 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'22 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'23 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'24 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'25 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'26 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'27 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'28 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'29 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'30 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'31 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'32 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'33 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'34 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'35 2024-05-08T17:41:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'36 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'37 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'38 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'39 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'40 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'41 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'42 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'43 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'44 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'45 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'46 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'47 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'48 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'49 2024-05-08T17:41:56.723 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'50 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'51 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'52 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'53 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'54 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'55 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'56 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'57 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'58 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'59 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'60 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'61 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'62 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'63 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'64 2024-05-08T17:41:56.724 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'65 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'66 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'67 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'68 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'69 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'70 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'71 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'72 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'73 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'74 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'75 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'76 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'77 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'78 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'79 2024-05-08T17:41:56.725 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'80 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'81 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'82 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'83 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'84 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'85 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'86 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'87 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'88 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'89 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'90 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'91 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'92 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'93 2024-05-08T17:41:56.726 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'94 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'95 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'96 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'97 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'98 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'99 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'100 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'101 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'102 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'103 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'104 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'105 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'106 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'107 2024-05-08T17:41:56.727 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'108 2024-05-08T17:41:56.728 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'109 2024-05-08T17:41:56.728 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'110 2024-05-08T17:41:56.729 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'111 2024-05-08T17:41:56.729 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'112 2024-05-08T17:41:56.729 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'113 2024-05-08T17:41:56.729 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'114 2024-05-08T17:41:56.729 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'115 2024-05-08T17:41:56.729 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'116 2024-05-08T17:41:56.729 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'117 2024-05-08T17:41:56.729 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'118 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'119 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'120 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'121 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'122 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'123 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'124 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'125 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'126 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'127 2024-05-08T17:41:56.730 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'128 2024-05-08T17:41:56.731 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'129 2024-05-08T17:41:56.731 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'130 2024-05-08T17:41:56.731 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'131 2024-05-08T17:41:56.731 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'132 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'133 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'134 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'135 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'136 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'137 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'138 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'139 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'140 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'142 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'143 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'144 2024-05-08T17:41:56.732 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'145 2024-05-08T17:41:56.733 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'146 2024-05-08T17:41:56.733 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'147 2024-05-08T17:41:56.733 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'148 2024-05-08T17:41:56.733 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:04.729+0000 7f032621d640 20 copy_up_to END max 2 dups.size()=148 other.dups.size()=100 2024-05-08T17:41:56.733 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_after v 34'150 dups.size()=0 other.dups.size()=100 2024-05-08T17:41:56.733 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 33'1 2024-05-08T17:41:56.734 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'2 2024-05-08T17:41:56.734 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'3 2024-05-08T17:41:56.734 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'4 2024-05-08T17:41:56.734 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'5 2024-05-08T17:41:56.734 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'6 2024-05-08T17:41:56.734 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'7 2024-05-08T17:41:56.735 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'8 2024-05-08T17:41:56.735 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'9 2024-05-08T17:41:56.735 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'10 2024-05-08T17:41:56.735 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'11 2024-05-08T17:41:56.735 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'12 2024-05-08T17:41:56.735 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'13 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'14 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'15 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'16 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'17 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'18 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'19 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'20 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'21 2024-05-08T17:41:56.736 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'22 2024-05-08T17:41:56.737 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'23 2024-05-08T17:41:56.737 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'24 2024-05-08T17:41:56.737 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'25 2024-05-08T17:41:56.737 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'26 2024-05-08T17:41:56.737 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'27 2024-05-08T17:41:56.737 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'28 2024-05-08T17:41:56.737 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'29 2024-05-08T17:41:56.737 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'30 2024-05-08T17:41:56.738 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'31 2024-05-08T17:41:56.738 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'32 2024-05-08T17:41:56.738 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'33 2024-05-08T17:41:56.738 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'34 2024-05-08T17:41:56.738 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'35 2024-05-08T17:41:56.738 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'36 2024-05-08T17:41:56.738 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'37 2024-05-08T17:41:56.738 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'38 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'39 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'40 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'41 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'42 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'43 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'44 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'45 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'46 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'47 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'48 2024-05-08T17:41:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'49 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'50 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'51 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'52 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'53 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'54 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'55 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'56 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'57 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'58 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'59 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'60 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'61 2024-05-08T17:41:56.740 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'62 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'63 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'64 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'65 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'66 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'67 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'68 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'69 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'70 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'71 2024-05-08T17:41:56.741 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'72 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'73 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'74 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'75 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'76 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'77 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'78 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'79 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'80 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'81 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'82 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'83 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'84 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'85 2024-05-08T17:41:56.742 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'86 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'87 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'88 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'89 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'90 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'91 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'92 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'93 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'94 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'95 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'96 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'97 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'98 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'99 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup version 34'100 2024-05-08T17:41:56.743 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'101 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'102 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'103 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'104 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'105 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'106 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'107 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'108 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'109 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'110 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'111 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'112 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'113 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'114 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'115 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'116 2024-05-08T17:41:56.744 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'117 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'118 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'119 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'120 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'121 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'122 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'123 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'124 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'125 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'126 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'127 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'128 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'129 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'130 2024-05-08T17:41:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'131 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'132 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'133 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'134 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'135 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'136 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'137 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'138 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'139 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'140 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:41:56.746 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'142 2024-05-08T17:41:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'143 2024-05-08T17:41:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'144 2024-05-08T17:41:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'145 2024-05-08T17:41:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'146 2024-05-08T17:41:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'147 2024-05-08T17:41:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'148 2024-05-08T17:41:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'149 2024-05-08T17:41:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_up_to/copy_after copy dup from log version 34'150 2024-05-08T17:41:56.748 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:41:39.540+0000 7f032621d640 20 copy_after END v 34'150 dups.size()=150 other.dups.size()=100 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:96: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:97: _common_test: '[' 0 '!=' 0 ']' 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:35: run: teardown td/osd-backfill-recovery-log 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:41:56.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:41:56.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:41:56.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:41:56.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:41:56.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:41:56.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:41:56.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:41:56.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:41:56.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:32: run: for func in $funcs 2024-05-08T17:41:56.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:33: run: setup td/osd-backfill-recovery-log 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-recovery-log 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:41:56.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:41:56.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:41:56.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:41:56.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:41:56.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:41:56.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:41:56.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:41:56.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:41:56.787 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:41:56.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:41:56.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:41:56.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:41:56.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:41:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:41:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:41:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:41:56.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:41:56.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:41:56.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:41:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:41:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:41:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:41:56.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-recovery-log 2024-05-08T17:41:56.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T17:41:56.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:41:56.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:41:56.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.47083 2024-05-08T17:41:56.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T17:41:56.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T17:41:56.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T17:41:56.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2024-05-08T17:41:56.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:34: run: TEST_recovery_1 td/osd-backfill-recovery-log 2024-05-08T17:41:56.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:122: TEST_recovery_1: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:56.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:124: TEST_recovery_1: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 40 0 40 2024-05-08T17:41:56.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:41: _common_test: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:56.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:42: _common_test: local 'extra_opts=--osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:41:56.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:43: _common_test: local loglen=40 2024-05-08T17:41:56.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:44: _common_test: local dupslen=0 2024-05-08T17:41:56.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:45: _common_test: local objects=40 2024-05-08T17:41:56.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:46: _common_test: local moreobjects=0 2024-05-08T17:41:56.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:48: _common_test: local OSDS=6 2024-05-08T17:41:56.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:50: _common_test: run_mon td/osd-backfill-recovery-log a 2024-05-08T17:41:56.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:56.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T17:41:56.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T17:41:56.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T17:41:56.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-recovery-log/a 2024-05-08T17:41:56.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2024-05-08T17:41:57.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T17:41:57.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:41:57.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:41:57.215 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:41:57.215 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:41:57.215 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:41:57.215 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:41:57.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T17:41:57.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T17:41:57.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T17:41:57.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:41:57.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:41:57.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T17:41:57.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T17:41:57.459 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:41:57.459 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:41:57.459 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:41:57.460 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:41:57.460 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:41:57.460 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:41:57.460 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.47083/ceph-mon.a.asok 2024-05-08T17:41:57.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:41:57.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.47083/ceph-mon.a.asok config get fsid 2024-05-08T17:41:57.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T17:41:57.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:41:57.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:41:57.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T17:41:57.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T17:41:57.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:41:57.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:41:57.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:41:57.579 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:41:57.579 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:41:57.579 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:41:57.579 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.47083/ceph-mon.a.asok 2024-05-08T17:41:57.579 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:41:57.579 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.47083/ceph-mon.a.asok config get mon_host 2024-05-08T17:41:57.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:51: _common_test: run_mgr td/osd-backfill-recovery-log x 2024-05-08T17:41:57.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:57.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T17:41:57.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T17:41:57.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T17:41:57.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-recovery-log/x 2024-05-08T17:41:57.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T17:41:58.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T17:41:58.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:41:58.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:41:58.589 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:41:58.589 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:41:58.589 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:41:58.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:41:58.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:41:58.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:41:58.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:52: _common_test: export CEPH_ARGS 2024-05-08T17:41:58.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:41:58.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:41:58.628 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: expr 6 - 1 2024-05-08T17:41:58.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: seq 0 5 2024-05-08T17:41:58.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:41:58.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 0 2024-05-08T17:41:58.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:41:58.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:41:58.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T17:41:58.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:41:58.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2024-05-08T17:41:58.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:41:58.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:41:58.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=27f05c90-6dca-4ed0-a6cd-1b610219ffde 2024-05-08T17:41:58.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 27f05c90-6dca-4ed0-a6cd-1b610219ffde' 2024-05-08T17:41:58.638 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 27f05c90-6dca-4ed0-a6cd-1b610219ffde 2024-05-08T17:41:58.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:41:58.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBmuTtmo+JbJxAAqVXDLKJdm4+RTkbAjIk2dw== 2024-05-08T17:41:58.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBmuTtmo+JbJxAAqVXDLKJdm4+RTkbAjIk2dw=="}' 2024-05-08T17:41:58.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 27f05c90-6dca-4ed0-a6cd-1b610219ffde -i td/osd-backfill-recovery-log/0/new.json 2024-05-08T17:41:58.983 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:41:58.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2024-05-08T17:41:58.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBmuTtmo+JbJxAAqVXDLKJdm4+RTkbAjIk2dw== --osd-uuid 27f05c90-6dca-4ed0-a6cd-1b610219ffde 2024-05-08T17:41:59.038 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:41:59.040+0000 7fca94bcd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:41:59.055 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:41:59.060+0000 7fca94bcd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:41:59.056 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:41:59.060+0000 7fca94bcd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:41:59.057 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:41:59.060+0000 7fca94bcd7c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:41:59.058 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:41:59.060+0000 7fca94bcd7c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:41:59.058 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:41:59.060+0000 7fca94bcd7c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:41:59.095 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:41:59.100+0000 7fca94bcd7c0 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2024-05-08T17:42:05.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2024-05-08T17:42:05.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:42:05.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T17:42:05.650 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T17:42:05.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:42:06.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T17:42:06.188 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:42:06.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:42:06.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:42:06.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:42:06.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:42:06.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:06.228+0000 7fa53e8e87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:06.270 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:06.272+0000 7fa53e8e87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:06.272 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:06.276+0000 7fa53e8e87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:06.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T17:42:06.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:42:06.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:42:06.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:42:06.596 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:42:06.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:42:06.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:06.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:42:06.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:06.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:06.857 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:06.860+0000 7fa53e8e87c0 -1 Falling back to public interface 2024-05-08T17:42:07.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:08.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:08.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:08.041 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:42:08.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:42:08.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:08.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:08.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:09.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:09.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:09.443 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:42:09.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:42:09.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:09.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:09.525 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:09.528+0000 7fa53e8e87c0 -1 osd.0 0 log_to_monitors true 2024-05-08T17:42:10.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:11.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:11.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:11.043 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:42:11.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:42:11.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:11.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:11.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:12.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:12.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:12.546 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:42:12.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:42:12.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:12.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:13.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:14.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:14.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:14.005 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:42:14.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:42:14.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:14.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:14.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:15.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:15.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:15.529 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:42:15.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:42:15.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:15.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:15.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:16.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:16.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:16.957 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:42:16.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:42:16.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:16.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:17.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:18.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:18.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:18.545 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:42:18.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:42:18.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:18.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:18.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:19.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:19.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:19.994 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:42:19.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:42:19.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:19.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:20.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:21.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:21.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:21.554 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:42:21.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:42:21.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:21.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:21.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:23.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:23.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:23.001 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:42:23.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:42:23.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:23.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:24.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:25.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:25.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:25.079 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:42:25.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:42:25.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:25.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:25.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:26.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:26.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:26.973 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:42:26.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:42:26.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:26.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:28.884 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:42:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:42:28.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:28.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:29.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:30.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:30.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:30.666 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:42:30.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:42:30.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:30.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:31.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:32.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:32.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:32.477 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:42:32.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:42:32.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:32.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:33.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:34.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:34.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:34.172 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:42:34.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:42:34.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:34.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:34.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:35.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:35.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:35.629 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:42:35.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:42:35.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:35.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:42:36.047 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3299773930,v1:127.0.0.1:6803/3299773930] [v2:127.0.0.1:6804/3299773930,v1:127.0.0.1:6805/3299773930] exists,up 27f05c90-6dca-4ed0-a6cd-1b610219ffde 2024-05-08T17:42:36.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:42:36.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:42:36.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 1 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:42:36.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:42:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:42:36.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:42:36.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:42:36.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:42:36.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:42:36.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:42:36.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:42:36.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2024-05-08T17:42:36.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:42:36.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=78143d11-cf79-4f26-8ff1-ec9fc57fd91e 2024-05-08T17:42:36.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 78143d11-cf79-4f26-8ff1-ec9fc57fd91e' 2024-05-08T17:42:36.055 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 78143d11-cf79-4f26-8ff1-ec9fc57fd91e 2024-05-08T17:42:36.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:42:36.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCMuTtmuuEFBRAA9TtTKiFKrXb0qzbiAIqFJA== 2024-05-08T17:42:36.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCMuTtmuuEFBRAA9TtTKiFKrXb0qzbiAIqFJA=="}' 2024-05-08T17:42:36.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 78143d11-cf79-4f26-8ff1-ec9fc57fd91e -i td/osd-backfill-recovery-log/1/new.json 2024-05-08T17:42:36.608 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:42:36.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2024-05-08T17:42:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCMuTtmuuEFBRAA9TtTKiFKrXb0qzbiAIqFJA== --osd-uuid 78143d11-cf79-4f26-8ff1-ec9fc57fd91e 2024-05-08T17:42:36.657 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:36.659+0000 7f88a2bcf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:36.700 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:36.703+0000 7f88a2bcf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:36.701 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:36.703+0000 7f88a2bcf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:36.702 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:36.703+0000 7f88a2bcf7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:42:36.702 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:36.703+0000 7f88a2bcf7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:42:36.702 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:36.703+0000 7f88a2bcf7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:42:36.746 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:36.747+0000 7f88a2bcf7c0 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2024-05-08T17:42:43.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2024-05-08T17:42:43.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:42:43.658 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T17:42:43.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T17:42:43.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:42:44.216 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T17:42:44.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T17:42:44.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:42:44.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:42:44.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:42:44.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:42:44.253 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:44.255+0000 7f58103187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:44.277 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:44.279+0000 7f58103187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:44.279 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:44.283+0000 7f58103187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:42:44.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T17:42:44.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:42:44.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T17:42:44.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:42:44.638 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:42:44.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:42:44.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:44.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:42:44.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:44.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:44.837 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:44.839+0000 7f58103187c0 -1 Falling back to public interface 2024-05-08T17:42:45.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:46.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:46.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:46.060 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:42:46.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:42:46.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:46.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:46.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:47.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:47.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:47.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:42:47.467 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:42:47.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:47.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:47.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:42:47.483+0000 7f58103187c0 -1 osd.1 0 log_to_monitors true 2024-05-08T17:42:47.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:48.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:48.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:48.899 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:42:48.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:42:48.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:48.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:49.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:50.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:50.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:50.486 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:42:50.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:42:50.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:50.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:50.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:51.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:51.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:51.955 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:42:51.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:42:51.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:51.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:52.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:53.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:53.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:53.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:42:53.534 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:42:53.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:53.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:54.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:55.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:55.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:55.053 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:42:55.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:42:55.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:55.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:55.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:56.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:56.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:56.610 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:42:56.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:42:56.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:56.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:57.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:58.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:58.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:58.045 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:42:58.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:42:58.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:58.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:42:58.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:42:59.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:42:59.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:42:59.583 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:42:59.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:42:59.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:42:59.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:00.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:01.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:01.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:01.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:43:01.094 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:43:01.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:01.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:01.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:02.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:02.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:02.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:43:02.736 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:43:02.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:02.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:03.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:04.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:04.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:04.242 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:43:04.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:43:04.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:04.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:05.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:06.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:06.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:06.075 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:43:06.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:43:06.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:06.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:07.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:08.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:08.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:08.251 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:43:08.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:43:08.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:08.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:10.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:10.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:10.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:43:10.181 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:43:10.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:10.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:10.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:11.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:11.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:11.952 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:43:11.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:43:11.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:11.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:12.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:13.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:13.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:13.603 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:43:13.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:43:13.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:13.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:14.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:15.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:15.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:15.173 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T17:43:15.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T17:43:15.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:15.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:43:15.587 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1611874598,v1:127.0.0.1:6811/1611874598] [v2:127.0.0.1:6812/1611874598,v1:127.0.0.1:6813/1611874598] exists,up 78143d11-cf79-4f26-8ff1-ec9fc57fd91e 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 2 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:43:15.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:43:15.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:43:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:43:15.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:43:15.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:43:15.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:43:15.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:43:15.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:43:15.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2024-05-08T17:43:15.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:43:15.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=eda3ca60-2ebb-440f-809e-2e57d3a2025f 2024-05-08T17:43:15.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 eda3ca60-2ebb-440f-809e-2e57d3a2025f' 2024-05-08T17:43:15.594 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 eda3ca60-2ebb-440f-809e-2e57d3a2025f 2024-05-08T17:43:15.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:43:15.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCzuTtmKsPlJBAAiRLbBTZP27lTWY1SGlmwDg== 2024-05-08T17:43:15.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCzuTtmKsPlJBAAiRLbBTZP27lTWY1SGlmwDg=="}' 2024-05-08T17:43:15.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new eda3ca60-2ebb-440f-809e-2e57d3a2025f -i td/osd-backfill-recovery-log/2/new.json 2024-05-08T17:43:16.102 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:43:16.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2024-05-08T17:43:16.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCzuTtmKsPlJBAAiRLbBTZP27lTWY1SGlmwDg== --osd-uuid eda3ca60-2ebb-440f-809e-2e57d3a2025f 2024-05-08T17:43:16.161 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:16.163+0000 7f5f3bd137c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:16.171 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:16.175+0000 7f5f3bd137c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:16.173 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:16.175+0000 7f5f3bd137c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:16.173 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:16.175+0000 7f5f3bd137c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:43:16.173 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:16.175+0000 7f5f3bd137c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:43:16.173 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:16.175+0000 7f5f3bd137c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:43:16.203 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:16.207+0000 7f5f3bd137c0 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2024-05-08T17:43:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2024-05-08T17:43:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:43:23.212 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T17:43:23.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T17:43:23.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:43:23.770 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T17:43:23.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T17:43:23.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:43:23.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:43:23.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:43:23.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:43:23.807 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:23.810+0000 7f51f4fed7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:23.834 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:23.834+0000 7f51f4fed7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:23.835 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:23.838+0000 7f51f4fed7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:24.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T17:43:24.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:43:24.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T17:43:24.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:43:24.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:43:24.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:24.185 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:43:24.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:43:24.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:24.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:24.397 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:24.398+0000 7f51f4fed7c0 -1 Falling back to public interface 2024-05-08T17:43:24.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:25.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:25.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:25.602 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:43:25.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:43:25.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:25.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:26.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:27.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:27.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:27.005 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:43:27.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:43:27.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:27.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:27.012 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:27.014+0000 7f51f4fed7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T17:43:27.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:28.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:28.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:28.418 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:43:28.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:43:28.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:28.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:29.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:30.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:30.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:30.004 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:43:30.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:43:30.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:30.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:30.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:31.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:31.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:31.438 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:43:31.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:43:31.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:31.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:32.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:33.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:33.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:33.006 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:43:33.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:43:33.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:33.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:33.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:34.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:34.475 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:43:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:43:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:34.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:35.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:36.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:36.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:36.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:43:36.028 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:43:36.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:36.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:36.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:37.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:37.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:37.459 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:43:37.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:43:37.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:37.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:38.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:39.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:39.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:39.002 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:43:39.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:43:39.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:39.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:39.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:40.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:40.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:40.516 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:43:40.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:43:40.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:40.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:41.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:42.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:42.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:42.264 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:43:42.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:43:42.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:42.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:42.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:43.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:43.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:43.982 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:43:43.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:43:43.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:43.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:44.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:45.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:45.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:45.835 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:43:45.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:43:45.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:45.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:46.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:47.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:47.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:47.762 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:43:47.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:43:47.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:47.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:49.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:49.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:49.527 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:43:49.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:43:49.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:49.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:50.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:51.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:51.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:51.200 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:43:51.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:43:51.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:51.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:52.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:43:53.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:43:53.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:43:53.359 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:43:53.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:43:53.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:43:53.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:43:53.808 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/230249133,v1:127.0.0.1:6819/230249133] [v2:127.0.0.1:6820/230249133,v1:127.0.0.1:6821/230249133] exists,up eda3ca60-2ebb-440f-809e-2e57d3a2025f 2024-05-08T17:43:53.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:43:53.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:43:53.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 3 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2024-05-08T17:43:53.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:43:53.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:43:53.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:43:53.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:43:53.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:43:53.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2024-05-08T17:43:53.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:43:53.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ac08176b-1e63-4d93-848a-b72d3ebba64d 2024-05-08T17:43:53.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 ac08176b-1e63-4d93-848a-b72d3ebba64d' 2024-05-08T17:43:53.815 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 ac08176b-1e63-4d93-848a-b72d3ebba64d 2024-05-08T17:43:53.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:43:53.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDZuTtmjcgEMhAABFXYs14pVKTBGfgqtQchkg== 2024-05-08T17:43:53.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDZuTtmjcgEMhAABFXYs14pVKTBGfgqtQchkg=="}' 2024-05-08T17:43:53.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ac08176b-1e63-4d93-848a-b72d3ebba64d -i td/osd-backfill-recovery-log/3/new.json 2024-05-08T17:43:54.305 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:43:54.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2024-05-08T17:43:54.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDZuTtmjcgEMhAABFXYs14pVKTBGfgqtQchkg== --osd-uuid ac08176b-1e63-4d93-848a-b72d3ebba64d 2024-05-08T17:43:54.360 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:54.366+0000 7f12029e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:54.374 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:54.378+0000 7f12029e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:54.375 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:54.382+0000 7f12029e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:43:54.375 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:54.382+0000 7f12029e07c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:43:54.375 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:54.382+0000 7f12029e07c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:43:54.375 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:54.382+0000 7f12029e07c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:43:54.414 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:43:54.418+0000 7f12029e07c0 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2024-05-08T17:44:01.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2024-05-08T17:44:01.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:44:01.296 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T17:44:01.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T17:44:01.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:44:01.860 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T17:44:01.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T17:44:01.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:44:01.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:44:01.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:44:01.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:44:01.897 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:01.901+0000 7f00794c07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:01.899 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:01.905+0000 7f00794c07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:01.900 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:01.905+0000 7f00794c07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:02.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T17:44:02.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:44:02.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T17:44:02.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:44:02.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:44:02.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:02.287 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:44:02.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:44:02.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:02.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:02.452 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:02.457+0000 7f00794c07c0 -1 Falling back to public interface 2024-05-08T17:44:02.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:03.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:03.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:03.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:44:03.717 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:44:03.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:03.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:04.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:05.136 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:05.141+0000 7f00794c07c0 -1 osd.3 0 log_to_monitors true 2024-05-08T17:44:05.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:05.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:05.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:44:05.158 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:44:05.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:05.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:05.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:06.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:06.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:06.918 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:44:06.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:44:06.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:06.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:07.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:08.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:08.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:08.474 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:44:08.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:44:08.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:08.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:09.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:10.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:10.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:10.061 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:44:10.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:44:10.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:10.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:10.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:11.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:11.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:11.690 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:44:11.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:44:11.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:11.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:12.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:13.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:13.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:13.123 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:44:13.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:44:13.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:13.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:13.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:14.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:14.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:14.612 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:44:14.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:44:14.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:14.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:15.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:16.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:16.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:16.066 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:44:16.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:44:16.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:16.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:16.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:17.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:17.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:17.629 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:44:17.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:44:17.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:17.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:18.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:19.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:19.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:19.137 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:44:19.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:44:19.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:19.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:19.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:20.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:20.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:20.744 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:44:20.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:44:20.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:20.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:21.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:22.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:22.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:22.380 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:44:22.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:44:22.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:22.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:23.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:24.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:24.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:24.264 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:44:24.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:44:24.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:24.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:25.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:26.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:26.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:26.409 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:44:26.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:44:26.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:26.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:27.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:28.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:28.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:28.256 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:44:28.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:44:28.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:28.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:29.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:30.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:30.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:30.012 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:44:30.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:44:30.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:30.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:30.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:31.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:31.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:31.956 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:44:31.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:44:31.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:31.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:44:32.368 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2197178960,v1:127.0.0.1:6827/2197178960] [v2:127.0.0.1:6828/2197178960,v1:127.0.0.1:6829/2197178960] exists,up ac08176b-1e63-4d93-848a-b72d3ebba64d 2024-05-08T17:44:32.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:44:32.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:44:32.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:44:32.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:44:32.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 4 2024-05-08T17:44:32.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:44:32.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:44:32.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T17:44:32.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:44:32.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2024-05-08T17:44:32.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:44:32.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:44:32.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:44:32.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:44:32.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2024-05-08T17:44:32.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2024-05-08T17:44:32.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:44:32.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=56e232f5-66c0-4b62-a156-33f637f8d075 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 56e232f5-66c0-4b62-a156-33f637f8d075' 2024-05-08T17:44:32.377 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 56e232f5-66c0-4b62-a156-33f637f8d075 2024-05-08T17:44:32.378 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:44:32.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAAujtmtD3DFxAAabtBUN2D9rhlN4tKKKMDzA== 2024-05-08T17:44:32.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAAujtmtD3DFxAAabtBUN2D9rhlN4tKKKMDzA=="}' 2024-05-08T17:44:32.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 56e232f5-66c0-4b62-a156-33f637f8d075 -i td/osd-backfill-recovery-log/4/new.json 2024-05-08T17:44:32.928 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:44:32.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2024-05-08T17:44:32.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAAujtmtD3DFxAAabtBUN2D9rhlN4tKKKMDzA== --osd-uuid 56e232f5-66c0-4b62-a156-33f637f8d075 2024-05-08T17:44:32.983 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:32.988+0000 7fe93b6ac7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:32.985 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:32.988+0000 7fe93b6ac7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:32.986 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:32.988+0000 7fe93b6ac7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:32.987 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:32.992+0000 7fe93b6ac7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:44:32.987 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:32.992+0000 7fe93b6ac7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:44:32.987 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:32.992+0000 7fe93b6ac7c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:44:33.082 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:33.088+0000 7fe93b6ac7c0 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2024-05-08T17:44:40.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2024-05-08T17:44:40.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:44:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T17:44:40.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T17:44:40.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:44:40.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T17:44:40.658 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T17:44:40.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:44:40.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:44:40.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:44:40.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:44:40.689 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:40.692+0000 7f3eacc167c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:40.691 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:40.696+0000 7f3eacc167c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:40.692 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:40.696+0000 7f3eacc167c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:44:41.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T17:44:41.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:44:41.102 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:44:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T17:44:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:44:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:44:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:44:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:41.245 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:41.248+0000 7f3eacc167c0 -1 Falling back to public interface 2024-05-08T17:44:41.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:42.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:42.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:42.569 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:44:42.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:44:42.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:42.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:42.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:43.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:43.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:43.972 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:44:43.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:44:43.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:43.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:44.025 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:44:44.028+0000 7f3eacc167c0 -1 osd.4 0 log_to_monitors true 2024-05-08T17:44:44.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:45.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:45.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:45.430 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:44:45.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:44:45.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:45.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:46.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:47.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:47.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:47.009 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:44:47.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:44:47.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:47.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:47.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:48.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:48.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:48.465 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:44:48.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:44:48.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:48.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:48.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:49.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:49.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:49.955 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:44:49.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:44:49.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:49.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:50.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:51.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:51.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:51.433 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:44:51.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:44:51.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:51.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:51.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:52.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:52.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:52.988 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:44:52.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:44:52.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:52.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:53.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:54.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:54.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:54.469 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:44:54.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:44:54.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:54.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:55.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:56.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:56.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:56.007 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:44:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:44:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:56.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:57.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:57.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:57.573 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:44:57.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:44:57.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:57.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:44:58.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:44:59.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:44:59.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:44:59.141 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:44:59.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:44:59.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:44:59.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:45:00.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:01.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:01.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:01.264 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:45:01.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:45:01.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:01.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:45:01.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:02.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:02.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:02.852 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:45:02.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:45:02.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:02.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:45:03.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:04.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:04.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:04.697 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:45:04.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:45:04.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:04.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:45:05.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:06.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:06.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:06.886 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:45:06.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:45:06.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:06.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:45:07.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:08.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:08.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:08.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:45:08.818 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:45:08.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:08.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:45:09.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:10.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:10.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:45:10.695 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:45:10.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:10.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:45:11.304 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/38634504,v1:127.0.0.1:6835/38634504] [v2:127.0.0.1:6836/38634504,v1:127.0.0.1:6837/38634504] exists,up 56e232f5-66c0-4b62-a156-33f637f8d075 2024-05-08T17:45:11.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 5 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:45:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:45:11.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:45:11.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:45:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=35dd3a14-c08d-4d4c-bedb-d6eaa9bfc38e 2024-05-08T17:45:11.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 35dd3a14-c08d-4d4c-bedb-d6eaa9bfc38e' 2024-05-08T17:45:11.310 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 35dd3a14-c08d-4d4c-bedb-d6eaa9bfc38e 2024-05-08T17:45:11.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:45:11.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAnujtm6FMtFBAAZtT3oOKKEmhvSp95iWqu/A== 2024-05-08T17:45:11.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAnujtm6FMtFBAAZtT3oOKKEmhvSp95iWqu/A=="}' 2024-05-08T17:45:11.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 35dd3a14-c08d-4d4c-bedb-d6eaa9bfc38e -i td/osd-backfill-recovery-log/5/new.json 2024-05-08T17:45:11.848 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:45:11.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2024-05-08T17:45:11.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAnujtm6FMtFBAAZtT3oOKKEmhvSp95iWqu/A== --osd-uuid 35dd3a14-c08d-4d4c-bedb-d6eaa9bfc38e 2024-05-08T17:45:11.897 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:11.899+0000 7f38c052e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:45:11.940 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:11.943+0000 7f38c052e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:45:11.942 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:11.943+0000 7f38c052e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:45:11.942 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:11.943+0000 7f38c052e7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:45:11.943 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:11.943+0000 7f38c052e7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:45:11.943 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:11.943+0000 7f38c052e7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:45:11.979 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:11.979+0000 7f38c052e7c0 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2024-05-08T17:45:18.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2024-05-08T17:45:18.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:45:18.777 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T17:45:18.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T17:45:18.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:45:19.353 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T17:45:19.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T17:45:19.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:45:19.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:45:19.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:45:19.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:45:19.393 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:19.395+0000 7f00c10217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:45:19.395 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:19.399+0000 7f00c10217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:45:19.397 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:19.399+0000 7f00c10217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:45:19.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T17:45:19.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:45:19.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T17:45:19.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:45:19.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:45:19.768 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:45:19.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:19.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:45:19.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:19.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:19.981 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:19.983+0000 7f00c10217c0 -1 Falling back to public interface 2024-05-08T17:45:20.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:21.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:21.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:21.199 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:45:21.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:45:21.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:21.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:21.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:22.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:22.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:22.605 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:45:22.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:45:22.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:22.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:22.647 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:45:22.647+0000 7f00c10217c0 -1 osd.5 0 log_to_monitors true 2024-05-08T17:45:23.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:24.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:24.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:24.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:45:24.212 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:45:24.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:24.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:24.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:25.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:25.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:25.734 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:45:25.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:45:25.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:25.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:26.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:27.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:27.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:27.274 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:45:27.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:45:27.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:27.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:27.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:28.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:28.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:28.877 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:45:28.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:45:28.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:28.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:29.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:30.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:30.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:30.316 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:45:30.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:45:30.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:30.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:30.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:31.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:31.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:31.841 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:45:31.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:45:31.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:31.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:32.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:33.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:33.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:33.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:45:33.401 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:45:33.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:33.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:34.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:35.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:35.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:35.078 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:45:35.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:45:35.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:35.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:35.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:36.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:36.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:36.646 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:45:36.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:45:36.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:36.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:37.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:38.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:38.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:38.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:45:38.122 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:45:38.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:38.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:38.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:39.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:39.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:39.614 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:45:39.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:45:39.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:39.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:40.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:41.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:41.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:41.221 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:45:41.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:45:41.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:41.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:41.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:42.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:42.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:42.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:45:42.799 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:45:42.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:42.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:43.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:44.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:44.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:44.557 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:45:44.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:45:44.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:44.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:45.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:46.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:46.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:46.325 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:45:46.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:45:46.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:46.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:47.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:48.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:48.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:48.121 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:45:48.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:45:48.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:48.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:48.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:45:49.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:45:49.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:45:49.905 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T17:45:49.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T17:45:49.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:45:49.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:45:50.431 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2219911955,v1:127.0.0.1:6843/2219911955] [v2:127.0.0.1:6844/2219911955,v1:127.0.0.1:6845/2219911955] exists,up 35dd3a14-c08d-4d4c-bedb-d6eaa9bfc38e 2024-05-08T17:45:50.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:45:50.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:45:50.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:45:50.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:60: _common_test: create_pool test 1 1 2024-05-08T17:45:50.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T17:45:50.958 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T17:45:50.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:45:51.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: seq 1 40 2024-05-08T17:45:51.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:51.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-1 /etc/passwd 2024-05-08T17:45:52.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:52.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-2 /etc/passwd 2024-05-08T17:45:53.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:53.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-3 /etc/passwd 2024-05-08T17:45:53.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:53.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-4 /etc/passwd 2024-05-08T17:45:53.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:53.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-5 /etc/passwd 2024-05-08T17:45:53.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:53.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-6 /etc/passwd 2024-05-08T17:45:54.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:54.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-7 /etc/passwd 2024-05-08T17:45:54.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:54.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-8 /etc/passwd 2024-05-08T17:45:54.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:54.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-9 /etc/passwd 2024-05-08T17:45:54.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:54.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-10 /etc/passwd 2024-05-08T17:45:54.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:54.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-11 /etc/passwd 2024-05-08T17:45:54.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:54.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-12 /etc/passwd 2024-05-08T17:45:55.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:55.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-13 /etc/passwd 2024-05-08T17:45:55.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:55.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-14 /etc/passwd 2024-05-08T17:45:55.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:55.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-15 /etc/passwd 2024-05-08T17:45:55.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:55.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-16 /etc/passwd 2024-05-08T17:45:55.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:55.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-17 /etc/passwd 2024-05-08T17:45:56.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:56.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-18 /etc/passwd 2024-05-08T17:45:56.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:56.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-19 /etc/passwd 2024-05-08T17:45:56.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:56.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-20 /etc/passwd 2024-05-08T17:45:56.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:56.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-21 /etc/passwd 2024-05-08T17:45:56.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:56.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-22 /etc/passwd 2024-05-08T17:45:56.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:56.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-23 /etc/passwd 2024-05-08T17:45:57.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:57.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-24 /etc/passwd 2024-05-08T17:45:57.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:57.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-25 /etc/passwd 2024-05-08T17:45:57.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:57.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-26 /etc/passwd 2024-05-08T17:45:57.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:57.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-27 /etc/passwd 2024-05-08T17:45:57.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:57.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-28 /etc/passwd 2024-05-08T17:45:58.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:58.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-29 /etc/passwd 2024-05-08T17:45:58.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:58.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-30 /etc/passwd 2024-05-08T17:45:58.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:58.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-31 /etc/passwd 2024-05-08T17:45:58.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:58.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-32 /etc/passwd 2024-05-08T17:45:58.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:58.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-33 /etc/passwd 2024-05-08T17:45:59.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:59.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-34 /etc/passwd 2024-05-08T17:45:59.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:59.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-35 /etc/passwd 2024-05-08T17:45:59.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:59.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-36 /etc/passwd 2024-05-08T17:45:59.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:59.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-37 /etc/passwd 2024-05-08T17:45:59.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:45:59.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-38 /etc/passwd 2024-05-08T17:46:00.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:46:00.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-39 /etc/passwd 2024-05-08T17:46:00.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:46:00.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-40 /etc/passwd 2024-05-08T17:46:00.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph pg dump pgs --format=json 2024-05-08T17:46:00.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: jq '.pg_stats[0].up[]' 2024-05-08T17:46:00.854 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:46:00.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph osd out 1 0 2 2024-05-08T17:46:01.411 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2024-05-08T17:46:01.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:69: _common_test: '[' 0 '!=' 0 ']' 2024-05-08T17:46:01.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:75: _common_test: sleep 1 2024-05-08T17:46:02.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:76: _common_test: wait_for_clean 2024-05-08T17:46:02.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:46:02.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:46:02.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:46:02.430 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:46:02.431 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:46:02.432 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:46:02.432 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:46:02.432 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:46:02.432 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:46:02.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:46:02.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:46:02.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:46:02.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:46:02.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:46:02.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:03.024 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:46:03.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836535 2024-05-08T17:46:03.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836535 2024-05-08T17:46:03.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535' 2024-05-08T17:46:03.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:03.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:46:03.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673003 2024-05-08T17:46:03.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673003 2024-05-08T17:46:03.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673003' 2024-05-08T17:46:03.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:03.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:46:03.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509471 2024-05-08T17:46:03.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509471 2024-05-08T17:46:03.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673003 2-64424509471' 2024-05-08T17:46:03.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:03.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:46:03.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345947 2024-05-08T17:46:03.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345947 2024-05-08T17:46:03.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673003 2-64424509471 3-85899345947' 2024-05-08T17:46:03.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:03.989 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:46:04.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182416 2024-05-08T17:46:04.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182416 2024-05-08T17:46:04.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673003 2-64424509471 3-85899345947 4-107374182416' 2024-05-08T17:46:04.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:04.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T17:46:04.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018892 2024-05-08T17:46:04.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018892 2024-05-08T17:46:04.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836535 1-42949673003 2-64424509471 3-85899345947 4-107374182416 5-128849018892' 2024-05-08T17:46:04.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:04.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836535 2024-05-08T17:46:04.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:04.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:46:04.293 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836535 2024-05-08T17:46:04.293 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:04.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836535 2024-05-08T17:46:04.295 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836535 2024-05-08T17:46:04.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836535' 2024-05-08T17:46:04.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:46:04.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 0 -lt 21474836535 2024-05-08T17:46:04.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:46:05.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:46:05.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:46:06.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836536 -lt 21474836535 2024-05-08T17:46:06.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:06.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:06.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673003 2024-05-08T17:46:06.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:46:06.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673003 2024-05-08T17:46:06.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:06.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673003 2024-05-08T17:46:06.272 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673003 2024-05-08T17:46:06.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673003' 2024-05-08T17:46:06.273 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:46:06.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673004 -lt 42949673003 2024-05-08T17:46:06.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:06.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509471 2024-05-08T17:46:06.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:06.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:46:06.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509471 2024-05-08T17:46:06.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:06.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509471 2024-05-08T17:46:06.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509471' 2024-05-08T17:46:06.829 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509471 2024-05-08T17:46:06.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:46:07.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509471 -lt 64424509471 2024-05-08T17:46:07.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:07.596 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345947 2024-05-08T17:46:07.596 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:07.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:46:07.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345947 2024-05-08T17:46:07.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:07.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345947 2024-05-08T17:46:07.600 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345947 2024-05-08T17:46:07.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345947' 2024-05-08T17:46:07.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:46:08.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345948 -lt 85899345947 2024-05-08T17:46:08.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:08.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182416 2024-05-08T17:46:08.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:08.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:46:08.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182416 2024-05-08T17:46:08.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:08.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182416 2024-05-08T17:46:08.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182416' 2024-05-08T17:46:08.058 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182416 2024-05-08T17:46:08.058 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:46:08.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182417 -lt 107374182416 2024-05-08T17:46:08.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:08.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018892 2024-05-08T17:46:08.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:08.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T17:46:08.521 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018892 2024-05-08T17:46:08.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:08.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018892 2024-05-08T17:46:08.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018892' 2024-05-08T17:46:08.523 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018892 2024-05-08T17:46:08.524 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T17:46:08.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018893 -lt 128849018892 2024-05-08T17:46:08.935 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:46:08.935 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:46:08.936 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:46:09.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T17:46:09.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:46:09.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:46:09.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:46:09.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:46:09.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:46:09.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:46:09.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:46:10.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:46:10.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:46:10.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:46:10.109 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:46:10.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:46:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T17:46:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:46:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T17:46:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:46:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:46:10.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:46:10.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:46:10.732 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:46:10.732 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:46:10.732 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:46:10.732 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:46:10.733 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:46:10.733 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:46:11.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:46:11.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:46:11.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:46:11.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:46:11.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:46:11.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:46:11.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:46:11.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:46:11.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:46:11.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:46:11.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:46:11.671 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:46:11.671 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:46:12.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=18487 2024-05-08T17:46:12.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 18487 '!=' null 2024-05-08T17:46:12.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:46:12.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:46:12.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:46:12.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:46:12.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:46:12.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:46:12.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:46:12.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:46:12.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:46:12.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:46:12.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:46:12.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:46:12.939 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:46:12.939 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:46:12.939 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:46:13.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:46:13.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:46:13.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:46:13.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:46:13.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:46:13.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:46:13.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:46:13.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:46:13.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:46:14.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=40064 2024-05-08T17:46:14.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 40064 '!=' null 2024-05-08T17:46:14.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:46:14.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:46:14.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:46:14.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:46:14.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:46:14.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:46:14.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:46:14.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:46:14.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:46:14.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:46:14.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:46:14.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:46:14.563 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:46:14.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:46:14.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:46:15.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:46:15.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:46:15.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:46:15.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:46:15.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:46:15.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:46:15.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:46:15.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:46:15.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:46:15.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=36513 2024-05-08T17:46:15.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 36513 '!=' null 2024-05-08T17:46:15.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:46:15.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:46:15.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:46:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:46:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:46:15.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:46:15.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:46:15.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:46:15.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:46:15.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:46:15.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:46:16.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:46:16.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:46:16.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:46:16.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:46:16.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:46:16.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:46:16.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:46:16.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:46:16.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:46:16.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:46:16.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:46:16.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:46:16.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:46:17.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=36513 2024-05-08T17:46:17.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 36513 '!=' null 2024-05-08T17:46:17.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:46:17.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:46:17.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:46:17.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:46:17.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:46:17.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:46:17.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:46:17.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:46:17.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:46:17.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:46:17.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:46:17.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:46:17.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:46:17.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:46:17.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:46:18.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T17:46:18.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:46:18.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:46:18.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:78: _common_test: flush_pg_stats 2024-05-08T17:46:18.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:46:18.348 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:46:18.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:46:18.858 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:46:18.859 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:46:18.859 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:46:18.859 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T17:46:18.859 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T17:46:18.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:46:18.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:18.860 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:46:19.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836540 2024-05-08T17:46:19.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836540 2024-05-08T17:46:19.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836540' 2024-05-08T17:46:19.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:19.029 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:46:19.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673008 2024-05-08T17:46:19.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673008 2024-05-08T17:46:19.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836540 1-42949673008' 2024-05-08T17:46:19.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:19.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:46:19.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509476 2024-05-08T17:46:19.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509476 2024-05-08T17:46:19.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836540 1-42949673008 2-64424509476' 2024-05-08T17:46:19.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:19.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:46:19.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345952 2024-05-08T17:46:19.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345952 2024-05-08T17:46:19.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836540 1-42949673008 2-64424509476 3-85899345952' 2024-05-08T17:46:19.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:19.492 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:46:19.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182421 2024-05-08T17:46:19.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182421 2024-05-08T17:46:19.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836540 1-42949673008 2-64424509476 3-85899345952 4-107374182421' 2024-05-08T17:46:19.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:46:19.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T17:46:19.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018897 2024-05-08T17:46:19.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018897 2024-05-08T17:46:19.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836540 1-42949673008 2-64424509476 3-85899345952 4-107374182421 5-128849018897' 2024-05-08T17:46:19.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:19.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836540 2024-05-08T17:46:19.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:19.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:46:19.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836540 2024-05-08T17:46:19.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:19.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836540 2024-05-08T17:46:19.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836540' 2024-05-08T17:46:19.799 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836540 2024-05-08T17:46:19.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:46:20.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836540 -lt 21474836540 2024-05-08T17:46:20.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:20.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673008 2024-05-08T17:46:20.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:20.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:46:20.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673008 2024-05-08T17:46:20.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:20.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673008 2024-05-08T17:46:20.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673008' 2024-05-08T17:46:20.186 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673008 2024-05-08T17:46:20.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:46:20.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673008 -lt 42949673008 2024-05-08T17:46:20.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:20.637 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509476 2024-05-08T17:46:20.637 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:20.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:46:20.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509476 2024-05-08T17:46:20.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:20.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509476 2024-05-08T17:46:20.640 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509476 2024-05-08T17:46:20.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509476' 2024-05-08T17:46:20.641 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:46:21.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509474 -lt 64424509476 2024-05-08T17:46:21.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:46:22.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:46:22.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:46:22.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509476 -lt 64424509476 2024-05-08T17:46:22.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:22.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345952 2024-05-08T17:46:22.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:22.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:46:22.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345952 2024-05-08T17:46:22.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:22.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345952 2024-05-08T17:46:22.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345952' 2024-05-08T17:46:22.487 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345952 2024-05-08T17:46:22.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:46:22.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345952 -lt 85899345952 2024-05-08T17:46:22.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:22.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:22.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182421 2024-05-08T17:46:22.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:46:22.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182421 2024-05-08T17:46:22.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:22.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182421 2024-05-08T17:46:22.907 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182421 2024-05-08T17:46:22.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182421' 2024-05-08T17:46:22.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:46:23.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182422 -lt 107374182421 2024-05-08T17:46:23.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:46:23.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:46:23.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018897 2024-05-08T17:46:23.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T17:46:23.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018897 2024-05-08T17:46:23.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:46:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018897 2024-05-08T17:46:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018897' 2024-05-08T17:46:23.383 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018897 2024-05-08T17:46:23.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T17:46:23.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018898 -lt 128849018897 2024-05-08T17:46:23.771 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: ceph pg dump pgs --format=json 2024-05-08T17:46:23.771 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: jq '.pg_stats[0].up_primary' 2024-05-08T17:46:24.174 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:46:24.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: newprimary=4 2024-05-08T17:46:24.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:81: _common_test: kill_daemons 2024-05-08T17:46:24.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:46:24.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:46:24.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:46:24.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:46:24.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:46:29.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:46:29.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:83: _common_test: ERRORS=0 2024-05-08T17:46:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2024-05-08T17:46:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: tee td/osd-backfill-recovery-log/result.log 2024-05-08T17:46:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T17:46:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=4 2024-05-08T17:46:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T17:46:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2024-05-08T17:46:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "pg_log_t": { 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "head": "34'40", 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "tail": "0'0", 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "log": [ 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c00128d9:::obj-1:head", 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "33'1", 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4397.0:1", 2024-05-08T17:46:30.831 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:52.035250+0000", 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.832 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:d7942fc0:::obj-2:head", 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'2", 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4400.0:1", 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:52.950531+0000", 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.833 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1dda57ab:::obj-3:head", 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'3", 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.834 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4403.0:1", 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:53.323404+0000", 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.835 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ba1802d0:::obj-4:head", 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'4", 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4406.0:1", 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:53.494987+0000", 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.836 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:d5d4a582:::obj-5:head", 2024-05-08T17:46:30.837 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'5", 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4409.0:1", 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:53.661375+0000", 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.838 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:25cac09a:::obj-6:head", 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'6", 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4412.0:1", 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:53.879807+0000", 2024-05-08T17:46:30.839 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.840 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:b11b7838:::obj-7:head", 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'7", 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4415.0:1", 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:54.057648+0000", 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.841 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:a0f702de:::obj-8:head", 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'8", 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4418.0:1", 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.842 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:54.248869+0000", 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.843 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1e5c3677:::obj-9:head", 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'9", 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4421.0:1", 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:54.449692+0000", 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.844 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:86dc045c:::obj-10:head", 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'10", 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4424.0:1", 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.845 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:54.624477+0000", 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.846 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1e6eca61:::obj-11:head", 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'11", 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4427.0:1", 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:54.800508+0000", 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.847 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:18dee445:::obj-12:head", 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'12", 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4430.0:1", 2024-05-08T17:46:30.848 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:54.994765+0000", 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.849 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:283c5c90:::obj-13:head", 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'13", 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4433.0:1", 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:55.162199+0000", 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.850 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.851 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:cc896bf0:::obj-14:head", 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'14", 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4436.0:1", 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:55.355985+0000", 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.852 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:a581f807:::obj-15:head", 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'15", 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4439.0:1", 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:55.572998+0000", 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.853 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.854 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c902ca7c:::obj-16:head", 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'16", 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4442.0:1", 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:55.779202+0000", 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.855 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:655283c8:::obj-17:head", 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'17", 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4445.0:1", 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:55.967349+0000", 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.856 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.857 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.858 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.858 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.858 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:d759d762:::obj-18:head", 2024-05-08T17:46:30.858 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'18", 2024-05-08T17:46:30.858 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.858 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4448.0:1", 2024-05-08T17:46:30.858 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.858 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:56.159012+0000", 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.861 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1b934a2d:::obj-19:head", 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'19", 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4451.0:1", 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.862 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:56.361348+0000", 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.863 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1d0ea2ca:::obj-20:head", 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'20", 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4454.0:1", 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:56.542949+0000", 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.864 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ab396690:::obj-21:head", 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'21", 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4457.0:1", 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:56.702532+0000", 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.865 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.866 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:254983db:::obj-22:head", 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'22", 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4460.0:1", 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:56.872602+0000", 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.867 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:e656299f:::obj-23:head", 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'23", 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4463.0:1", 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:57.035520+0000", 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.868 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:5cdf412b:::obj-24:head", 2024-05-08T17:46:30.869 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'24", 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4466.0:1", 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:57.214160+0000", 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.870 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:cacae143:::obj-25:head", 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'25", 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4469.0:1", 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:57.432809+0000", 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.871 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:34b5bff6:::obj-26:head", 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'26", 2024-05-08T17:46:30.872 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4472.0:1", 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:57.625261+0000", 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.873 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:a354f8f6:::obj-27:head", 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'27", 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4475.0:1", 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:57.859186+0000", 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.874 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:7421db49:::obj-28:head", 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'28", 2024-05-08T17:46:30.875 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4478.0:1", 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:58.035119+0000", 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.876 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:54bc79ba:::obj-29:head", 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'29", 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4481.0:1", 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:58.208955+0000", 2024-05-08T17:46:30.877 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.878 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:01b15595:::obj-30:head", 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'30", 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4484.0:1", 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:58.402592+0000", 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.879 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.880 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:f9a0a8a2:::obj-31:head", 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'31", 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4487.0:1", 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:58.588542+0000", 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.881 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1bf2562f:::obj-32:head", 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'32", 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4490.0:1", 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.882 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:58.796115+0000", 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.883 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:b982ae22:::obj-33:head", 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'33", 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4493.0:1", 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:58.964308+0000", 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.884 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.885 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1ad9f98e:::obj-34:head", 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'34", 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4496.0:1", 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:59.165705+0000", 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.886 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:941f43ff:::obj-35:head", 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'35", 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4499.0:1", 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:59.366312+0000", 2024-05-08T17:46:30.887 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.888 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:24ebabe9:::obj-36:head", 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'36", 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4502.0:1", 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:59.549759+0000", 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.889 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:5f3a5398:::obj-37:head", 2024-05-08T17:46:30.890 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'37", 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4505.0:1", 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:59.725252+0000", 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:31.114 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c96cb37e:::obj-38:head", 2024-05-08T17:46:31.115 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'38", 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4508.0:1", 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:45:59.927927+0000", 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:31.116 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:69e36996:::obj-39:head", 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'39", 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4511.0:1", 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:46:00.102443+0000", 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:31.117 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.118 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:9f75773e:::obj-40:head", 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'40", 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4514.0:1", 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:46:00.286653+0000", 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.119 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "dups": [] 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "pg_missing_t": { 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "missing": [], 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: "may_include_deletes": true 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:46:31.120 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:46:31.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2024-05-08T17:46:31.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: LOGLEN=40 2024-05-08T17:46:31.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:86: _common_test: '[' 40 '!=' 40 ']' 2024-05-08T17:46:31.160 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2024-05-08T17:46:31.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: DUPSLEN=0 2024-05-08T17:46:31.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:91: _common_test: '[' 0 '!=' 0 ']' 2024-05-08T17:46:31.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:95: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'40 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'39 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'38 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'37 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'36 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'35 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'34 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'33 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'32 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'31 2024-05-08T17:46:31.202 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'30 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'29 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'28 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'27 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'26 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'25 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'24 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'23 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'22 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'21 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'20 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'19 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'18 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'17 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'16 2024-05-08T17:46:31.203 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'15 2024-05-08T17:46:31.204 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'14 2024-05-08T17:46:31.204 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'13 2024-05-08T17:46:31.204 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'12 2024-05-08T17:46:31.204 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'11 2024-05-08T17:46:31.204 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'10 2024-05-08T17:46:31.204 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'9 2024-05-08T17:46:31.204 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'8 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'7 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'6 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'5 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'4 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'3 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 34'2 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after copy log version 33'1 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:46:02.034+0000 7fa522872640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'40 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'39 2024-05-08T17:46:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'38 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'37 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'36 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'35 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'34 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'33 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'32 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'31 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'30 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'29 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'28 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'27 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'26 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'25 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'24 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'23 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'22 2024-05-08T17:46:31.212 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'21 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'20 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'19 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'18 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'17 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'16 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'15 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'14 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'13 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'12 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'11 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'10 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'9 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'8 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'7 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'6 2024-05-08T17:46:31.213 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'5 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'4 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'3 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'2 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 33'1 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'40 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'39 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'38 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'37 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'36 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'35 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'34 2024-05-08T17:46:31.214 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'33 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'32 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'31 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'30 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'29 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'28 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'27 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'26 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'25 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'24 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'23 2024-05-08T17:46:31.215 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'22 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'21 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'20 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'19 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'18 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'17 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'16 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'15 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'14 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'13 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'12 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'11 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'10 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'9 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'8 2024-05-08T17:46:31.216 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'7 2024-05-08T17:46:31.217 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'6 2024-05-08T17:46:31.217 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'5 2024-05-08T17:46:31.217 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'4 2024-05-08T17:46:31.217 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'3 2024-05-08T17:46:31.217 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 34'2 2024-05-08T17:46:31.217 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after copy log version 33'1 2024-05-08T17:46:31.217 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-05-08T17:46:02.402+0000 7f3e90ba0640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:96: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:97: _common_test: '[' 0 '!=' 0 ']' 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:35: run: teardown td/osd-backfill-recovery-log 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:46:31.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:46:31.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:46:31.227 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:46:31.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:46:31.228 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:46:31.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:46:31.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:46:31.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:46:31.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:46:31.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:46:31.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:46:31.230 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:46:31.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:46:31.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:46:31.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:46:31.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:46:31.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:46:31.263 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:46:31.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:46:31.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:46:31.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:46:31.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:32: run: for func in $funcs 2024-05-08T17:46:31.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:33: run: setup td/osd-backfill-recovery-log 2024-05-08T17:46:31.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-recovery-log 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:46:31.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:46:31.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:46:31.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:46:31.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:46:31.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:46:31.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:46:31.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:46:31.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:46:31.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:46:31.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:46:31.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:46:31.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:46:31.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:46:31.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:46:31.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:46:31.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:46:31.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:46:31.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:46:31.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:46:31.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:46:31.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:46:31.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-recovery-log 2024-05-08T17:46:31.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T17:46:31.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:46:31.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:46:31.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.47083 2024-05-08T17:46:31.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T17:46:31.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T17:46:31.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T17:46:31.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2024-05-08T17:46:31.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:34: run: TEST_recovery_2 td/osd-backfill-recovery-log 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:130: TEST_recovery_2: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:132: TEST_recovery_2: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 151 10 141 20 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:41: _common_test: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:42: _common_test: local 'extra_opts=--osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:43: _common_test: local loglen=151 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:44: _common_test: local dupslen=10 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:45: _common_test: local objects=141 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:46: _common_test: local moreobjects=20 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:48: _common_test: local OSDS=6 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:50: _common_test: run_mon td/osd-backfill-recovery-log a 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T17:46:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-recovery-log/a 2024-05-08T17:46:31.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2024-05-08T17:46:31.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T17:46:31.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:46:31.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:46:31.687 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:46:31.687 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:46:31.687 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:46:31.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:46:31.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T17:46:31.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T17:46:31.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T17:46:31.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:46:31.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:46:31.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T17:46:31.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T17:46:31.918 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:46:31.918 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:46:31.918 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:46:31.919 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:46:31.919 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:46:31.919 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:46:31.919 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.47083/ceph-mon.a.asok 2024-05-08T17:46:31.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:46:31.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.47083/ceph-mon.a.asok config get fsid 2024-05-08T17:46:32.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T17:46:32.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:46:32.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:46:32.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T17:46:32.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.47083/ceph-mon.a.asok 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:46:32.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.47083/ceph-mon.a.asok config get mon_host 2024-05-08T17:46:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:51: _common_test: run_mgr td/osd-backfill-recovery-log x 2024-05-08T17:46:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T17:46:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T17:46:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T17:46:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-recovery-log/x 2024-05-08T17:46:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T17:46:33.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T17:46:33.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:46:33.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:46:33.062 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:46:33.062 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:46:33.062 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:46:33.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:46:33.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:46:33.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:46:33.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:52: _common_test: export CEPH_ARGS 2024-05-08T17:46:33.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:46:33.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:46:33.102 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: expr 6 - 1 2024-05-08T17:46:33.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: seq 0 5 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 0 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:46:33.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:46:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:46:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2024-05-08T17:46:33.109 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:46:33.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7dfb7be4-c245-4c2d-966b-c614d855a285 2024-05-08T17:46:33.109 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 7dfb7be4-c245-4c2d-966b-c614d855a285 2024-05-08T17:46:33.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 7dfb7be4-c245-4c2d-966b-c614d855a285' 2024-05-08T17:46:33.109 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:46:33.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB5ujtmXGvfBxAAR1xScr6C/SntlHE6Byd9yg== 2024-05-08T17:46:33.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB5ujtmXGvfBxAAR1xScr6C/SntlHE6Byd9yg=="}' 2024-05-08T17:46:33.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7dfb7be4-c245-4c2d-966b-c614d855a285 -i td/osd-backfill-recovery-log/0/new.json 2024-05-08T17:46:33.427 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:46:33.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2024-05-08T17:46:33.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB5ujtmXGvfBxAAR1xScr6C/SntlHE6Byd9yg== --osd-uuid 7dfb7be4-c245-4c2d-966b-c614d855a285 2024-05-08T17:46:33.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:33.485+0000 7faf561037c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:46:33.520 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:33.525+0000 7faf561037c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:46:33.521 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:33.525+0000 7faf561037c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:46:33.522 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:33.525+0000 7faf561037c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:46:33.522 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:33.525+0000 7faf561037c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:46:33.522 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:33.525+0000 7faf561037c0 -1 bluestore(td/osd-backfill-recovery-log/0/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/0/block: (2) No such file or directory 2024-05-08T17:46:33.560 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:33.565+0000 7faf561037c0 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2024-05-08T17:46:39.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2024-05-08T17:46:39.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:46:39.980 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T17:46:39.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T17:46:39.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:46:40.518 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:46:40.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T17:46:40.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:46:40.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:46:40.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:46:40.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:46:40.555 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:40.557+0000 7ff1257667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:46:40.558 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:40.561+0000 7ff1257667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:46:40.559 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:40.561+0000 7ff1257667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:46:40.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T17:46:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:46:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:46:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:46:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:46:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:46:40.987 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:46:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:40.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:41.161 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:41.165+0000 7ff1257667c0 -1 Falling back to public interface 2024-05-08T17:46:41.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:42.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:42.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:42.423 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:46:42.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:46:42.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:42.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:42.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:43.791 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:46:43.793+0000 7ff1257667c0 -1 osd.0 0 log_to_monitors true 2024-05-08T17:46:43.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:43.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:43.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:46:43.908 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:46:43.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:43.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:44.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:45.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:45.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:45.516 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:46:45.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:46:45.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:45.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:45.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:46.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:46.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:46.945 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:46:46.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:46:46.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:46.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:47.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:48.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:48.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:48.378 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:46:48.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:46:48.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:48.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:48.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:49.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:49.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:49.822 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:46:49.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:46:49.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:49.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:50.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:51.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:51.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:51.273 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:46:51.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:46:51.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:51.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:51.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:52.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:52.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:52.728 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:46:52.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:46:52.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:52.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:53.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:54.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:54.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:54.173 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:46:54.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:46:54.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:54.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:54.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:55.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:55.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:55.733 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:46:55.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:46:55.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:55.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:56.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:57.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:57.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:57.170 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:46:57.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:46:57.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:57.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:57.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:46:58.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:46:58.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:46:58.905 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:46:58.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:46:58.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:46:58.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:46:59.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:00.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:00.410 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:47:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:47:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:00.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:47:01.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:02.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:02.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:02.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:47:02.293 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:47:02.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:02.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:47:03.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:04.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:04.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:04.111 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:47:04.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:47:04.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:04.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:47:04.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:05.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:05.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:05.989 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:47:05.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:47:05.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:05.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:47:07.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:08.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:08.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:08.056 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:47:08.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:47:08.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:08.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:47:08.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:09.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:09.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:09.673 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:47:09.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:47:09.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:09.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:47:10.127 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2668324268,v1:127.0.0.1:6803/2668324268] [v2:127.0.0.1:6804/2668324268,v1:127.0.0.1:6805/2668324268] exists,up 7dfb7be4-c245-4c2d-966b-c614d855a285 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 1 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:47:10.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:47:10.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:47:10.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:47:10.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:47:10.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:47:10.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:47:10.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2024-05-08T17:47:10.132 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:47:10.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=03594459-bdf5-488c-bab1-a4cd54d32f59 2024-05-08T17:47:10.133 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 03594459-bdf5-488c-bab1-a4cd54d32f59 2024-05-08T17:47:10.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 03594459-bdf5-488c-bab1-a4cd54d32f59' 2024-05-08T17:47:10.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:47:10.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCeujtmok6sCRAAhTzT+AAsDplLMnWH6kXe4A== 2024-05-08T17:47:10.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCeujtmok6sCRAAhTzT+AAsDplLMnWH6kXe4A=="}' 2024-05-08T17:47:10.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 03594459-bdf5-488c-bab1-a4cd54d32f59 -i td/osd-backfill-recovery-log/1/new.json 2024-05-08T17:47:10.652 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:47:10.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2024-05-08T17:47:10.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCeujtmok6sCRAAhTzT+AAsDplLMnWH6kXe4A== --osd-uuid 03594459-bdf5-488c-bab1-a4cd54d32f59 2024-05-08T17:47:10.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:10.700+0000 7f2581c3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:10.746 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:10.748+0000 7f2581c3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:10.748 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:10.748+0000 7f2581c3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:10.748 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:10.752+0000 7f2581c3a7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:47:10.748 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:10.752+0000 7f2581c3a7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:47:10.749 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:10.752+0000 7f2581c3a7c0 -1 bluestore(td/osd-backfill-recovery-log/1/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/1/block: (2) No such file or directory 2024-05-08T17:47:10.785 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:10.788+0000 7f2581c3a7c0 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2024-05-08T17:47:17.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2024-05-08T17:47:17.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:47:17.529 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T17:47:17.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T17:47:17.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:47:18.134 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T17:47:18.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T17:47:18.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:47:18.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:47:18.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:47:18.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:47:18.171 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:18.172+0000 7f77404b07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:18.201 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:18.204+0000 7f77404b07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:18.203 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:18.204+0000 7f77404b07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:18.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T17:47:18.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:47:18.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T17:47:18.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:47:18.564 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:47:18.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:47:18.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:18.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:47:18.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:18.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:18.767 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:18.768+0000 7f77404b07c0 -1 Falling back to public interface 2024-05-08T17:47:19.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:20.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:20.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:20.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:47:20.021 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:47:20.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:20.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:20.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:21.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:21.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:21.450 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:47:21.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:47:21.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:21.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:21.450 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:21.452+0000 7f77404b07c0 -1 osd.1 0 log_to_monitors true 2024-05-08T17:47:21.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:22.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:22.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:22.878 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:47:22.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:47:22.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:22.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:23.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:24.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:24.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:24.334 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:47:24.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:47:24.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:24.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:24.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:25.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:25.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:25.819 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:47:25.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:47:25.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:25.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:26.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:27.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:27.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:27.267 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:47:27.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:47:27.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:27.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:27.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:28.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:28.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:28.922 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:47:28.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:47:28.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:28.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:29.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:30.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:30.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:30.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:47:30.342 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:47:30.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:30.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:30.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:31.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:31.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:31.833 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:47:31.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:47:31.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:31.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:32.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:33.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:33.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:33.247 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:47:33.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:47:33.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:33.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:33.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:34.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:34.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:34.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:47:34.705 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:47:34.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:34.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:35.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:36.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:36.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:36.137 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:47:36.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:47:36.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:36.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:37.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:38.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:38.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:38.266 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:47:38.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:47:38.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:38.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:39.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:40.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:40.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:40.154 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:47:40.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:47:40.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:40.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:40.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:41.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:41.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:41.873 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:47:41.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:47:41.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:41.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:43.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:44.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:44.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:44.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:47:44.370 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:47:44.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:44.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:45.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:46.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:46.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:46.211 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:47:46.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:47:46.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:46.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:47.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:48.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:48.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:48.104 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:47:48.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:47:48.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:48.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:47:48.564 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2554594050,v1:127.0.0.1:6811/2554594050] [v2:127.0.0.1:6812/2554594050,v1:127.0.0.1:6813/2554594050] exists,up 03594459-bdf5-488c-bab1-a4cd54d32f59 2024-05-08T17:47:48.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:47:48.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:47:48.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:47:48.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 2 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2024-05-08T17:47:48.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:47:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:47:48.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2024-05-08T17:47:48.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:47:48.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=3892f3f5-b8e3-4f09-bde3-0259368a6481 2024-05-08T17:47:48.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 3892f3f5-b8e3-4f09-bde3-0259368a6481' 2024-05-08T17:47:48.571 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 3892f3f5-b8e3-4f09-bde3-0259368a6481 2024-05-08T17:47:48.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:47:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDEujtm3B2gIxAAix9y9GhjLx3IkhXYYKhloQ== 2024-05-08T17:47:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDEujtm3B2gIxAAix9y9GhjLx3IkhXYYKhloQ=="}' 2024-05-08T17:47:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 3892f3f5-b8e3-4f09-bde3-0259368a6481 -i td/osd-backfill-recovery-log/2/new.json 2024-05-08T17:47:49.115 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:47:49.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2024-05-08T17:47:49.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDEujtm3B2gIxAAix9y9GhjLx3IkhXYYKhloQ== --osd-uuid 3892f3f5-b8e3-4f09-bde3-0259368a6481 2024-05-08T17:47:49.163 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:49.163+0000 7fa5057377c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:49.192 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:49.195+0000 7fa5057377c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:49.194 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:49.195+0000 7fa5057377c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:49.195 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:49.195+0000 7fa5057377c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:47:49.195 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:49.195+0000 7fa5057377c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:47:49.195 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:49.195+0000 7fa5057377c0 -1 bluestore(td/osd-backfill-recovery-log/2/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/2/block: (2) No such file or directory 2024-05-08T17:47:49.239 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:49.239+0000 7fa5057377c0 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2024-05-08T17:47:56.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2024-05-08T17:47:56.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:47:56.204 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T17:47:56.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T17:47:56.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:47:56.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T17:47:56.745 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T17:47:56.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:47:56.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:47:56.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:47:56.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:47:56.781 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:56.783+0000 7f680f6827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:56.783 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:56.783+0000 7f680f6827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:56.785 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:56.787+0000 7f680f6827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:47:57.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T17:47:57.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:47:57.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T17:47:57.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:47:57.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:47:57.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:57.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:47:57.143 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:47:57.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:57.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:47:57.362 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:47:57.363+0000 7f680f6827c0 -1 Falling back to public interface 2024-05-08T17:47:57.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:58.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:58.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:58.579 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:47:58.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:47:58.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:58.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:47:58.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:47:59.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:47:59.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:47:59.981 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:47:59.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:47:59.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:47:59.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:00.113 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:00.115+0000 7f680f6827c0 -1 osd.2 0 log_to_monitors true 2024-05-08T17:48:00.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:01.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:01.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:01.513 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:48:01.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:48:01.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:01.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:02.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:03.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:03.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:03.111 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:48:03.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:48:03.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:03.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:03.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:04.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:04.547 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:48:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:48:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:04.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:05.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:06.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:06.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:06.107 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:48:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:48:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:06.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:07.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:07.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:07.684 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:48:07.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:48:07.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:07.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:08.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:09.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:09.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:09.205 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:48:09.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:48:09.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:09.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:09.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:10.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:10.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:10.652 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:48:10.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:48:10.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:10.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:11.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:12.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:12.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:12.222 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:48:12.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:48:12.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:12.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:12.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:13.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:13.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:13.710 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:48:13.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:48:13.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:13.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:14.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:15.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:15.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:15.199 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:48:15.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:48:15.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:15.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:15.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:16.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:16.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:16.844 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:48:16.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:48:16.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:16.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:17.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:18.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:18.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:18.953 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:48:18.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:48:18.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:18.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:19.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:20.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:20.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:20.906 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:48:20.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:48:20.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:20.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:21.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:22.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:22.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:22.771 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:48:22.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:48:22.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:22.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:23.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:24.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:24.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:24.988 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:48:24.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:48:24.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:24.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:25.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:26.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:26.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:26.828 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:48:26.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:48:26.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:26.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:48:27.342 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2119543215,v1:127.0.0.1:6819/2119543215] [v2:127.0.0.1:6820/2119543215,v1:127.0.0.1:6821/2119543215] exists,up 3892f3f5-b8e3-4f09-bde3-0259368a6481 2024-05-08T17:48:27.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:48:27.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:48:27.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:48:27.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:48:27.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 3 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:48:27.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:48:27.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2024-05-08T17:48:27.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2024-05-08T17:48:27.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:48:27.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:48:27.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:48:27.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:48:27.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:48:27.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:48:27.350 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:48:27.350 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:48:27.350 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:48:27.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2024-05-08T17:48:27.351 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:48:27.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2d89f803-3618-4592-8934-2b71656e878e 2024-05-08T17:48:27.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 2d89f803-3618-4592-8934-2b71656e878e' 2024-05-08T17:48:27.352 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 2d89f803-3618-4592-8934-2b71656e878e 2024-05-08T17:48:27.353 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:48:27.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDrujtmxeY9FhAAeyStPML0X+9HylmpJX97hg== 2024-05-08T17:48:27.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDrujtmxeY9FhAAeyStPML0X+9HylmpJX97hg=="}' 2024-05-08T17:48:27.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2d89f803-3618-4592-8934-2b71656e878e -i td/osd-backfill-recovery-log/3/new.json 2024-05-08T17:48:27.985 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:48:28.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2024-05-08T17:48:28.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrujtmxeY9FhAAeyStPML0X+9HylmpJX97hg== --osd-uuid 2d89f803-3618-4592-8934-2b71656e878e 2024-05-08T17:48:28.049 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:28.051+0000 7f1beba717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:48:28.057 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:28.059+0000 7f1beba717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:48:28.059 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:28.059+0000 7f1beba717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:48:28.060 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:28.059+0000 7f1beba717c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:48:28.060 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:28.059+0000 7f1beba717c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:48:28.060 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:28.059+0000 7f1beba717c0 -1 bluestore(td/osd-backfill-recovery-log/3/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/3/block: (2) No such file or directory 2024-05-08T17:48:28.159 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:28.159+0000 7f1beba717c0 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2024-05-08T17:48:35.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2024-05-08T17:48:35.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:48:35.027 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T17:48:35.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T17:48:35.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:48:35.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T17:48:35.585 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T17:48:35.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:48:35.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:48:35.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:48:35.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:48:35.620 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:35.623+0000 7fd1023657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:48:35.648 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:35.647+0000 7fd1023657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:48:35.649 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:35.651+0000 7fd1023657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:48:36.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T17:48:36.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:48:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T17:48:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:48:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:48:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:36.045 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:48:36.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:48:36.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:36.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:36.206 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:36.206+0000 7fd1023657c0 -1 Falling back to public interface 2024-05-08T17:48:36.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:37.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:37.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:37.494 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:48:37.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:48:37.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:37.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:37.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:38.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:38.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:38.925 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:48:38.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:48:38.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:38.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:38.928 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:48:38.926+0000 7fd1023657c0 -1 osd.3 0 log_to_monitors true 2024-05-08T17:48:39.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:40.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:40.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:40.552 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:48:40.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:48:40.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:40.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:41.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:42.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:42.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:42.177 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:48:42.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:48:42.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:42.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:42.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:43.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:43.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:43.691 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:48:43.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:48:43.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:43.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:44.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:45.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:45.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:45.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:48:45.490 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:48:45.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:45.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:46.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:47.193 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:48:47.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:48:47.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:47.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:47.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:48.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:48.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:48.640 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:48:48.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:48:48.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:48.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:49.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:50.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:50.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:50.157 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:48:50.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:48:50.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:50.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:50.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:51.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:51.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:51.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:48:51.715 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:48:51.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:51.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:52.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:53.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:53.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:53.472 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:48:53.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:48:53.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:53.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:54.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:55.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:55.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:55.545 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:48:55.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:48:55.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:55.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:56.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:57.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:57.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:57.364 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:48:57.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:48:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:48:58.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:48:59.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:48:59.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:48:59.234 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:48:59.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:48:59.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:48:59.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:49:00.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:01.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:01.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:01.505 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:49:01.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:49:01.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:01.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:49:02.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:03.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:03.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:03.472 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:49:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:49:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:49:04.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:05.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:05.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:05.605 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:49:05.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:49:05.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:05.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T17:49:06.075 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3595710263,v1:127.0.0.1:6827/3595710263] [v2:127.0.0.1:6828/3595710263,v1:127.0.0.1:6829/3595710263] exists,up 2d89f803-3618-4592-8934-2b71656e878e 2024-05-08T17:49:06.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:49:06.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:49:06.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:49:06.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:49:06.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 4 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2024-05-08T17:49:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:49:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:49:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:49:06.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:49:06.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:49:06.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:49:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:49:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:49:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:49:06.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:49:06.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:49:06.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2024-05-08T17:49:06.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:49:06.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4ef2a32d-72c6-4456-b262-7c90fe9bb9ed 2024-05-08T17:49:06.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 4ef2a32d-72c6-4456-b262-7c90fe9bb9ed' 2024-05-08T17:49:06.082 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 4ef2a32d-72c6-4456-b262-7c90fe9bb9ed 2024-05-08T17:49:06.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:49:06.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQASuztmTK+HBhAALDYX+rdrypmnmctskqfOHg== 2024-05-08T17:49:06.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQASuztmTK+HBhAALDYX+rdrypmnmctskqfOHg=="}' 2024-05-08T17:49:06.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4ef2a32d-72c6-4456-b262-7c90fe9bb9ed -i td/osd-backfill-recovery-log/4/new.json 2024-05-08T17:49:06.664 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:49:06.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2024-05-08T17:49:06.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQASuztmTK+HBhAALDYX+rdrypmnmctskqfOHg== --osd-uuid 4ef2a32d-72c6-4456-b262-7c90fe9bb9ed 2024-05-08T17:49:06.722 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:06.726+0000 7f51899297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:06.758 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:06.762+0000 7f51899297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:06.760 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:06.762+0000 7f51899297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:06.760 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:06.766+0000 7f51899297c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:49:06.760 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:06.766+0000 7f51899297c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:49:06.760 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:06.766+0000 7f51899297c0 -1 bluestore(td/osd-backfill-recovery-log/4/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/4/block: (2) No such file or directory 2024-05-08T17:49:06.797 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:06.802+0000 7f51899297c0 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2024-05-08T17:49:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2024-05-08T17:49:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:49:13.787 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T17:49:13.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T17:49:13.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:49:14.337 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T17:49:14.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T17:49:14.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:49:14.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:49:14.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:49:14.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:49:14.374 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:14.378+0000 7f2700b7b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:14.388 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:14.394+0000 7f2700b7b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:14.390 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:14.394+0000 7f2700b7b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:14.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T17:49:14.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:49:14.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T17:49:14.740 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:49:14.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:49:14.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:49:14.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:14.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:49:14.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:14.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:14.951 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:14.954+0000 7f2700b7b7c0 -1 Falling back to public interface 2024-05-08T17:49:15.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:16.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:16.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:16.157 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:49:16.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:49:16.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:16.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:16.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:17.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:17.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:17.593 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:49:17.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:49:17.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:17.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:17.600 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:17.606+0000 7f2700b7b7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T17:49:18.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:19.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:19.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:19.186 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:49:19.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:49:19.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:19.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:19.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:20.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:20.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:20.742 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:49:20.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:49:20.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:20.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:21.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:22.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:22.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:22.195 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:49:22.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:49:22.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:22.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:22.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:23.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:23.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:23.652 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:49:23.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:49:23.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:23.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:24.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:25.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:25.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:25.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:49:25.060 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:49:25.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:25.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:25.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:26.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:26.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:26.522 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:49:26.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:49:26.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:26.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:26.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:27.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:27.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:27.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:49:27.968 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:49:27.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:27.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:28.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:29.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:29.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:29.495 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:49:29.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:49:29.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:29.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:29.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:30.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:30.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:30.945 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:49:30.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:49:30.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:30.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:31.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:32.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:32.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:32.502 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:49:32.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:49:32.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:32.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:33.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:34.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:34.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:34.277 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:49:34.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:49:34.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:34.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:35.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:36.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:36.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:36.263 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:49:36.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:49:36.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:36.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:37.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:38.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:38.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:38.175 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:49:38.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:49:38.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:38.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:39.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:40.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:40.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:40.439 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:49:40.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:49:40.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:40.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:41.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:42.357 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:49:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:49:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:43.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:44.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:44.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:44.310 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:49:44.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:49:44.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:44.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T17:49:44.733 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3843622447,v1:127.0.0.1:6835/3843622447] [v2:127.0.0.1:6836/3843622447,v1:127.0.0.1:6837/3843622447] exists,up 4ef2a32d-72c6-4456-b262-7c90fe9bb9ed 2024-05-08T17:49:44.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:49:44.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:49:44.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 5 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-recovery-log 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2024-05-08T17:49:44.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:49:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:49:44.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2024-05-08T17:49:44.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:49:44.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1f8a7784-5b73-4d21-93be-0ef5e364d2cc 2024-05-08T17:49:44.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 1f8a7784-5b73-4d21-93be-0ef5e364d2cc' 2024-05-08T17:49:44.741 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 1f8a7784-5b73-4d21-93be-0ef5e364d2cc 2024-05-08T17:49:44.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:49:44.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA4uztm5qSPLRAA9IjmcwQoJPhia8ChJjm5pQ== 2024-05-08T17:49:44.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA4uztm5qSPLRAA9IjmcwQoJPhia8ChJjm5pQ=="}' 2024-05-08T17:49:44.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1f8a7784-5b73-4d21-93be-0ef5e364d2cc -i td/osd-backfill-recovery-log/5/new.json 2024-05-08T17:49:45.373 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:49:45.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2024-05-08T17:49:45.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA4uztm5qSPLRAA9IjmcwQoJPhia8ChJjm5pQ== --osd-uuid 1f8a7784-5b73-4d21-93be-0ef5e364d2cc 2024-05-08T17:49:45.427 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:45.429+0000 7f3fe86cb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:45.430 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:45.433+0000 7f3fe86cb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:45.431 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:45.433+0000 7f3fe86cb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:45.432 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:45.433+0000 7f3fe86cb7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:49:45.432 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:45.433+0000 7f3fe86cb7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:49:45.432 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:45.433+0000 7f3fe86cb7c0 -1 bluestore(td/osd-backfill-recovery-log/5/block) _read_bdev_label failed to open td/osd-backfill-recovery-log/5/block: (2) No such file or directory 2024-05-08T17:49:45.520 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:45.525+0000 7f3fe86cb7c0 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2024-05-08T17:49:52.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2024-05-08T17:49:52.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:49:52.515 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T17:49:52.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T17:49:52.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:49:53.077 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T17:49:53.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T17:49:53.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=16774686-b2a2-4fa7-8af9-a3132bbaf1a8 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.47083/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:49:53.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:49:53.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:49:53.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:49:53.114 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:53.117+0000 7fd2a7fe87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:53.146 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:53.149+0000 7fd2a7fe87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:53.148 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:53.149+0000 7fd2a7fe87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:49:53.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T17:49:53.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:49:53.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T17:49:53.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:49:53.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:49:53.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:53.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:49:53.515 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:49:53.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:53.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:49:53.705 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:53.709+0000 7fd2a7fe87c0 -1 Falling back to public interface 2024-05-08T17:49:53.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:54.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:54.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:54.949 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:49:54.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:49:54.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:54.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:49:55.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:56.167 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:49:56.169+0000 7fd2a7fe87c0 -1 osd.5 0 log_to_monitors true 2024-05-08T17:49:56.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:56.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:56.352 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:49:56.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:49:56.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:56.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:49:57.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:58.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:58.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:58.034 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:49:58.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:49:58.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:58.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:49:58.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:49:59.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:49:59.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:49:59.569 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:49:59.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:49:59.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:49:59.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:00.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:01.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:01.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:01.207 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:50:01.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:50:01.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:01.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:01.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:02.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:02.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:02.668 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:50:02.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:50:02.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:02.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:03.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:04.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:04.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:04.330 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:50:04.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:50:04.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:04.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:05.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:05.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:05.996 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:50:05.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:50:05.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:05.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:06.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:07.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:07.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:07.555 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:50:07.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:50:07.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:07.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:08.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:09.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:09.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:09.034 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:50:09.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:50:09.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:09.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:09.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:10.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:10.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:10.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:50:10.513 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:50:10.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:10.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:11.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:12.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:12.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:12.252 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:50:12.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:50:12.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:12.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:12.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:13.682 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:50:13.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:50:13.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:13.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:14.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:15.440 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:50:15.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:15.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:15.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:50:15.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:15.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:16.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:17.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:17.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:17.268 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:50:17.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:50:17.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:17.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:18.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:19.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:19.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:19.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:50:19.234 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:50:19.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:19.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:20.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:21.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:21.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:21.040 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:50:21.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:50:21.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:21.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:21.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:50:22.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:50:22.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:50:22.748 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:50:22.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:50:22.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:50:22.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T17:50:23.181 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/851034642,v1:127.0.0.1:6843/851034642] [v2:127.0.0.1:6844/851034642,v1:127.0.0.1:6845/851034642] exists,up 1f8a7784-5b73-4d21-93be-0ef5e364d2cc 2024-05-08T17:50:23.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:50:23.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:50:23.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:50:23.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:60: _common_test: create_pool test 1 1 2024-05-08T17:50:23.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T17:50:24.067 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T17:50:24.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:50:25.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: seq 1 141 2024-05-08T17:50:25.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:25.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-1 /etc/passwd 2024-05-08T17:50:25.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:25.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-2 /etc/passwd 2024-05-08T17:50:26.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:26.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-3 /etc/passwd 2024-05-08T17:50:26.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:26.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-4 /etc/passwd 2024-05-08T17:50:26.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:26.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-5 /etc/passwd 2024-05-08T17:50:26.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:26.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-6 /etc/passwd 2024-05-08T17:50:27.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:27.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-7 /etc/passwd 2024-05-08T17:50:27.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:27.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-8 /etc/passwd 2024-05-08T17:50:27.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:27.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-9 /etc/passwd 2024-05-08T17:50:27.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:27.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-10 /etc/passwd 2024-05-08T17:50:27.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:27.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-11 /etc/passwd 2024-05-08T17:50:27.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:27.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-12 /etc/passwd 2024-05-08T17:50:28.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:28.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-13 /etc/passwd 2024-05-08T17:50:28.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:28.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-14 /etc/passwd 2024-05-08T17:50:28.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:28.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-15 /etc/passwd 2024-05-08T17:50:28.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:28.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-16 /etc/passwd 2024-05-08T17:50:28.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:28.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-17 /etc/passwd 2024-05-08T17:50:29.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:29.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-18 /etc/passwd 2024-05-08T17:50:29.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:29.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-19 /etc/passwd 2024-05-08T17:50:29.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:29.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-20 /etc/passwd 2024-05-08T17:50:29.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:29.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-21 /etc/passwd 2024-05-08T17:50:29.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:29.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-22 /etc/passwd 2024-05-08T17:50:29.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:29.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-23 /etc/passwd 2024-05-08T17:50:30.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:30.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-24 /etc/passwd 2024-05-08T17:50:30.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:30.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-25 /etc/passwd 2024-05-08T17:50:30.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:30.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-26 /etc/passwd 2024-05-08T17:50:30.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:30.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-27 /etc/passwd 2024-05-08T17:50:30.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:30.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-28 /etc/passwd 2024-05-08T17:50:31.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:31.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-29 /etc/passwd 2024-05-08T17:50:31.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:31.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-30 /etc/passwd 2024-05-08T17:50:31.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:31.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-31 /etc/passwd 2024-05-08T17:50:31.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:31.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-32 /etc/passwd 2024-05-08T17:50:31.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:31.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-33 /etc/passwd 2024-05-08T17:50:32.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:32.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-34 /etc/passwd 2024-05-08T17:50:32.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:32.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-35 /etc/passwd 2024-05-08T17:50:32.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:32.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-36 /etc/passwd 2024-05-08T17:50:32.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:32.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-37 /etc/passwd 2024-05-08T17:50:32.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:32.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-38 /etc/passwd 2024-05-08T17:50:32.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:32.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-39 /etc/passwd 2024-05-08T17:50:33.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:33.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-40 /etc/passwd 2024-05-08T17:50:33.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:33.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-41 /etc/passwd 2024-05-08T17:50:33.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:33.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-42 /etc/passwd 2024-05-08T17:50:33.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:33.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-43 /etc/passwd 2024-05-08T17:50:33.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:33.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-44 /etc/passwd 2024-05-08T17:50:34.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:34.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-45 /etc/passwd 2024-05-08T17:50:34.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:34.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-46 /etc/passwd 2024-05-08T17:50:34.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:34.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-47 /etc/passwd 2024-05-08T17:50:34.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:34.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-48 /etc/passwd 2024-05-08T17:50:34.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:34.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-49 /etc/passwd 2024-05-08T17:50:34.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:34.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-50 /etc/passwd 2024-05-08T17:50:35.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:35.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-51 /etc/passwd 2024-05-08T17:50:35.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:35.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-52 /etc/passwd 2024-05-08T17:50:35.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:35.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-53 /etc/passwd 2024-05-08T17:50:35.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:35.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-54 /etc/passwd 2024-05-08T17:50:35.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:35.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-55 /etc/passwd 2024-05-08T17:50:36.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:36.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-56 /etc/passwd 2024-05-08T17:50:36.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:36.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-57 /etc/passwd 2024-05-08T17:50:36.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:36.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-58 /etc/passwd 2024-05-08T17:50:36.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:36.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-59 /etc/passwd 2024-05-08T17:50:36.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:36.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-60 /etc/passwd 2024-05-08T17:50:36.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:36.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-61 /etc/passwd 2024-05-08T17:50:37.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:37.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-62 /etc/passwd 2024-05-08T17:50:37.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:37.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-63 /etc/passwd 2024-05-08T17:50:37.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:37.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-64 /etc/passwd 2024-05-08T17:50:37.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:37.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-65 /etc/passwd 2024-05-08T17:50:37.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:37.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-66 /etc/passwd 2024-05-08T17:50:37.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:37.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-67 /etc/passwd 2024-05-08T17:50:38.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:38.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-68 /etc/passwd 2024-05-08T17:50:38.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:38.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-69 /etc/passwd 2024-05-08T17:50:38.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:38.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-70 /etc/passwd 2024-05-08T17:50:38.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:38.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-71 /etc/passwd 2024-05-08T17:50:38.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:38.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-72 /etc/passwd 2024-05-08T17:50:39.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:39.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-73 /etc/passwd 2024-05-08T17:50:39.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:39.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-74 /etc/passwd 2024-05-08T17:50:39.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:39.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-75 /etc/passwd 2024-05-08T17:50:39.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:39.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-76 /etc/passwd 2024-05-08T17:50:39.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:39.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-77 /etc/passwd 2024-05-08T17:50:40.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:40.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-78 /etc/passwd 2024-05-08T17:50:40.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:40.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-79 /etc/passwd 2024-05-08T17:50:40.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:40.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-80 /etc/passwd 2024-05-08T17:50:40.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:40.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-81 /etc/passwd 2024-05-08T17:50:40.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:40.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-82 /etc/passwd 2024-05-08T17:50:41.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:41.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-83 /etc/passwd 2024-05-08T17:50:41.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:41.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-84 /etc/passwd 2024-05-08T17:50:41.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:41.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-85 /etc/passwd 2024-05-08T17:50:41.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:41.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-86 /etc/passwd 2024-05-08T17:50:41.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:41.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-87 /etc/passwd 2024-05-08T17:50:42.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:42.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-88 /etc/passwd 2024-05-08T17:50:42.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:42.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-89 /etc/passwd 2024-05-08T17:50:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-90 /etc/passwd 2024-05-08T17:50:42.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:42.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-91 /etc/passwd 2024-05-08T17:50:42.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:42.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-92 /etc/passwd 2024-05-08T17:50:42.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:42.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-93 /etc/passwd 2024-05-08T17:50:43.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:43.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-94 /etc/passwd 2024-05-08T17:50:43.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:43.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-95 /etc/passwd 2024-05-08T17:50:43.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:43.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-96 /etc/passwd 2024-05-08T17:50:43.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:43.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-97 /etc/passwd 2024-05-08T17:50:43.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:43.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-98 /etc/passwd 2024-05-08T17:50:43.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:43.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-99 /etc/passwd 2024-05-08T17:50:44.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:44.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-100 /etc/passwd 2024-05-08T17:50:44.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:44.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-101 /etc/passwd 2024-05-08T17:50:44.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:44.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-102 /etc/passwd 2024-05-08T17:50:44.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:44.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-103 /etc/passwd 2024-05-08T17:50:44.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:44.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-104 /etc/passwd 2024-05-08T17:50:45.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:45.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-105 /etc/passwd 2024-05-08T17:50:45.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:45.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-106 /etc/passwd 2024-05-08T17:50:45.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:45.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-107 /etc/passwd 2024-05-08T17:50:45.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:45.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-108 /etc/passwd 2024-05-08T17:50:45.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:45.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-109 /etc/passwd 2024-05-08T17:50:46.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:46.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-110 /etc/passwd 2024-05-08T17:50:46.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:46.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-111 /etc/passwd 2024-05-08T17:50:46.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:46.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-112 /etc/passwd 2024-05-08T17:50:46.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:46.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-113 /etc/passwd 2024-05-08T17:50:46.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:46.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-114 /etc/passwd 2024-05-08T17:50:46.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:46.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-115 /etc/passwd 2024-05-08T17:50:47.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:47.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-116 /etc/passwd 2024-05-08T17:50:47.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:47.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-117 /etc/passwd 2024-05-08T17:50:47.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:47.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-118 /etc/passwd 2024-05-08T17:50:47.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:47.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-119 /etc/passwd 2024-05-08T17:50:47.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:47.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-120 /etc/passwd 2024-05-08T17:50:48.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:48.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-121 /etc/passwd 2024-05-08T17:50:48.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:48.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-122 /etc/passwd 2024-05-08T17:50:48.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:48.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-123 /etc/passwd 2024-05-08T17:50:48.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:48.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-124 /etc/passwd 2024-05-08T17:50:48.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:48.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-125 /etc/passwd 2024-05-08T17:50:48.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:48.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-126 /etc/passwd 2024-05-08T17:50:49.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:49.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-127 /etc/passwd 2024-05-08T17:50:49.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:49.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-128 /etc/passwd 2024-05-08T17:50:49.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:49.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-129 /etc/passwd 2024-05-08T17:50:49.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:49.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-130 /etc/passwd 2024-05-08T17:50:49.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:49.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-131 /etc/passwd 2024-05-08T17:50:50.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:50.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-132 /etc/passwd 2024-05-08T17:50:50.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:50.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-133 /etc/passwd 2024-05-08T17:50:50.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:50.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-134 /etc/passwd 2024-05-08T17:50:50.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:50.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-135 /etc/passwd 2024-05-08T17:50:50.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:50.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-136 /etc/passwd 2024-05-08T17:50:51.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:51.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-137 /etc/passwd 2024-05-08T17:50:51.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:51.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-138 /etc/passwd 2024-05-08T17:50:51.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:51.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-139 /etc/passwd 2024-05-08T17:50:51.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:51.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-140 /etc/passwd 2024-05-08T17:50:51.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-05-08T17:50:51.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-141 /etc/passwd 2024-05-08T17:50:51.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph pg dump pgs --format=json 2024-05-08T17:50:51.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: jq '.pg_stats[0].up[]' 2024-05-08T17:50:52.346 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:50:52.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph osd out 1 0 2 2024-05-08T17:50:52.886 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2024-05-08T17:50:52.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:69: _common_test: '[' 20 '!=' 0 ']' 2024-05-08T17:50:52.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: seq 1 20 2024-05-08T17:50:52.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:52.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-1 /etc/passwd 2024-05-08T17:50:55.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:55.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-2 /etc/passwd 2024-05-08T17:50:55.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:55.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-3 /etc/passwd 2024-05-08T17:50:56.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:56.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-4 /etc/passwd 2024-05-08T17:50:56.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:56.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-5 /etc/passwd 2024-05-08T17:50:56.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:56.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-6 /etc/passwd 2024-05-08T17:50:57.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:57.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-7 /etc/passwd 2024-05-08T17:50:57.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:57.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-8 /etc/passwd 2024-05-08T17:50:57.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:57.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-9 /etc/passwd 2024-05-08T17:50:58.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:58.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-10 /etc/passwd 2024-05-08T17:50:58.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:58.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-11 /etc/passwd 2024-05-08T17:50:58.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:58.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-12 /etc/passwd 2024-05-08T17:50:59.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:59.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-13 /etc/passwd 2024-05-08T17:50:59.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:59.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-14 /etc/passwd 2024-05-08T17:50:59.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:50:59.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-15 /etc/passwd 2024-05-08T17:51:00.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:51:00.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-16 /etc/passwd 2024-05-08T17:51:00.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:51:00.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-17 /etc/passwd 2024-05-08T17:51:00.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:51:00.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-18 /etc/passwd 2024-05-08T17:51:01.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:51:01.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-19 /etc/passwd 2024-05-08T17:51:01.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-05-08T17:51:01.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-20 /etc/passwd 2024-05-08T17:51:01.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:75: _common_test: sleep 1 2024-05-08T17:51:02.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:76: _common_test: wait_for_clean 2024-05-08T17:51:02.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:51:02.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:51:02.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:51:02.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:51:02.757 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:51:02.757 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:51:02.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:51:02.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:51:02.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:51:02.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:51:02.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:51:02.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:51:02.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:51:02.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:51:02.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:51:03.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:51:03.309 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:51:03.309 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:51:03.310 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:51:03.310 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T17:51:03.310 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T17:51:03.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:51:03.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:03.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:51:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836537 2024-05-08T17:51:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836537 2024-05-08T17:51:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537' 2024-05-08T17:51:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:03.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:51:03.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673010 2024-05-08T17:51:03.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673010 2024-05-08T17:51:03.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673010' 2024-05-08T17:51:03.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:03.724 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:51:03.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509476 2024-05-08T17:51:03.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509476 2024-05-08T17:51:03.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673010 2-64424509476' 2024-05-08T17:51:03.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:03.886 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:51:04.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345948 2024-05-08T17:51:04.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345948 2024-05-08T17:51:04.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673010 2-64424509476 3-85899345948' 2024-05-08T17:51:04.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:04.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:51:04.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182420 2024-05-08T17:51:04.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182420 2024-05-08T17:51:04.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673010 2-64424509476 3-85899345948 4-107374182420' 2024-05-08T17:51:04.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:04.202 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T17:51:04.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018903 2024-05-08T17:51:04.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018903 2024-05-08T17:51:04.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673010 2-64424509476 3-85899345948 4-107374182420 5-128849018903' 2024-05-08T17:51:04.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:04.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836537 2024-05-08T17:51:04.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:04.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:51:04.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836537 2024-05-08T17:51:04.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:04.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836537 2024-05-08T17:51:04.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2024-05-08T17:51:04.359 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836537 2024-05-08T17:51:04.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:51:04.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836537 -lt 21474836537 2024-05-08T17:51:04.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:04.776 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673010 2024-05-08T17:51:04.777 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:04.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:51:04.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:04.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673010 2024-05-08T17:51:04.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673010 2024-05-08T17:51:04.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673010' 2024-05-08T17:51:04.780 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673010 2024-05-08T17:51:04.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:51:05.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673008 -lt 42949673010 2024-05-08T17:51:05.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:51:06.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:51:06.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:51:06.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673010 -lt 42949673010 2024-05-08T17:51:06.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:06.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509476 2024-05-08T17:51:06.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:06.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:51:06.842 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509476 2024-05-08T17:51:06.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:06.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509476 2024-05-08T17:51:06.844 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509476 2024-05-08T17:51:06.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509476' 2024-05-08T17:51:06.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:51:07.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509476 -lt 64424509476 2024-05-08T17:51:07.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:07.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345948 2024-05-08T17:51:07.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:07.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:51:07.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345948 2024-05-08T17:51:07.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:07.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345948 2024-05-08T17:51:07.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345948' 2024-05-08T17:51:07.451 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345948 2024-05-08T17:51:07.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:51:08.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345949 -lt 85899345948 2024-05-08T17:51:08.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:08.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:08.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182420 2024-05-08T17:51:08.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:51:08.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182420 2024-05-08T17:51:08.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:08.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182420 2024-05-08T17:51:08.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182420' 2024-05-08T17:51:08.153 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182420 2024-05-08T17:51:08.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:51:08.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182421 -lt 107374182420 2024-05-08T17:51:08.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:08.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018903 2024-05-08T17:51:08.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:08.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T17:51:08.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018903 2024-05-08T17:51:08.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:08.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018903 2024-05-08T17:51:08.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018903' 2024-05-08T17:51:08.816 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018903 2024-05-08T17:51:08.816 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T17:51:09.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018903 -lt 128849018903 2024-05-08T17:51:09.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:51:09.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:09.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:10.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T17:51:10.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:10.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:10.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:10.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:10.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:10.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:10.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:10.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:10.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:10.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:10.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:11.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:11.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T17:51:11.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:51:11.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T17:51:11.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:11.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:11.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:11.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:11.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:11.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:11.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:11.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:11.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:11.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:11.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:11.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:11.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:11.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:51:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:51:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:51:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:51:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:51:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:51:12.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:51:12.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:51:13.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=56801 2024-05-08T17:51:13.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 56801 '!=' null 2024-05-08T17:51:13.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:51:13.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:13.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:13.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:13.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:13.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:13.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:13.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:13.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:13.222 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:13.222 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:13.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:13.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:13.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:13.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:14.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:51:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:51:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:51:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:51:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:51:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:51:14.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:51:14.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:51:15.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=56801 2024-05-08T17:51:15.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 56801 '!=' null 2024-05-08T17:51:15.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:51:15.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:15.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:15.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:15.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:15.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:15.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:15.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:15.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:15.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:15.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:15.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:15.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:15.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:15.723 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:16.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:16.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:51:16.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:51:16.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:51:16.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:51:16.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:51:16.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:51:16.397 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:51:16.397 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:51:17.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=67960 2024-05-08T17:51:17.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 67960 '!=' null 2024-05-08T17:51:17.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:51:17.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:17.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:17.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:17.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:17.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:17.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:17.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:17.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:17.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:17.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:17.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:17.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:17.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:17.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:18.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:18.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:51:18.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:51:18.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:51:18.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:51:18.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:51:18.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:51:18.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:51:18.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:51:18.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=61874 2024-05-08T17:51:18.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 61874 '!=' null 2024-05-08T17:51:18.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:51:18.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:18.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:18.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:18.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:18.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:18.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:18.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:18.912 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:18.912 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:18.912 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:19.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:19.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:19.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:19.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:19.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:19.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:51:19.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:51:19.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:51:19.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:51:19.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:51:19.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:51:19.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:51:19.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:51:20.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=94333 2024-05-08T17:51:20.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 94333 '!=' null 2024-05-08T17:51:20.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:51:20.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:20.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:20.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:20.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:20.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:20.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:20.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:20.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:20.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:20.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:21.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:21.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:21.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:21.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:21.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:21.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:51:21.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:51:21.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:51:21.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:51:21.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:51:21.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:51:21.895 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:51:21.895 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:51:22.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=75465 2024-05-08T17:51:22.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 75465 '!=' null 2024-05-08T17:51:22.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:51:22.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:22.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:22.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:22.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:22.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:22.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:22.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:22.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:22.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:22.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:23.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:23.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:23.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:23.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:51:23.709 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:51:24.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=48685 2024-05-08T17:51:24.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 48685 '!=' null 2024-05-08T17:51:24.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:51:24.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:24.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:24.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:24.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:24.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:24.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:24.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:24.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:24.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:24.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:24.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:51:24.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:24.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:24.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:25.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:51:25.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:51:25.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:51:25.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:51:25.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:51:25.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:51:25.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:51:25.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:51:25.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:51:25.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=63901 2024-05-08T17:51:25.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 63901 '!=' null 2024-05-08T17:51:25.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:51:25.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:51:25.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:51:26.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:51:26.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:51:26.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:51:26.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:51:26.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:51:26.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:51:26.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:51:26.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:51:26.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:51:26.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:51:26.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:51:26.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:51:27.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T17:51:27.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:51:27.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:51:27.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:78: _common_test: flush_pg_stats 2024-05-08T17:51:27.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:51:27.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:51:27.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:51:27.448 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:51:27.448 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T17:51:27.448 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T17:51:27.448 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T17:51:27.448 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T17:51:27.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:51:27.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:27.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:51:27.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836544 2024-05-08T17:51:27.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836544 2024-05-08T17:51:27.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836544' 2024-05-08T17:51:27.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:27.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:51:27.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673016 2024-05-08T17:51:27.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673016 2024-05-08T17:51:27.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836544 1-42949673016' 2024-05-08T17:51:27.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:27.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:51:27.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509483 2024-05-08T17:51:27.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509483 2024-05-08T17:51:27.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836544 1-42949673016 2-64424509483' 2024-05-08T17:51:27.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:27.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T17:51:28.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345955 2024-05-08T17:51:28.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345955 2024-05-08T17:51:28.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836544 1-42949673016 2-64424509483 3-85899345955' 2024-05-08T17:51:28.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:28.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T17:51:28.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182427 2024-05-08T17:51:28.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182427 2024-05-08T17:51:28.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836544 1-42949673016 2-64424509483 3-85899345955 4-107374182427' 2024-05-08T17:51:28.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:51:28.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T17:51:28.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018909 2024-05-08T17:51:28.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018909 2024-05-08T17:51:28.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836544 1-42949673016 2-64424509483 3-85899345955 4-107374182427 5-128849018909' 2024-05-08T17:51:28.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:28.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836544 2024-05-08T17:51:28.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:28.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:51:28.348 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836544 2024-05-08T17:51:28.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:28.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836544 2024-05-08T17:51:28.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836544' 2024-05-08T17:51:28.350 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836544 2024-05-08T17:51:28.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:51:28.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836544 -lt 21474836544 2024-05-08T17:51:28.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:28.755 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673016 2024-05-08T17:51:28.755 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:28.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:51:28.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673016 2024-05-08T17:51:28.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:28.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673016 2024-05-08T17:51:28.758 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673016 2024-05-08T17:51:28.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673016' 2024-05-08T17:51:28.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:51:29.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673014 -lt 42949673016 2024-05-08T17:51:29.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:51:30.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:51:30.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:51:30.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673017 -lt 42949673016 2024-05-08T17:51:30.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:30.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509483 2024-05-08T17:51:30.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:30.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:51:30.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:30.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509483 2024-05-08T17:51:30.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509483 2024-05-08T17:51:30.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509483' 2024-05-08T17:51:30.596 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509483 2024-05-08T17:51:30.597 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:51:31.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509483 -lt 64424509483 2024-05-08T17:51:31.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:31.043 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345955 2024-05-08T17:51:31.043 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:31.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T17:51:31.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345955 2024-05-08T17:51:31.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:31.047 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345955 2024-05-08T17:51:31.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345955 2024-05-08T17:51:31.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345955' 2024-05-08T17:51:31.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T17:51:31.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345955 -lt 85899345955 2024-05-08T17:51:31.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:31.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182427 2024-05-08T17:51:31.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:31.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T17:51:31.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182427 2024-05-08T17:51:31.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:31.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182427 2024-05-08T17:51:31.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182427' 2024-05-08T17:51:31.495 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182427 2024-05-08T17:51:31.495 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T17:51:31.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182428 -lt 107374182427 2024-05-08T17:51:31.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:51:31.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018909 2024-05-08T17:51:31.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:51:31.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T17:51:31.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018909 2024-05-08T17:51:31.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:51:31.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018909 2024-05-08T17:51:31.952 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018909 2024-05-08T17:51:31.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018909' 2024-05-08T17:51:31.952 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T17:51:32.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018910 -lt 128849018909 2024-05-08T17:51:32.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: ceph pg dump pgs --format=json 2024-05-08T17:51:32.408 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: jq '.pg_stats[0].up_primary' 2024-05-08T17:51:32.819 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T17:51:32.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: newprimary=4 2024-05-08T17:51:32.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:81: _common_test: kill_daemons 2024-05-08T17:51:32.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:51:32.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:51:32.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:51:32.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:51:32.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:51:38.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:51:38.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:83: _common_test: ERRORS=0 2024-05-08T17:51:38.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2024-05-08T17:51:38.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:51:38.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T17:51:38.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=4 2024-05-08T17:51:38.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T17:51:38.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2024-05-08T17:51:38.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: tee td/osd-backfill-recovery-log/result.log 2024-05-08T17:51:38.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2024-05-08T17:51:39.443 INFO:tasks.workunit.client.0.smithi117.stdout:{ 2024-05-08T17:51:39.443 INFO:tasks.workunit.client.0.smithi117.stdout: "pg_log_t": { 2024-05-08T17:51:39.443 INFO:tasks.workunit.client.0.smithi117.stdout: "head": "37'161", 2024-05-08T17:51:39.443 INFO:tasks.workunit.client.0.smithi117.stdout: "tail": "34'10", 2024-05-08T17:51:39.443 INFO:tasks.workunit.client.0.smithi117.stdout: "log": [ 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1e6eca61:::obj-11:head", 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'11", 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4421.0:1", 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:27.792121+0000", 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.444 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:18dee445:::obj-12:head", 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'12", 2024-05-08T17:51:39.445 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4424.0:1", 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:27.985166+0000", 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.446 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:283c5c90:::obj-13:head", 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'13", 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4427.0:1", 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:28.169118+0000", 2024-05-08T17:51:39.447 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.448 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:cc896bf0:::obj-14:head", 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'14", 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4430.0:1", 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:28.377065+0000", 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.449 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:a581f807:::obj-15:head", 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'15", 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4433.0:1", 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:28.555332+0000", 2024-05-08T17:51:39.450 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.451 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c902ca7c:::obj-16:head", 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'16", 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4436.0:1", 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:28.721485+0000", 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.452 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:655283c8:::obj-17:head", 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'17", 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.453 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4439.0:1", 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:28.930707+0000", 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.454 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:d759d762:::obj-18:head", 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'18", 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4442.0:1", 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:29.097221+0000", 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.455 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1b934a2d:::obj-19:head", 2024-05-08T17:51:39.456 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'19", 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4445.0:1", 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:29.282546+0000", 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.457 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.458 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.458 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.459 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.459 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.459 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.459 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.459 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1d0ea2ca:::obj-20:head", 2024-05-08T17:51:39.459 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'20", 2024-05-08T17:51:39.459 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4448.0:1", 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:29.467198+0000", 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.460 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ab396690:::obj-21:head", 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'21", 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4451.0:1", 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:29.650692+0000", 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.461 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.462 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:254983db:::obj-22:head", 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'22", 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4454.0:1", 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:29.859798+0000", 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.463 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:e656299f:::obj-23:head", 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'23", 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4457.0:1", 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:30.035698+0000", 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.464 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:5cdf412b:::obj-24:head", 2024-05-08T17:51:39.465 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'24", 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4460.0:1", 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:30.243340+0000", 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.466 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:cacae143:::obj-25:head", 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'25", 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4463.0:1", 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:30.438252+0000", 2024-05-08T17:51:39.467 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.468 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:34b5bff6:::obj-26:head", 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'26", 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4466.0:1", 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:30.632365+0000", 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.469 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:a354f8f6:::obj-27:head", 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'27", 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4469.0:1", 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:30.799037+0000", 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.470 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.471 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:7421db49:::obj-28:head", 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'28", 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4472.0:1", 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:30.967080+0000", 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.472 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:54bc79ba:::obj-29:head", 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'29", 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4475.0:1", 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.473 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:31.141305+0000", 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.474 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:01b15595:::obj-30:head", 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'30", 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4478.0:1", 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:31.318213+0000", 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.475 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:f9a0a8a2:::obj-31:head", 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'31", 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.476 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4481.0:1", 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:31.494173+0000", 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.477 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1bf2562f:::obj-32:head", 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'32", 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4484.0:1", 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:31.677877+0000", 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.478 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:b982ae22:::obj-33:head", 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'33", 2024-05-08T17:51:39.479 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4487.0:1", 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:31.894294+0000", 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.480 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1ad9f98e:::obj-34:head", 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'34", 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4490.0:1", 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:32.072220+0000", 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.481 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:941f43ff:::obj-35:head", 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'35", 2024-05-08T17:51:39.482 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4493.0:1", 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:32.265381+0000", 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.483 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:24ebabe9:::obj-36:head", 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'36", 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4496.0:1", 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:32.470820+0000", 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.484 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:5f3a5398:::obj-37:head", 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'37", 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.485 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4499.0:1", 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:32.647729+0000", 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.486 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c96cb37e:::obj-38:head", 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'38", 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4502.0:1", 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:32.824780+0000", 2024-05-08T17:51:39.487 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.488 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:69e36996:::obj-39:head", 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'39", 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4505.0:1", 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:33.001665+0000", 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.489 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:9f75773e:::obj-40:head", 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'40", 2024-05-08T17:51:39.490 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4508.0:1", 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:33.168421+0000", 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.491 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:2c01cd48:::obj-41:head", 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'41", 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4511.0:1", 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:33.359417+0000", 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.492 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:5e676e3d:::obj-42:head", 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'42", 2024-05-08T17:51:39.493 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4514.0:1", 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:33.537361+0000", 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.494 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1215f697:::obj-43:head", 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'43", 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4517.0:1", 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:33.710076+0000", 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.495 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:3a0aa357:::obj-44:head", 2024-05-08T17:51:39.496 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'44", 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4520.0:1", 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:33.913872+0000", 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.497 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:6366950a:::obj-45:head", 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'45", 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4523.0:1", 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:34.090559+0000", 2024-05-08T17:51:39.498 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.499 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:621cb2b3:::obj-46:head", 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'46", 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4526.0:1", 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:34.263415+0000", 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.500 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:d83ab3cd:::obj-47:head", 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'47", 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4529.0:1", 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:34.440861+0000", 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.501 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.502 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:3d8e6d4a:::obj-48:head", 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'48", 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4532.0:1", 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:34.608155+0000", 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.503 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:50b1e2f2:::obj-49:head", 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'49", 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4535.0:1", 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:34.773870+0000", 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.504 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.505 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c75430e6:::obj-50:head", 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'50", 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4538.0:1", 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:34.960054+0000", 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.506 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:eaf3ca0a:::obj-51:head", 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'51", 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4541.0:1", 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:35.136365+0000", 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.507 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.508 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:86a15bea:::obj-52:head", 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'52", 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4544.0:1", 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:35.310585+0000", 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.509 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1df15dae:::obj-53:head", 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'53", 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4547.0:1", 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.510 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:35.495119+0000", 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.511 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:29304dc8:::obj-54:head", 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'54", 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4550.0:1", 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:35.671475+0000", 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.512 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:de02c26d:::obj-55:head", 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'55", 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4553.0:1", 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:35.855192+0000", 2024-05-08T17:51:39.513 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.514 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:0d36fc08:::obj-56:head", 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'56", 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4556.0:1", 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:36.048684+0000", 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.515 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:2b2cbcba:::obj-57:head", 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'57", 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4559.0:1", 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.516 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:36.249117+0000", 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.517 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:838be76e:::obj-58:head", 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'58", 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4562.0:1", 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:36.425735+0000", 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.518 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:2c66fd6f:::obj-59:head", 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'59", 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4565.0:1", 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:36.601799+0000", 2024-05-08T17:51:39.519 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.520 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:2b18273b:::obj-60:head", 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'60", 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4568.0:1", 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:36.777225+0000", 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.521 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:fcfa3cd1:::obj-61:head", 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'61", 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4571.0:1", 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.522 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:36.953707+0000", 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.523 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:16e51a68:::obj-62:head", 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'62", 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4574.0:1", 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:37.136896+0000", 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.524 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c15678fc:::obj-63:head", 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'63", 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4577.0:1", 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:37.313128+0000", 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.525 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.526 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:e066252d:::obj-64:head", 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'64", 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4580.0:1", 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:37.479908+0000", 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.527 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:95a4ceaf:::obj-65:head", 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'65", 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4583.0:1", 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.528 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:37.656049+0000", 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.529 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:6e97b31a:::obj-66:head", 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'66", 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4586.0:1", 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:37.856409+0000", 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.530 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ceed8b4e:::obj-67:head", 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'67", 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4589.0:1", 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.531 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:38.040595+0000", 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.532 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:05e2e722:::obj-68:head", 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'68", 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4592.0:1", 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:38.237739+0000", 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.533 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c40f7de9:::obj-69:head", 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'69", 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4595.0:1", 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.534 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:38.402095+0000", 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.535 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:7bab3581:::obj-70:head", 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'70", 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4598.0:1", 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:38.587009+0000", 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.536 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:cb9edc4f:::obj-71:head", 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'71", 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4601.0:1", 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:38.761116+0000", 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.537 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.538 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:88ae729f:::obj-72:head", 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'72", 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4604.0:1", 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:38.940419+0000", 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.539 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:887b5de4:::obj-73:head", 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'73", 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4607.0:1", 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:39.287036+0000", 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.540 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.541 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:996efeaa:::obj-74:head", 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'74", 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4610.0:1", 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:39.464294+0000", 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.542 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:942222a0:::obj-75:head", 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'75", 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4613.0:1", 2024-05-08T17:51:39.543 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:39.657126+0000", 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.544 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:35f0499f:::obj-76:head", 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'76", 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4616.0:1", 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:39.858780+0000", 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.545 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:15cd38e3:::obj-77:head", 2024-05-08T17:51:39.546 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'77", 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4619.0:1", 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:40.026638+0000", 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.547 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:7adeb77b:::obj-78:head", 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'78", 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4622.0:1", 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:40.199097+0000", 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.548 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c92176ea:::obj-79:head", 2024-05-08T17:51:39.549 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'79", 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4625.0:1", 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:40.418678+0000", 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.550 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:14abac33:::obj-80:head", 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'80", 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4628.0:1", 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:40.621353+0000", 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.551 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.552 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ea1005df:::obj-81:head", 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'81", 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4631.0:1", 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:40.795443+0000", 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.553 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:df18954d:::obj-82:head", 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'82", 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4634.0:1", 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:40.962426+0000", 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.554 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:cdd3834b:::obj-83:head", 2024-05-08T17:51:39.555 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'83", 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4637.0:1", 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:41.138991+0000", 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.556 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:dfbf520a:::obj-84:head", 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'84", 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4640.0:1", 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:41.323005+0000", 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.557 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1dd3df2f:::obj-85:head", 2024-05-08T17:51:39.558 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'85", 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4643.0:1", 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:41.507610+0000", 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.559 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:54554b77:::obj-86:head", 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'86", 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4646.0:1", 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:41.683833+0000", 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.560 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:43a48f98:::obj-87:head", 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'87", 2024-05-08T17:51:39.561 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4649.0:1", 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:41.868029+0000", 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.562 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:3f7b3ecc:::obj-88:head", 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'88", 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4652.0:1", 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:42.051718+0000", 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.563 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.564 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:d25ef7d2:::obj-89:head", 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'89", 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4655.0:1", 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:42.242338+0000", 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.565 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ea27d688:::obj-90:head", 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'90", 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4658.0:1", 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:42.404578+0000", 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.566 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.567 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:088f9d12:::obj-91:head", 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'91", 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4661.0:1", 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:42.579271+0000", 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.568 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:206f25a5:::obj-92:head", 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'92", 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4664.0:1", 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:42.755710+0000", 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.569 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:501cca61:::obj-93:head", 2024-05-08T17:51:39.570 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'93", 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4667.0:1", 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:42.930922+0000", 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.571 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1ed468c0:::obj-94:head", 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'94", 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4670.0:1", 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:43.116338+0000", 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.572 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:e8cba918:::obj-95:head", 2024-05-08T17:51:39.573 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'95", 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4673.0:1", 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:43.291242+0000", 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.574 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:403c3dfc:::obj-96:head", 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'96", 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4676.0:1", 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:43.466872+0000", 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.575 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:7c2d0cb1:::obj-97:head", 2024-05-08T17:51:39.576 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'97", 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4679.0:1", 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:43.651541+0000", 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.577 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:6f3e26a7:::obj-98:head", 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'98", 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4682.0:1", 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:43.854130+0000", 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.578 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.579 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:a4b22c6a:::obj-99:head", 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'99", 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4685.0:1", 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:44.029214+0000", 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.580 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:25c09ea8:::obj-100:head", 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'100", 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4688.0:1", 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:44.202849+0000", 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.581 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.582 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:be8b0193:::obj-101:head", 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'101", 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4691.0:1", 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:44.487722+0000", 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.583 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:6aa5e219:::obj-102:head", 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'102", 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4694.0:1", 2024-05-08T17:51:39.584 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:44.664746+0000", 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.585 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ff8cd32f:::obj-103:head", 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'103", 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4697.0:1", 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:44.848297+0000", 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.586 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:fcaf5c1c:::obj-104:head", 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'104", 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.587 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4700.0:1", 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:45.041734+0000", 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.588 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:2111aa60:::obj-105:head", 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'105", 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4703.0:1", 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:45.225830+0000", 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.589 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:9fed4eb7:::obj-106:head", 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'106", 2024-05-08T17:51:39.590 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4706.0:1", 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:45.409320+0000", 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.591 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:0b0c0bce:::obj-107:head", 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'107", 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4709.0:1", 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:45.576754+0000", 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.592 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:b7ce613a:::obj-108:head", 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'108", 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.593 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4712.0:1", 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:45.745657+0000", 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.594 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:4f32cd61:::obj-109:head", 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'109", 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4715.0:1", 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:45.903134+0000", 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.595 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:40f97f88:::obj-110:head", 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'110", 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4718.0:1", 2024-05-08T17:51:39.596 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:46.070415+0000", 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.597 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:1d8e7a62:::obj-111:head", 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'111", 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4721.0:1", 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:46.247207+0000", 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.598 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:3a283967:::obj-112:head", 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'112", 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4724.0:1", 2024-05-08T17:51:39.599 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:46.422594+0000", 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.600 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:2acdc9e7:::obj-113:head", 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'113", 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4727.0:1", 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:46.606526+0000", 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.601 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:7f18a9ad:::obj-114:head", 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'114", 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.602 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4730.0:1", 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:46.791146+0000", 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.603 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:852b8a34:::obj-115:head", 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'115", 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4733.0:1", 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:46.973364+0000", 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.604 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:589de4f7:::obj-116:head", 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'116", 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.605 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4736.0:1", 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:47.153029+0000", 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.606 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:14f2571c:::obj-117:head", 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'117", 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4739.0:1", 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:47.329562+0000", 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.607 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:dd36f0e5:::obj-118:head", 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'118", 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4742.0:1", 2024-05-08T17:51:39.608 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:47.511150+0000", 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.609 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:0d7fa432:::obj-119:head", 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'119", 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4745.0:1", 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:47.678413+0000", 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.610 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:295ec31a:::obj-120:head", 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'120", 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4748.0:1", 2024-05-08T17:51:39.611 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:47.870838+0000", 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.612 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c2863561:::obj-121:head", 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'121", 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4751.0:1", 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:48.055022+0000", 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.613 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:0b943493:::obj-122:head", 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'122", 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4754.0:1", 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.614 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:48.245524+0000", 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.615 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:4cfecbf8:::obj-123:head", 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'123", 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4757.0:1", 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:48.425877+0000", 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.616 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:fd18e511:::obj-124:head", 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'124", 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4760.0:1", 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:48.610655+0000", 2024-05-08T17:51:39.617 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.618 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:4f299322:::obj-125:head", 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'125", 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4763.0:1", 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:48.777261+0000", 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.619 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:302ecc7e:::obj-126:head", 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'126", 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4766.0:1", 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:48.943734+0000", 2024-05-08T17:51:39.620 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.621 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:42feb657:::obj-127:head", 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'127", 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4769.0:1", 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:49.118753+0000", 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.622 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:5e6b9a81:::obj-128:head", 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'128", 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4772.0:1", 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.623 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:49.321350+0000", 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.624 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:0d242242:::obj-129:head", 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'129", 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4775.0:1", 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:49.554682+0000", 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.625 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ed409294:::obj-130:head", 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'130", 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4778.0:1", 2024-05-08T17:51:39.626 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:49.752666+0000", 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.627 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:720761ff:::obj-131:head", 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'131", 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4781.0:1", 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:49.923177+0000", 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.628 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:7715ee72:::obj-132:head", 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'132", 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4784.0:1", 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.629 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:50.096175+0000", 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.630 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:580938e3:::obj-133:head", 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'133", 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4787.0:1", 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:50.335036+0000", 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.631 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:05dc98b5:::obj-134:head", 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'134", 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4790.0:1", 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.632 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:50.535384+0000", 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.633 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:73221e51:::obj-135:head", 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'135", 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4793.0:1", 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:50.710283+0000", 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.634 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:3a97ede2:::obj-136:head", 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'136", 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4796.0:1", 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:50.901777+0000", 2024-05-08T17:51:39.635 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.636 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:9e95a205:::obj-137:head", 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'137", 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4799.0:1", 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:51.086320+0000", 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.637 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:27f846bd:::obj-138:head", 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'138", 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.638 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4802.0:1", 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:51.254612+0000", 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.639 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:bb2f7605:::obj-139:head", 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'139", 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4805.0:1", 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:51.430702+0000", 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.640 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:27668d5f:::obj-140:head", 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'140", 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4808.0:1", 2024-05-08T17:51:39.641 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:51.605105+0000", 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.642 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:0d70cb86:::obj-141:head", 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'141", 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4811.0:1", 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:51.784365+0000", 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.643 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:347b39b5:::obj-more-1:head", 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'142", 2024-05-08T17:51:39.644 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4818.0:1", 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:52.984955+0000", 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.645 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:0c63cc63:::obj-more-2:head", 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'143", 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4821.0:1", 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:55.556509+0000", 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.646 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:3ce69b57:::obj-more-3:head", 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'144", 2024-05-08T17:51:39.647 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4824.0:1", 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:55.900513+0000", 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.648 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:50476200:::obj-more-4:head", 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'145", 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4827.0:1", 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:56.268561+0000", 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.649 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:7a39cfd8:::obj-more-5:head", 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'146", 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.650 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4830.0:1", 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:56.644949+0000", 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.651 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:a7159f95:::obj-more-6:head", 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'147", 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4833.0:1", 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:56.915957+0000", 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.652 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:37f29f5f:::obj-more-7:head", 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'148", 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4836.0:1", 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.653 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:57.240612+0000", 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.654 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:4e4836c1:::obj-more-8:head", 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'149", 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4839.0:1", 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:57.551720+0000", 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.655 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:d56cad57:::obj-more-9:head", 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'150", 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4842.0:1", 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.656 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:57.871320+0000", 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.657 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:96ff4b77:::obj-more-10:head", 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'151", 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4845.0:1", 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:58.305350+0000", 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.658 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:b8937ca5:::obj-more-11:head", 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'152", 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.659 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4848.0:1", 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:58.568920+0000", 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.660 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:c949902e:::obj-more-12:head", 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'153", 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4851.0:1", 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:58.858905+0000", 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.661 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:4909985f:::obj-more-13:head", 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'154", 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.662 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4854.0:1", 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:59.168461+0000", 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.663 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:acf906ce:::obj-more-14:head", 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'155", 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4857.0:1", 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:59.481749+0000", 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.664 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:44d31ae5:::obj-more-15:head", 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'156", 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4860.0:1", 2024-05-08T17:51:39.665 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:50:59.821761+0000", 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.666 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:54dfd3e0:::obj-more-16:head", 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'157", 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4863.0:1", 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:51:00.220547+0000", 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.667 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:6a7dcd50:::obj-more-17:head", 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'158", 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.668 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4866.0:1", 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:51:00.548926+0000", 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.669 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:fb20876f:::obj-more-18:head", 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'159", 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4869.0:1", 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:51:00.886453+0000", 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.670 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.671 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.672 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:ed63ae36:::obj-more-19:head", 2024-05-08T17:51:39.672 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'160", 2024-05-08T17:51:39.672 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.966 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4872.0:1", 2024-05-08T17:51:39.966 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.966 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:51:01.208161+0000", 2024-05-08T17:51:39.966 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.967 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "op": "modify", 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "object": "1:6a8a392a:::obj-more-20:head", 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "37'161", 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "prior_version": "0'0", 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4875.0:1", 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "extra_reqids": [], 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "mtime": "2024-05-08T17:51:01.501220+0000", 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": 0, 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "mod_desc": { 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "object_mod_desc": { 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "can_local_rollback": false, 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "rollback_info_completed": false, 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "ops": [] 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.968 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_regions": { 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "object_clean_regions": { 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_offsets": "[12174~18446744073709539441]", 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "clean_omap": true, 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "new_object": false 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: ], 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "dups": [ 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4391.0:1", 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "33'1", 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "1", 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.969 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4394.0:1", 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'2", 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "2", 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4397.0:1", 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'3", 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "3", 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4400.0:1", 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'4", 2024-05-08T17:51:39.970 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "4", 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4403.0:1", 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'5", 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "5", 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4406.0:1", 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'6", 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "6", 2024-05-08T17:51:39.971 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4409.0:1", 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'7", 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "7", 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4412.0:1", 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'8", 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "8", 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4415.0:1", 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'9", 2024-05-08T17:51:39.972 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "9", 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: { 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: "reqid": "client.4418.0:1", 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: "version": "34'10", 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: "user_version": "10", 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: "return_code": "0" 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: ] 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: }, 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: "pg_missing_t": { 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: "missing": [], 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: "may_include_deletes": true 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout: } 2024-05-08T17:51:39.973 INFO:tasks.workunit.client.0.smithi117.stdout:} 2024-05-08T17:51:39.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2024-05-08T17:51:40.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: LOGLEN=151 2024-05-08T17:51:40.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:86: _common_test: '[' 151 '!=' 151 ']' 2024-05-08T17:51:40.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2024-05-08T17:51:40.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: DUPSLEN=10 2024-05-08T17:51:40.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:91: _common_test: '[' 10 '!=' 10 ']' 2024-05-08T17:51:40.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:95: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'141 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'140 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'139 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'138 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'137 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'136 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'135 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'134 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'133 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'132 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'131 2024-05-08T17:51:40.060 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'130 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'129 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'128 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'127 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'126 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'125 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'124 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'123 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'122 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'121 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'120 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'119 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'118 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'117 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'116 2024-05-08T17:51:40.061 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'115 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'114 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'113 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'112 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'111 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'110 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'109 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'108 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'107 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'106 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'105 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'104 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'103 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'102 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'101 2024-05-08T17:51:40.062 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'100 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'99 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'98 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'97 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'96 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'95 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'94 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'93 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'92 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'91 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'90 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'89 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'88 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'87 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'86 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'85 2024-05-08T17:51:40.063 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'84 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'83 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'82 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'81 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'80 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'79 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'78 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'77 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'76 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'75 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'74 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'73 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'72 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'71 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'70 2024-05-08T17:51:40.064 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'69 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'68 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'67 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'66 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'65 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'64 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'63 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'62 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'61 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'60 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'59 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'58 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'57 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'56 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'55 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'54 2024-05-08T17:51:40.065 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'53 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'52 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'51 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'50 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'49 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'48 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'47 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'46 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'45 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'44 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'43 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'42 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'41 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'40 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'39 2024-05-08T17:51:40.066 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'38 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'37 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'36 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'35 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'34 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'33 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'32 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'31 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'30 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'29 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'28 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'27 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'26 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'25 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'24 2024-05-08T17:51:40.067 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'23 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'22 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'21 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'20 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'19 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'18 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'17 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'16 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'15 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'14 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'13 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'12 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'11 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'10 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'9 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'8 2024-05-08T17:51:40.068 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'7 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'6 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'5 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'4 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'3 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'2 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 33'1 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'141 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'140 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'139 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'138 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'137 2024-05-08T17:51:40.069 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'136 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'135 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'134 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'133 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'132 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'131 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'130 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'129 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'128 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'127 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'126 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'125 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'124 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'123 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'122 2024-05-08T17:51:40.070 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'121 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'120 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'119 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'118 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'117 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'116 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'115 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'114 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'113 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'112 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'111 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'110 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'109 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'108 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'107 2024-05-08T17:51:40.071 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'106 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'105 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'104 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'103 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'102 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'101 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'100 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'99 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'98 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'97 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'96 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'95 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'94 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'93 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'92 2024-05-08T17:51:40.072 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'91 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'90 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'89 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'88 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'87 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'86 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'85 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'84 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'83 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'82 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'81 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'80 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'79 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'78 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'77 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'76 2024-05-08T17:51:40.073 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'75 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'74 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'73 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'72 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'71 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'70 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'69 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'68 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'67 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'66 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'65 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'64 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'63 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'62 2024-05-08T17:51:40.074 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'61 2024-05-08T17:51:40.075 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'60 2024-05-08T17:51:40.075 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'59 2024-05-08T17:51:40.075 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'58 2024-05-08T17:51:40.077 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'57 2024-05-08T17:51:40.077 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'56 2024-05-08T17:51:40.077 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'55 2024-05-08T17:51:40.077 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'54 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'53 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'52 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'51 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'50 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'49 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'48 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'47 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'46 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'45 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'44 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'43 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'42 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'41 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'40 2024-05-08T17:51:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'39 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'38 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'37 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'36 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'35 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'34 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'33 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'32 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'31 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'30 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'29 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'28 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'27 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'26 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'25 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'24 2024-05-08T17:51:40.079 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'23 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'22 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'21 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'20 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'19 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'18 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'17 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'16 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'15 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'14 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'13 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'12 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'11 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'10 2024-05-08T17:51:40.080 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'9 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'8 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'7 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'6 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'5 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'4 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'3 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'2 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 33'1 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'141 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'140 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'139 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'138 2024-05-08T17:51:40.081 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'137 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'136 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'135 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'134 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'133 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'132 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'131 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'130 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'129 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'128 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'127 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'126 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'125 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'124 2024-05-08T17:51:40.082 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'123 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'122 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'121 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'120 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'119 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'118 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'117 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'116 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'115 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'114 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'113 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'112 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'111 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'110 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'109 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'108 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'107 2024-05-08T17:51:40.083 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'106 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'105 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'104 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'103 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'102 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'101 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'100 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'99 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'98 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'97 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'96 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'95 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'94 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'93 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'92 2024-05-08T17:51:40.084 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'91 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'90 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'89 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'88 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'87 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'86 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'85 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'84 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'83 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'82 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'81 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'80 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'79 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'78 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'77 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'76 2024-05-08T17:51:40.085 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'75 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'74 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'73 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'72 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'71 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'70 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'69 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'68 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'67 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'66 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'65 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'64 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'63 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'62 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'61 2024-05-08T17:51:40.086 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'60 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'59 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'58 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'57 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'56 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'55 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'54 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.272+0000 7ff1096f0640 20 copy_after copy log version 34'53 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'52 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'51 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'50 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'49 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'48 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'47 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'46 2024-05-08T17:51:40.087 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'45 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'44 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'43 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'42 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'41 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'40 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'39 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'38 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'37 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'36 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'35 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'34 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'33 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'32 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'31 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'30 2024-05-08T17:51:40.088 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'29 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'28 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'27 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'26 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'25 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'24 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'23 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'22 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'21 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'20 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'19 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'18 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'17 2024-05-08T17:51:40.089 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'16 2024-05-08T17:51:40.090 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'15 2024-05-08T17:51:40.090 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'14 2024-05-08T17:51:40.090 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'13 2024-05-08T17:51:40.090 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'12 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'11 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'10 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'9 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'8 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'7 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'6 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'5 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'4 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'3 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 34'2 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after copy log version 33'1 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:50:54.276+0000 7ff1096f0640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_after v 37'161 dups.size()=0 other.dups.size()=10 2024-05-08T17:51:40.091 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 33'1 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'2 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'3 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'4 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'5 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'6 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'7 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'8 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'9 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup version 34'10 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'11 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'12 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'13 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'14 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'15 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'16 2024-05-08T17:51:40.092 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'17 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'18 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'19 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'20 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'21 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'22 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'23 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'24 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'25 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'26 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'27 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'28 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'29 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'30 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'31 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'32 2024-05-08T17:51:40.093 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'33 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'34 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'35 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'36 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'37 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'38 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'39 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'40 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'41 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'42 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'43 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'44 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'45 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'46 2024-05-08T17:51:40.094 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'47 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'48 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'49 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'50 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'51 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'52 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'53 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'54 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'55 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'56 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'57 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'58 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'59 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'60 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'61 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'62 2024-05-08T17:51:40.095 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'63 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'64 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'65 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'66 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'67 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'68 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'69 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'70 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'71 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'72 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'73 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'74 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'75 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'76 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'77 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'78 2024-05-08T17:51:40.096 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'79 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'80 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'81 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'82 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'83 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'84 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'85 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'86 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'87 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'88 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'89 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'90 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'91 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'92 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'93 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'94 2024-05-08T17:51:40.097 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'95 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'96 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'97 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'98 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'99 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'100 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'101 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'102 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'103 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'104 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'105 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'106 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'107 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'108 2024-05-08T17:51:40.098 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'109 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'110 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'111 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'112 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'113 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'114 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'115 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'116 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'117 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'118 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'119 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'120 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'121 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'122 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'123 2024-05-08T17:51:40.099 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'124 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'125 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'126 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'127 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'128 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'129 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'130 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'131 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'132 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'133 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'134 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'135 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'136 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'137 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'138 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'139 2024-05-08T17:51:40.100 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'140 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'142 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'143 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'144 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'145 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'146 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'147 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'148 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'149 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'150 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'151 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'152 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'153 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'154 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'155 2024-05-08T17:51:40.101 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'156 2024-05-08T17:51:40.102 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'157 2024-05-08T17:51:40.102 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'158 2024-05-08T17:51:40.102 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'159 2024-05-08T17:51:40.102 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'160 2024-05-08T17:51:40.102 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_up_to/copy_after copy dup from log version 37'161 2024-05-08T17:51:40.102 INFO:tasks.workunit.client.0.smithi117.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-05-08T17:51:21.475+0000 7ff1096f0640 20 copy_after END v 37'161 dups.size()=161 other.dups.size()=10 2024-05-08T17:51:40.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:96: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2024-05-08T17:51:40.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:97: _common_test: '[' 0 '!=' 0 ']' 2024-05-08T17:51:40.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:35: run: teardown td/osd-backfill-recovery-log 2024-05-08T17:51:40.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:51:40.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:51:40.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:51:40.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:51:40.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:51:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:51:40.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:51:40.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:51:40.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:40.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:51:40.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2314: main: code=0 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: teardown td/osd-backfill-recovery-log 0 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-recovery-log 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:51:40.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:51:40.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:51:40.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:51:40.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:51:40.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:51:40.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:51:40.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:51:40.148 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:51:40.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:51:40.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:51:40.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:51:40.149 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:51:40.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:51:40.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2024-05-08T17:51:40.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-recovery-log 2024-05-08T17:51:40.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:51:40.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:40.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.47083 2024-05-08T17:51:40.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.47083 2024-05-08T17:51:40.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:51:40.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:51:40.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2319: main: return 0 2024-05-08T17:51:40.153 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T17:51:40.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T17:51:40.163 INFO:tasks.workunit:Running workunit osd-backfill/osd-backfill-space.sh... 2024-05-08T17:51:40.163 DEBUG:teuthology.orchestra.run.smithi117:workunit test osd-backfill/osd-backfill-space.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=95a4ad3c90f2f12f920e87725ad8d9002f948722 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh 2024-05-08T17:51:40.217 INFO:tasks.workunit.client.0.smithi117.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-05-08T17:51:40.223 INFO:tasks.workunit.client.0.smithi117.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2307: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2307: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2308: main: export PYTHONWARNINGS=ignore 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2308: main: PYTHONWARNINGS=ignore 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2309: main: export CEPH_CONF=/dev/null 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2309: main: CEPH_CONF=/dev/null 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2310: main: unset CEPH_ARGS 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2312: main: local code 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2313: main: run td/osd-backfill-space 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:21: run: local dir=td/osd-backfill-space 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:22: run: shift 2024-05-08T17:51:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:24: run: export CEPH_MON=127.0.0.1:7180 2024-05-08T17:51:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:24: run: CEPH_MON=127.0.0.1:7180 2024-05-08T17:51:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:25: run: export CEPH_ARGS 2024-05-08T17:51:40.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:26: run: uuidgen 2024-05-08T17:51:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:26: run: CEPH_ARGS+='--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none ' 2024-05-08T17:51:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7180 ' 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:28: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:29: run: CEPH_ARGS+='--fake_statfs_for_testing=3686400 ' 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:30: run: CEPH_ARGS+='--osd_max_backfills=10 ' 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:31: run: CEPH_ARGS+='--osd_mclock_override_recovery_settings=true ' 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:32: run: export objects=600 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:32: run: objects=600 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:33: run: export poolprefix=test 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:33: run: poolprefix=test 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:35: run: set 2024-05-08T17:51:40.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:35: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:35: run: local 'funcs=TEST_backfill_grow 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_multi_partial 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_test_multi 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_test_sametarget 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_test_simple 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_ec_backfill_grow 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_ec_backfill_multi 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_ec_backfill_simple' 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-05-08T17:51:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:51:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:51:40.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:51:40.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:51:40.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:51:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:51:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:51:40.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:51:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:51:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:51:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:51:40.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:51:40.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:51:40.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:51:40.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T17:51:40.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:51:40.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:40.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:51:40.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T17:51:40.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:51:40.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:51:40.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2024-05-08T17:51:40.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T17:51:40.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:40.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:51:40.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.109971 2024-05-08T17:51:40.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T17:51:40.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2024-05-08T17:51:40.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_grow td/osd-backfill-space 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:558: TEST_backfill_grow: local dir=td/osd-backfill-space 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:559: TEST_backfill_grow: local poolname=test 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:560: TEST_backfill_grow: local OSDS=3 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:562: TEST_backfill_grow: run_mon td/osd-backfill-space a 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2024-05-08T17:51:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-05-08T17:51:40.637 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T17:51:40.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:51:40.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:51:40.638 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:51:40.638 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:40.638 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:51:40.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:51:40.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T17:51:40.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T17:51:40.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T17:51:40.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:51:40.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:51:40.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T17:51:40.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:51:40.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get fsid 2024-05-08T17:51:40.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T17:51:40.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:51:40.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:51:40.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T17:51:40.986 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:51:40.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T17:51:40.986 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:51:40.986 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:51:40.986 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:51:40.986 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:40.986 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:51:40.986 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T17:51:40.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:51:40.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get mon_host 2024-05-08T17:51:41.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:563: TEST_backfill_grow: run_mgr td/osd-backfill-space x 2024-05-08T17:51:41.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-space 2024-05-08T17:51:41.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T17:51:41.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T17:51:41.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T17:51:41.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-space/x 2024-05-08T17:51:41.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T17:51:42.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T17:51:42.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:51:42.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:51:42.032 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:51:42.032 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:42.032 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:51:42.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:51:42.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:51:42.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:51:42.114 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: expr 3 - 1 2024-05-08T17:51:42.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: seq 0 2 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:567: TEST_backfill_grow: run_osd td/osd-backfill-space 0 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:51:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:51:42.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T17:51:42.122 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:51:42.123 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 4873b7f8-1f5b-4d4c-a7ea-03f1a984efe8 2024-05-08T17:51:42.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4873b7f8-1f5b-4d4c-a7ea-03f1a984efe8 2024-05-08T17:51:42.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 4873b7f8-1f5b-4d4c-a7ea-03f1a984efe8' 2024-05-08T17:51:42.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:51:42.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCuuztmNBJCCRAAPLBpdsrCP3sKFYG6XY8OIg== 2024-05-08T17:51:42.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCuuztmNBJCCRAAPLBpdsrCP3sKFYG6XY8OIg=="}' 2024-05-08T17:51:42.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4873b7f8-1f5b-4d4c-a7ea-03f1a984efe8 -i td/osd-backfill-space/0/new.json 2024-05-08T17:51:42.477 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:51:42.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/0/new.json 2024-05-08T17:51:42.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCuuztmNBJCCRAAPLBpdsrCP3sKFYG6XY8OIg== --osd-uuid 4873b7f8-1f5b-4d4c-a7ea-03f1a984efe8 2024-05-08T17:51:42.541 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:42.543+0000 7fd9f19c57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:51:42.553 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:42.555+0000 7fd9f19c57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:51:42.554 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:42.555+0000 7fd9f19c57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:51:42.555 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:42.555+0000 7fd9f19c57c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T17:51:42.555 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:42.555+0000 7fd9f19c57c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T17:51:42.555 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:42.555+0000 7fd9f19c57c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T17:51:42.593 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:42.595+0000 7fd9f19c57c0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-05-08T17:51:49.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-05-08T17:51:49.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:51:49.127 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T17:51:49.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T17:51:49.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:51:49.698 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:51:49.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T17:51:49.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:51:49.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:51:49.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:51:49.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:51:49.737 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:49.739+0000 7f870addd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:51:49.766 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:49.767+0000 7f870addd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:51:49.768 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:49.767+0000 7f870addd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:51:50.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T17:51:50.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:51:50.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:51:50.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:51:50.138 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:51:50.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:51:50.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:51:50.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:51:50.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:51:50.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:51:50.349 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:50.351+0000 7f870addd7c0 -1 Falling back to public interface 2024-05-08T17:51:50.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:51:51.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:51:51.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:51:51.581 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:51:51.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:51:51.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:51:51.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:51:52.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:51:52.981 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:51:52.983+0000 7f870addd7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T17:51:53.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:51:53.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:51:53.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:51:53.016 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:51:53.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:51:53.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:51:53.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:51:54.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:51:54.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:51:54.647 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:51:54.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:51:54.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:51:54.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:51:55.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:51:56.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:51:56.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:51:56.176 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:51:56.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:51:56.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:51:56.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:51:56.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:51:57.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:51:57.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:51:57.805 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:51:57.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:51:57.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:51:57.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:51:58.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:51:59.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:51:59.285 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:51:59.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:51:59.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:51:59.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:51:59.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:51:59.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:00.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:00.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:00.762 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:52:00.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:52:00.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:00.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:01.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:02.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:02.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:02.203 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:52:02.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:52:02.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:02.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:02.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:03.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:03.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:03.748 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:52:03.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:52:03.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:03.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:04.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:05.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:05.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:05.176 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:52:05.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:52:05.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:05.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:05.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:06.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:06.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:06.661 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:52:06.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:52:06.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:06.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:08.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:09.179 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:52:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:52:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:09.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:10.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:10.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:10.989 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:52:10.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:52:10.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:10.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:12.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:13.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:13.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:13.052 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:52:13.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:52:13.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:13.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:13.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:14.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:14.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:14.897 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:52:14.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:52:14.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:14.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:16.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:17.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:17.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:17.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:52:17.023 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:52:17.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:17.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:17.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:18.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:18.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:18.820 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:52:18.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:52:18.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:18.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:52:19.239 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2528688255,v1:127.0.0.1:6803/2528688255] [v2:127.0.0.1:6804/2528688255,v1:127.0.0.1:6805/2528688255] exists,up 4873b7f8-1f5b-4d4c-a7ea-03f1a984efe8 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:567: TEST_backfill_grow: run_osd td/osd-backfill-space 1 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:52:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:52:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:52:19.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:52:19.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T17:52:19.245 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:52:19.245 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 625cd3f9-d69f-401c-8d4b-485eab3d3332 2024-05-08T17:52:19.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=625cd3f9-d69f-401c-8d4b-485eab3d3332 2024-05-08T17:52:19.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 625cd3f9-d69f-401c-8d4b-485eab3d3332' 2024-05-08T17:52:19.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:52:19.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDTuztmBhpzEBAAaKIIQdu9giPsODozXz6kaw== 2024-05-08T17:52:19.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDTuztmBhpzEBAAaKIIQdu9giPsODozXz6kaw=="}' 2024-05-08T17:52:19.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 625cd3f9-d69f-401c-8d4b-485eab3d3332 -i td/osd-backfill-space/1/new.json 2024-05-08T17:52:19.750 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:52:19.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/1/new.json 2024-05-08T17:52:19.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTuztmBhpzEBAAaKIIQdu9giPsODozXz6kaw== --osd-uuid 625cd3f9-d69f-401c-8d4b-485eab3d3332 2024-05-08T17:52:19.807 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:19.807+0000 7f787d8c67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:19.826 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:19.827+0000 7f787d8c67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:19.828 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:19.827+0000 7f787d8c67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:19.828 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:19.831+0000 7f787d8c67c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T17:52:19.828 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:19.831+0000 7f787d8c67c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T17:52:19.828 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:19.831+0000 7f787d8c67c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T17:52:19.866 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:19.867+0000 7f787d8c67c0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-05-08T17:52:26.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-05-08T17:52:26.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:52:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T17:52:26.706 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T17:52:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:52:27.276 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T17:52:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T17:52:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:52:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:52:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:52:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:52:27.308 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:27.310+0000 7f2224da77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:27.356 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:27.358+0000 7f2224da77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:27.358 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:27.358+0000 7f2224da77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:27.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T17:52:27.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:52:27.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T17:52:27.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:52:27.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:52:27.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:27.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:52:27.746 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:52:27.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:27.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:27.946 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:27.946+0000 7f2224da77c0 -1 Falling back to public interface 2024-05-08T17:52:28.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:29.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:29.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:29.192 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:52:29.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:52:29.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:29.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:29.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:30.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:30.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:30.641 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:52:30.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:52:30.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:30.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:30.698 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:30.698+0000 7f2224da77c0 -1 osd.1 0 log_to_monitors true 2024-05-08T17:52:31.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:32.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:32.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:32.124 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:52:32.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:52:32.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:32.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:32.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:33.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:33.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:33.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:52:33.756 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:52:33.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:33.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:34.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:35.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:35.187 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:52:35.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:52:35.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:35.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:35.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:36.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:36.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:36.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:52:36.831 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:52:36.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:36.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:37.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:38.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:38.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:38.315 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:52:38.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:52:38.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:38.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:38.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:39.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:39.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:39.877 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:52:39.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:52:39.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:39.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:40.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:41.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:41.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:41.332 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:52:41.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:52:41.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:41.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:41.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:42.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:42.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:42.888 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:52:42.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:52:42.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:42.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:43.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:44.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:44.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:44.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:52:44.551 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:52:44.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:44.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:45.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:46.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:46.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:46.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:52:46.153 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:52:46.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:46.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:46.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:47.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:47.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:47.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:52:47.953 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:52:47.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:47.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:48.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:49.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:49.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:49.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:52:49.712 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:52:49.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:49.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:50.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:51.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:51.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:51.522 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:52:51.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:52:51.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:51.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:52.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:53.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:53.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:53.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:52:53.345 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:52:53.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:53.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:53.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:54.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:54.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:54.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:52:54.907 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:52:54.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:54.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:55.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:52:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:52:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:52:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:52:56.792 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:52:56.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:52:56.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:52:57.352 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2985071931,v1:127.0.0.1:6811/2985071931] [v2:127.0.0.1:6812/2985071931,v1:127.0.0.1:6813/2985071931] exists,up 625cd3f9-d69f-401c-8d4b-485eab3d3332 2024-05-08T17:52:57.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:567: TEST_backfill_grow: run_osd td/osd-backfill-space 2 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:52:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:52:57.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:52:57.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T17:52:57.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:52:57.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=96a83b95-0e79-45aa-8060-6a5eb11872fe 2024-05-08T17:52:57.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 96a83b95-0e79-45aa-8060-6a5eb11872fe' 2024-05-08T17:52:57.360 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 96a83b95-0e79-45aa-8060-6a5eb11872fe 2024-05-08T17:52:57.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:52:57.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD5uztmTqsOFxAAz8QmThE4qTn4YFB6hhBBqw== 2024-05-08T17:52:57.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD5uztmTqsOFxAAz8QmThE4qTn4YFB6hhBBqw=="}' 2024-05-08T17:52:57.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 96a83b95-0e79-45aa-8060-6a5eb11872fe -i td/osd-backfill-space/2/new.json 2024-05-08T17:52:58.015 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:52:58.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/2/new.json 2024-05-08T17:52:58.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD5uztmTqsOFxAAz8QmThE4qTn4YFB6hhBBqw== --osd-uuid 96a83b95-0e79-45aa-8060-6a5eb11872fe 2024-05-08T17:52:58.080 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:58.086+0000 7fd4ba1547c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:58.090 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:58.094+0000 7fd4ba1547c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:58.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:58.094+0000 7fd4ba1547c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:52:58.092 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:58.098+0000 7fd4ba1547c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T17:52:58.092 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:58.098+0000 7fd4ba1547c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T17:52:58.092 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:58.098+0000 7fd4ba1547c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T17:52:58.129 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:52:58.134+0000 7fd4ba1547c0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-05-08T17:53:05.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-05-08T17:53:05.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:53:05.150 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T17:53:05.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T17:53:05.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:53:05.696 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T17:53:05.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T17:53:05.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:53:05.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:53:05.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:53:05.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:53:05.734 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:53:05.738+0000 7f9eb11127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:53:05.770 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:53:05.774+0000 7f9eb11127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:53:05.771 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:53:05.774+0000 7f9eb11127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:53:06.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T17:53:06.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:53:06.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T17:53:06.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:53:06.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:53:06.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:06.151 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:53:06.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:53:06.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:06.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:06.341 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:53:06.346+0000 7f9eb11127c0 -1 Falling back to public interface 2024-05-08T17:53:06.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:07.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:07.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:07.574 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:53:07.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:53:07.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:07.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:07.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:08.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:08.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:08.987 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:53:08.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:53:08.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:08.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:09.077 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:53:09.082+0000 7f9eb11127c0 -1 osd.2 0 log_to_monitors true 2024-05-08T17:53:09.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:10.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:10.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:10.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:53:10.465 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:53:10.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:10.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:10.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:11.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:11.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:11.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:53:11.929 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:53:11.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:11.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:12.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:13.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:13.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:13.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:53:13.375 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:53:13.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:13.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:13.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:14.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:14.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:14.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:53:14.954 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:53:14.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:14.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:15.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:16.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:16.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:16.539 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:53:16.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:53:16.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:16.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:17.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:18.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:18.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:18.164 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:53:18.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:53:18.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:18.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:18.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:19.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:19.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:19.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:53:19.613 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:53:19.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:19.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:20.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:21.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:21.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:21.154 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:53:21.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:53:21.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:21.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:21.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:22.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:22.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:22.627 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:53:22.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:53:22.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:22.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:23.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:24.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:24.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:24.211 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:53:24.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:53:24.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:24.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:24.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:25.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:25.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:25.802 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:53:25.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:53:25.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:25.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:26.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:27.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:27.722 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:53:27.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:53:27.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:27.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:28.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:29.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:29.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:29.618 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:53:29.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:53:29.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:29.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:30.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:31.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:31.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:31.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:53:31.310 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:53:31.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:31.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:32.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:33.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:33.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:33.070 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:53:33.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:53:33.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:33.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:34.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:35.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:35.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:35.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:53:35.333 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:53:35.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:35.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:35.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:53:36.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:53:36.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:53:36.867 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T17:53:36.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T17:53:36.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:53:36.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:53:37.323 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2126909434,v1:127.0.0.1:6819/2126909434] [v2:127.0.0.1:6820/2126909434,v1:127.0.0.1:6821/2126909434] exists,up 96a83b95-0e79-45aa-8060-6a5eb11872fe 2024-05-08T17:53:37.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:53:37.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:53:37.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:53:37.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:570: TEST_backfill_grow: ceph osd set-backfillfull-ratio .85 2024-05-08T17:53:37.995 INFO:tasks.workunit.client.0.smithi117.stderr:osd set-backfillfull-ratio 0.85 2024-05-08T17:53:38.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:572: TEST_backfill_grow: create_pool test 1 1 2024-05-08T17:53:38.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T17:53:38.773 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T17:53:38.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:53:39.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:573: TEST_backfill_grow: ceph osd pool set test size 3 2024-05-08T17:53:40.623 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 3 2024-05-08T17:53:40.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:574: TEST_backfill_grow: sleep 5 2024-05-08T17:53:45.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:576: TEST_backfill_grow: wait_for_clean 2024-05-08T17:53:45.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:53:45.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:53:45.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:53:45.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:53:45.650 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:53:45.650 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:53:45.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:53:45.651 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:53:45.651 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:53:45.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:53:45.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:53:45.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:53:45.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:53:45.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:53:45.772 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:53:46.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:53:46.203 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:53:46.203 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T17:53:46.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:53:46.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:53:46.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:53:46.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836501 2024-05-08T17:53:46.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836501 2024-05-08T17:53:46.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836501' 2024-05-08T17:53:46.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:53:46.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:53:46.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672978 2024-05-08T17:53:46.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672978 2024-05-08T17:53:46.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836501 1-42949672978' 2024-05-08T17:53:46.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:53:46.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:53:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509455 2024-05-08T17:53:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509455 2024-05-08T17:53:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836501 1-42949672978 2-64424509455' 2024-05-08T17:53:46.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:53:46.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:53:46.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836501 2024-05-08T17:53:46.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:53:46.690 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836501 2024-05-08T17:53:46.690 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:53:46.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836501 2024-05-08T17:53:46.691 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836501 2024-05-08T17:53:46.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2024-05-08T17:53:46.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:53:47.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836501 -lt 21474836501 2024-05-08T17:53:47.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:53:47.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672978 2024-05-08T17:53:47.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:53:47.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:53:47.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672978 2024-05-08T17:53:47.086 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:53:47.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672978 2024-05-08T17:53:47.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672978' 2024-05-08T17:53:47.087 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672978 2024-05-08T17:53:47.087 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:53:47.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672978 -lt 42949672978 2024-05-08T17:53:47.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:53:47.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509455 2024-05-08T17:53:47.545 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:53:47.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:53:47.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:53:47.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509455 2024-05-08T17:53:47.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509455 2024-05-08T17:53:47.548 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509455 2024-05-08T17:53:47.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509455' 2024-05-08T17:53:47.548 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:53:47.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509453 -lt 64424509455 2024-05-08T17:53:47.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:53:48.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:53:48.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:53:49.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509456 -lt 64424509455 2024-05-08T17:53:49.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:53:49.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:53:49.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:53:49.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T17:53:49.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:53:49.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:53:49.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:53:49.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:53:49.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:53:49.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:53:49.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:53:50.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:53:50.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:53:50.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:53:50.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:53:50.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T17:53:50.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:53:50.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:53:50.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:578: TEST_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/4kdata bs=1k count=4 2024-05-08T17:53:50.891 INFO:tasks.workunit.client.0.smithi117.stderr:4+0 records in 2024-05-08T17:53:50.891 INFO:tasks.workunit.client.0.smithi117.stderr:4+0 records out 2024-05-08T17:53:50.891 INFO:tasks.workunit.client.0.smithi117.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000245374 s, 16.7 MB/s 2024-05-08T17:53:50.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: seq 1 600 2024-05-08T17:53:50.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:50.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj1 td/osd-backfill-space/4kdata 2024-05-08T17:53:51.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:51.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj2 td/osd-backfill-space/4kdata 2024-05-08T17:53:51.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:51.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj3 td/osd-backfill-space/4kdata 2024-05-08T17:53:51.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:51.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj4 td/osd-backfill-space/4kdata 2024-05-08T17:53:51.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:51.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj5 td/osd-backfill-space/4kdata 2024-05-08T17:53:51.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:51.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj6 td/osd-backfill-space/4kdata 2024-05-08T17:53:52.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:52.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj7 td/osd-backfill-space/4kdata 2024-05-08T17:53:52.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:52.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj8 td/osd-backfill-space/4kdata 2024-05-08T17:53:52.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:52.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj9 td/osd-backfill-space/4kdata 2024-05-08T17:53:52.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:52.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj10 td/osd-backfill-space/4kdata 2024-05-08T17:53:52.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:52.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj11 td/osd-backfill-space/4kdata 2024-05-08T17:53:52.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:52.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj12 td/osd-backfill-space/4kdata 2024-05-08T17:53:53.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:53.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj13 td/osd-backfill-space/4kdata 2024-05-08T17:53:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj14 td/osd-backfill-space/4kdata 2024-05-08T17:53:53.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:53.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj15 td/osd-backfill-space/4kdata 2024-05-08T17:53:53.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:53.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj16 td/osd-backfill-space/4kdata 2024-05-08T17:53:53.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:53.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj17 td/osd-backfill-space/4kdata 2024-05-08T17:53:54.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:54.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj18 td/osd-backfill-space/4kdata 2024-05-08T17:53:54.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:54.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj19 td/osd-backfill-space/4kdata 2024-05-08T17:53:54.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:54.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj20 td/osd-backfill-space/4kdata 2024-05-08T17:53:54.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:54.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj21 td/osd-backfill-space/4kdata 2024-05-08T17:53:54.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:54.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj22 td/osd-backfill-space/4kdata 2024-05-08T17:53:54.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:54.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj23 td/osd-backfill-space/4kdata 2024-05-08T17:53:55.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:55.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj24 td/osd-backfill-space/4kdata 2024-05-08T17:53:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj25 td/osd-backfill-space/4kdata 2024-05-08T17:53:55.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:55.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj26 td/osd-backfill-space/4kdata 2024-05-08T17:53:55.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:55.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj27 td/osd-backfill-space/4kdata 2024-05-08T17:53:55.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:55.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj28 td/osd-backfill-space/4kdata 2024-05-08T17:53:56.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:56.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj29 td/osd-backfill-space/4kdata 2024-05-08T17:53:56.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:56.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj30 td/osd-backfill-space/4kdata 2024-05-08T17:53:56.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:56.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj31 td/osd-backfill-space/4kdata 2024-05-08T17:53:56.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:56.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj32 td/osd-backfill-space/4kdata 2024-05-08T17:53:56.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:56.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj33 td/osd-backfill-space/4kdata 2024-05-08T17:53:57.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:57.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj34 td/osd-backfill-space/4kdata 2024-05-08T17:53:57.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:57.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj35 td/osd-backfill-space/4kdata 2024-05-08T17:53:57.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:57.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj36 td/osd-backfill-space/4kdata 2024-05-08T17:53:57.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:57.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj37 td/osd-backfill-space/4kdata 2024-05-08T17:53:57.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:57.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj38 td/osd-backfill-space/4kdata 2024-05-08T17:53:57.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:57.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj39 td/osd-backfill-space/4kdata 2024-05-08T17:53:58.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:58.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj40 td/osd-backfill-space/4kdata 2024-05-08T17:53:58.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:58.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj41 td/osd-backfill-space/4kdata 2024-05-08T17:53:58.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:58.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj42 td/osd-backfill-space/4kdata 2024-05-08T17:53:58.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:58.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj43 td/osd-backfill-space/4kdata 2024-05-08T17:53:58.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:58.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj44 td/osd-backfill-space/4kdata 2024-05-08T17:53:59.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:59.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj45 td/osd-backfill-space/4kdata 2024-05-08T17:53:59.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:59.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj46 td/osd-backfill-space/4kdata 2024-05-08T17:53:59.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:59.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj47 td/osd-backfill-space/4kdata 2024-05-08T17:53:59.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:59.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj48 td/osd-backfill-space/4kdata 2024-05-08T17:53:59.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:53:59.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj49 td/osd-backfill-space/4kdata 2024-05-08T17:54:00.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:00.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj50 td/osd-backfill-space/4kdata 2024-05-08T17:54:00.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:00.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj51 td/osd-backfill-space/4kdata 2024-05-08T17:54:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj52 td/osd-backfill-space/4kdata 2024-05-08T17:54:00.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:00.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj53 td/osd-backfill-space/4kdata 2024-05-08T17:54:00.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:00.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj54 td/osd-backfill-space/4kdata 2024-05-08T17:54:00.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:00.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj55 td/osd-backfill-space/4kdata 2024-05-08T17:54:01.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:01.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj56 td/osd-backfill-space/4kdata 2024-05-08T17:54:01.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:01.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj57 td/osd-backfill-space/4kdata 2024-05-08T17:54:01.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:01.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj58 td/osd-backfill-space/4kdata 2024-05-08T17:54:01.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:01.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj59 td/osd-backfill-space/4kdata 2024-05-08T17:54:01.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:01.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj60 td/osd-backfill-space/4kdata 2024-05-08T17:54:02.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:02.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj61 td/osd-backfill-space/4kdata 2024-05-08T17:54:02.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:02.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj62 td/osd-backfill-space/4kdata 2024-05-08T17:54:02.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:02.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj63 td/osd-backfill-space/4kdata 2024-05-08T17:54:02.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:02.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj64 td/osd-backfill-space/4kdata 2024-05-08T17:54:02.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:02.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj65 td/osd-backfill-space/4kdata 2024-05-08T17:54:03.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:03.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj66 td/osd-backfill-space/4kdata 2024-05-08T17:54:03.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:03.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj67 td/osd-backfill-space/4kdata 2024-05-08T17:54:03.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:03.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj68 td/osd-backfill-space/4kdata 2024-05-08T17:54:03.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:03.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj69 td/osd-backfill-space/4kdata 2024-05-08T17:54:03.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:03.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj70 td/osd-backfill-space/4kdata 2024-05-08T17:54:04.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:04.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj71 td/osd-backfill-space/4kdata 2024-05-08T17:54:04.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:04.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj72 td/osd-backfill-space/4kdata 2024-05-08T17:54:04.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:04.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj73 td/osd-backfill-space/4kdata 2024-05-08T17:54:04.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:04.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj74 td/osd-backfill-space/4kdata 2024-05-08T17:54:04.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:04.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj75 td/osd-backfill-space/4kdata 2024-05-08T17:54:04.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:04.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj76 td/osd-backfill-space/4kdata 2024-05-08T17:54:05.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:05.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj77 td/osd-backfill-space/4kdata 2024-05-08T17:54:05.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:05.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj78 td/osd-backfill-space/4kdata 2024-05-08T17:54:05.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:05.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj79 td/osd-backfill-space/4kdata 2024-05-08T17:54:05.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:05.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj80 td/osd-backfill-space/4kdata 2024-05-08T17:54:05.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:05.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj81 td/osd-backfill-space/4kdata 2024-05-08T17:54:06.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:06.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj82 td/osd-backfill-space/4kdata 2024-05-08T17:54:06.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:06.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj83 td/osd-backfill-space/4kdata 2024-05-08T17:54:06.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:06.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj84 td/osd-backfill-space/4kdata 2024-05-08T17:54:06.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:06.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj85 td/osd-backfill-space/4kdata 2024-05-08T17:54:06.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:06.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj86 td/osd-backfill-space/4kdata 2024-05-08T17:54:06.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:06.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj87 td/osd-backfill-space/4kdata 2024-05-08T17:54:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj88 td/osd-backfill-space/4kdata 2024-05-08T17:54:07.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:07.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj89 td/osd-backfill-space/4kdata 2024-05-08T17:54:07.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:07.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj90 td/osd-backfill-space/4kdata 2024-05-08T17:54:07.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:07.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj91 td/osd-backfill-space/4kdata 2024-05-08T17:54:07.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:07.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj92 td/osd-backfill-space/4kdata 2024-05-08T17:54:08.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:08.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj93 td/osd-backfill-space/4kdata 2024-05-08T17:54:08.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:08.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj94 td/osd-backfill-space/4kdata 2024-05-08T17:54:08.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:08.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj95 td/osd-backfill-space/4kdata 2024-05-08T17:54:08.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:08.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj96 td/osd-backfill-space/4kdata 2024-05-08T17:54:08.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:08.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj97 td/osd-backfill-space/4kdata 2024-05-08T17:54:08.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:08.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj98 td/osd-backfill-space/4kdata 2024-05-08T17:54:09.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:09.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj99 td/osd-backfill-space/4kdata 2024-05-08T17:54:09.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:09.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj100 td/osd-backfill-space/4kdata 2024-05-08T17:54:09.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:09.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj101 td/osd-backfill-space/4kdata 2024-05-08T17:54:09.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:09.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj102 td/osd-backfill-space/4kdata 2024-05-08T17:54:09.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:09.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj103 td/osd-backfill-space/4kdata 2024-05-08T17:54:10.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:10.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj104 td/osd-backfill-space/4kdata 2024-05-08T17:54:10.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:10.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj105 td/osd-backfill-space/4kdata 2024-05-08T17:54:10.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:10.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj106 td/osd-backfill-space/4kdata 2024-05-08T17:54:10.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:10.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj107 td/osd-backfill-space/4kdata 2024-05-08T17:54:10.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:10.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj108 td/osd-backfill-space/4kdata 2024-05-08T17:54:10.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:10.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj109 td/osd-backfill-space/4kdata 2024-05-08T17:54:11.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:11.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj110 td/osd-backfill-space/4kdata 2024-05-08T17:54:11.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:11.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj111 td/osd-backfill-space/4kdata 2024-05-08T17:54:11.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:11.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj112 td/osd-backfill-space/4kdata 2024-05-08T17:54:11.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:11.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj113 td/osd-backfill-space/4kdata 2024-05-08T17:54:11.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:11.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj114 td/osd-backfill-space/4kdata 2024-05-08T17:54:12.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:12.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj115 td/osd-backfill-space/4kdata 2024-05-08T17:54:12.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:12.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj116 td/osd-backfill-space/4kdata 2024-05-08T17:54:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:12.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj117 td/osd-backfill-space/4kdata 2024-05-08T17:54:12.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:12.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj118 td/osd-backfill-space/4kdata 2024-05-08T17:54:12.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:12.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj119 td/osd-backfill-space/4kdata 2024-05-08T17:54:13.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:13.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj120 td/osd-backfill-space/4kdata 2024-05-08T17:54:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj121 td/osd-backfill-space/4kdata 2024-05-08T17:54:13.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:13.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj122 td/osd-backfill-space/4kdata 2024-05-08T17:54:13.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:13.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj123 td/osd-backfill-space/4kdata 2024-05-08T17:54:13.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:13.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj124 td/osd-backfill-space/4kdata 2024-05-08T17:54:13.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:13.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj125 td/osd-backfill-space/4kdata 2024-05-08T17:54:14.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:14.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj126 td/osd-backfill-space/4kdata 2024-05-08T17:54:14.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:14.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj127 td/osd-backfill-space/4kdata 2024-05-08T17:54:14.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:14.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj128 td/osd-backfill-space/4kdata 2024-05-08T17:54:14.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:14.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj129 td/osd-backfill-space/4kdata 2024-05-08T17:54:14.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:14.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj130 td/osd-backfill-space/4kdata 2024-05-08T17:54:15.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:15.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj131 td/osd-backfill-space/4kdata 2024-05-08T17:54:15.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:15.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj132 td/osd-backfill-space/4kdata 2024-05-08T17:54:15.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:15.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj133 td/osd-backfill-space/4kdata 2024-05-08T17:54:15.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:15.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj134 td/osd-backfill-space/4kdata 2024-05-08T17:54:15.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:15.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj135 td/osd-backfill-space/4kdata 2024-05-08T17:54:15.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:15.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj136 td/osd-backfill-space/4kdata 2024-05-08T17:54:16.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:16.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj137 td/osd-backfill-space/4kdata 2024-05-08T17:54:16.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:16.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj138 td/osd-backfill-space/4kdata 2024-05-08T17:54:16.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:16.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj139 td/osd-backfill-space/4kdata 2024-05-08T17:54:16.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:16.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj140 td/osd-backfill-space/4kdata 2024-05-08T17:54:16.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:16.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj141 td/osd-backfill-space/4kdata 2024-05-08T17:54:16.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:16.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj142 td/osd-backfill-space/4kdata 2024-05-08T17:54:17.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:17.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj143 td/osd-backfill-space/4kdata 2024-05-08T17:54:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj144 td/osd-backfill-space/4kdata 2024-05-08T17:54:17.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:17.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj145 td/osd-backfill-space/4kdata 2024-05-08T17:54:17.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:17.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj146 td/osd-backfill-space/4kdata 2024-05-08T17:54:17.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:17.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj147 td/osd-backfill-space/4kdata 2024-05-08T17:54:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj148 td/osd-backfill-space/4kdata 2024-05-08T17:54:18.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:18.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj149 td/osd-backfill-space/4kdata 2024-05-08T17:54:18.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:18.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj150 td/osd-backfill-space/4kdata 2024-05-08T17:54:18.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:18.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj151 td/osd-backfill-space/4kdata 2024-05-08T17:54:18.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:18.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj152 td/osd-backfill-space/4kdata 2024-05-08T17:54:19.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:19.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj153 td/osd-backfill-space/4kdata 2024-05-08T17:54:19.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:19.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj154 td/osd-backfill-space/4kdata 2024-05-08T17:54:19.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:19.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj155 td/osd-backfill-space/4kdata 2024-05-08T17:54:19.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:19.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj156 td/osd-backfill-space/4kdata 2024-05-08T17:54:19.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:19.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj157 td/osd-backfill-space/4kdata 2024-05-08T17:54:20.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:20.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj158 td/osd-backfill-space/4kdata 2024-05-08T17:54:20.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:20.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj159 td/osd-backfill-space/4kdata 2024-05-08T17:54:20.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:20.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj160 td/osd-backfill-space/4kdata 2024-05-08T17:54:20.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:20.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj161 td/osd-backfill-space/4kdata 2024-05-08T17:54:20.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:20.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj162 td/osd-backfill-space/4kdata 2024-05-08T17:54:21.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:21.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj163 td/osd-backfill-space/4kdata 2024-05-08T17:54:21.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:21.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj164 td/osd-backfill-space/4kdata 2024-05-08T17:54:21.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:21.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj165 td/osd-backfill-space/4kdata 2024-05-08T17:54:21.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:21.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj166 td/osd-backfill-space/4kdata 2024-05-08T17:54:21.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:21.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj167 td/osd-backfill-space/4kdata 2024-05-08T17:54:22.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:22.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj168 td/osd-backfill-space/4kdata 2024-05-08T17:54:22.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:22.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj169 td/osd-backfill-space/4kdata 2024-05-08T17:54:22.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:22.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj170 td/osd-backfill-space/4kdata 2024-05-08T17:54:22.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:22.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj171 td/osd-backfill-space/4kdata 2024-05-08T17:54:22.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:22.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj172 td/osd-backfill-space/4kdata 2024-05-08T17:54:22.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:22.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj173 td/osd-backfill-space/4kdata 2024-05-08T17:54:23.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:23.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj174 td/osd-backfill-space/4kdata 2024-05-08T17:54:23.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:23.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj175 td/osd-backfill-space/4kdata 2024-05-08T17:54:23.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:23.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj176 td/osd-backfill-space/4kdata 2024-05-08T17:54:23.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:23.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj177 td/osd-backfill-space/4kdata 2024-05-08T17:54:23.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:23.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj178 td/osd-backfill-space/4kdata 2024-05-08T17:54:24.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:24.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj179 td/osd-backfill-space/4kdata 2024-05-08T17:54:24.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:24.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj180 td/osd-backfill-space/4kdata 2024-05-08T17:54:24.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:24.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj181 td/osd-backfill-space/4kdata 2024-05-08T17:54:24.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:24.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj182 td/osd-backfill-space/4kdata 2024-05-08T17:54:24.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:24.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj183 td/osd-backfill-space/4kdata 2024-05-08T17:54:25.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:25.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj184 td/osd-backfill-space/4kdata 2024-05-08T17:54:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj185 td/osd-backfill-space/4kdata 2024-05-08T17:54:25.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:25.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj186 td/osd-backfill-space/4kdata 2024-05-08T17:54:25.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:25.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj187 td/osd-backfill-space/4kdata 2024-05-08T17:54:25.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:25.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj188 td/osd-backfill-space/4kdata 2024-05-08T17:54:25.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:25.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj189 td/osd-backfill-space/4kdata 2024-05-08T17:54:26.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:26.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj190 td/osd-backfill-space/4kdata 2024-05-08T17:54:26.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:26.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj191 td/osd-backfill-space/4kdata 2024-05-08T17:54:26.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:26.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj192 td/osd-backfill-space/4kdata 2024-05-08T17:54:26.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:26.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj193 td/osd-backfill-space/4kdata 2024-05-08T17:54:26.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:26.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj194 td/osd-backfill-space/4kdata 2024-05-08T17:54:27.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:27.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj195 td/osd-backfill-space/4kdata 2024-05-08T17:54:27.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:27.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj196 td/osd-backfill-space/4kdata 2024-05-08T17:54:27.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:27.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj197 td/osd-backfill-space/4kdata 2024-05-08T17:54:27.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:27.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj198 td/osd-backfill-space/4kdata 2024-05-08T17:54:27.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:27.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj199 td/osd-backfill-space/4kdata 2024-05-08T17:54:27.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:27.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj200 td/osd-backfill-space/4kdata 2024-05-08T17:54:28.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:28.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj201 td/osd-backfill-space/4kdata 2024-05-08T17:54:28.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:28.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj202 td/osd-backfill-space/4kdata 2024-05-08T17:54:28.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:28.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj203 td/osd-backfill-space/4kdata 2024-05-08T17:54:28.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:28.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj204 td/osd-backfill-space/4kdata 2024-05-08T17:54:28.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:28.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj205 td/osd-backfill-space/4kdata 2024-05-08T17:54:29.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:29.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj206 td/osd-backfill-space/4kdata 2024-05-08T17:54:29.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:29.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj207 td/osd-backfill-space/4kdata 2024-05-08T17:54:29.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:29.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj208 td/osd-backfill-space/4kdata 2024-05-08T17:54:29.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:29.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj209 td/osd-backfill-space/4kdata 2024-05-08T17:54:29.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:29.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj210 td/osd-backfill-space/4kdata 2024-05-08T17:54:29.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:29.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj211 td/osd-backfill-space/4kdata 2024-05-08T17:54:30.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:30.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj212 td/osd-backfill-space/4kdata 2024-05-08T17:54:30.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:30.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj213 td/osd-backfill-space/4kdata 2024-05-08T17:54:30.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:30.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj214 td/osd-backfill-space/4kdata 2024-05-08T17:54:30.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:30.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj215 td/osd-backfill-space/4kdata 2024-05-08T17:54:30.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:30.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj216 td/osd-backfill-space/4kdata 2024-05-08T17:54:31.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:31.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj217 td/osd-backfill-space/4kdata 2024-05-08T17:54:31.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:31.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj218 td/osd-backfill-space/4kdata 2024-05-08T17:54:31.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:31.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj219 td/osd-backfill-space/4kdata 2024-05-08T17:54:31.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:31.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj220 td/osd-backfill-space/4kdata 2024-05-08T17:54:31.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:31.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj221 td/osd-backfill-space/4kdata 2024-05-08T17:54:32.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:32.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj222 td/osd-backfill-space/4kdata 2024-05-08T17:54:32.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:32.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj223 td/osd-backfill-space/4kdata 2024-05-08T17:54:32.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:32.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj224 td/osd-backfill-space/4kdata 2024-05-08T17:54:32.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:32.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj225 td/osd-backfill-space/4kdata 2024-05-08T17:54:32.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:32.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj226 td/osd-backfill-space/4kdata 2024-05-08T17:54:32.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:32.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj227 td/osd-backfill-space/4kdata 2024-05-08T17:54:33.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:33.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj228 td/osd-backfill-space/4kdata 2024-05-08T17:54:33.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:33.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj229 td/osd-backfill-space/4kdata 2024-05-08T17:54:33.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:33.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj230 td/osd-backfill-space/4kdata 2024-05-08T17:54:33.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:33.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj231 td/osd-backfill-space/4kdata 2024-05-08T17:54:33.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:33.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj232 td/osd-backfill-space/4kdata 2024-05-08T17:54:34.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:34.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj233 td/osd-backfill-space/4kdata 2024-05-08T17:54:34.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:34.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj234 td/osd-backfill-space/4kdata 2024-05-08T17:54:34.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:34.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj235 td/osd-backfill-space/4kdata 2024-05-08T17:54:34.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:34.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj236 td/osd-backfill-space/4kdata 2024-05-08T17:54:34.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:34.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj237 td/osd-backfill-space/4kdata 2024-05-08T17:54:34.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:34.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj238 td/osd-backfill-space/4kdata 2024-05-08T17:54:35.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:35.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj239 td/osd-backfill-space/4kdata 2024-05-08T17:54:35.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:35.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj240 td/osd-backfill-space/4kdata 2024-05-08T17:54:35.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:35.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj241 td/osd-backfill-space/4kdata 2024-05-08T17:54:35.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:35.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj242 td/osd-backfill-space/4kdata 2024-05-08T17:54:35.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:35.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj243 td/osd-backfill-space/4kdata 2024-05-08T17:54:36.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:36.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj244 td/osd-backfill-space/4kdata 2024-05-08T17:54:36.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:36.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj245 td/osd-backfill-space/4kdata 2024-05-08T17:54:36.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:36.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj246 td/osd-backfill-space/4kdata 2024-05-08T17:54:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj247 td/osd-backfill-space/4kdata 2024-05-08T17:54:36.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:36.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj248 td/osd-backfill-space/4kdata 2024-05-08T17:54:36.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:36.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj249 td/osd-backfill-space/4kdata 2024-05-08T17:54:37.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:37.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj250 td/osd-backfill-space/4kdata 2024-05-08T17:54:37.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:37.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj251 td/osd-backfill-space/4kdata 2024-05-08T17:54:37.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:37.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj252 td/osd-backfill-space/4kdata 2024-05-08T17:54:37.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:37.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj253 td/osd-backfill-space/4kdata 2024-05-08T17:54:37.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:37.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj254 td/osd-backfill-space/4kdata 2024-05-08T17:54:38.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:38.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj255 td/osd-backfill-space/4kdata 2024-05-08T17:54:38.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:38.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj256 td/osd-backfill-space/4kdata 2024-05-08T17:54:38.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:38.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj257 td/osd-backfill-space/4kdata 2024-05-08T17:54:38.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:38.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj258 td/osd-backfill-space/4kdata 2024-05-08T17:54:38.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:38.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj259 td/osd-backfill-space/4kdata 2024-05-08T17:54:38.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:38.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj260 td/osd-backfill-space/4kdata 2024-05-08T17:54:39.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:39.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj261 td/osd-backfill-space/4kdata 2024-05-08T17:54:39.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:39.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj262 td/osd-backfill-space/4kdata 2024-05-08T17:54:39.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:39.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj263 td/osd-backfill-space/4kdata 2024-05-08T17:54:39.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:39.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj264 td/osd-backfill-space/4kdata 2024-05-08T17:54:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:39.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj265 td/osd-backfill-space/4kdata 2024-05-08T17:54:40.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:40.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj266 td/osd-backfill-space/4kdata 2024-05-08T17:54:40.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:40.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj267 td/osd-backfill-space/4kdata 2024-05-08T17:54:40.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:40.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj268 td/osd-backfill-space/4kdata 2024-05-08T17:54:40.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:40.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj269 td/osd-backfill-space/4kdata 2024-05-08T17:54:40.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:40.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj270 td/osd-backfill-space/4kdata 2024-05-08T17:54:40.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:40.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj271 td/osd-backfill-space/4kdata 2024-05-08T17:54:41.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:41.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj272 td/osd-backfill-space/4kdata 2024-05-08T17:54:41.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:41.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj273 td/osd-backfill-space/4kdata 2024-05-08T17:54:41.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:41.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj274 td/osd-backfill-space/4kdata 2024-05-08T17:54:41.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:41.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj275 td/osd-backfill-space/4kdata 2024-05-08T17:54:41.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:41.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj276 td/osd-backfill-space/4kdata 2024-05-08T17:54:42.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:42.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj277 td/osd-backfill-space/4kdata 2024-05-08T17:54:42.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:42.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj278 td/osd-backfill-space/4kdata 2024-05-08T17:54:42.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:42.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj279 td/osd-backfill-space/4kdata 2024-05-08T17:54:42.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:42.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj280 td/osd-backfill-space/4kdata 2024-05-08T17:54:42.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:42.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj281 td/osd-backfill-space/4kdata 2024-05-08T17:54:43.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:43.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj282 td/osd-backfill-space/4kdata 2024-05-08T17:54:43.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:43.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj283 td/osd-backfill-space/4kdata 2024-05-08T17:54:43.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:43.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj284 td/osd-backfill-space/4kdata 2024-05-08T17:54:43.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:43.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj285 td/osd-backfill-space/4kdata 2024-05-08T17:54:43.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:43.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj286 td/osd-backfill-space/4kdata 2024-05-08T17:54:43.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:43.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj287 td/osd-backfill-space/4kdata 2024-05-08T17:54:44.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:44.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj288 td/osd-backfill-space/4kdata 2024-05-08T17:54:44.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:44.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj289 td/osd-backfill-space/4kdata 2024-05-08T17:54:44.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:44.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj290 td/osd-backfill-space/4kdata 2024-05-08T17:54:44.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:44.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj291 td/osd-backfill-space/4kdata 2024-05-08T17:54:44.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:44.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj292 td/osd-backfill-space/4kdata 2024-05-08T17:54:44.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:44.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj293 td/osd-backfill-space/4kdata 2024-05-08T17:54:45.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:45.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj294 td/osd-backfill-space/4kdata 2024-05-08T17:54:45.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:45.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj295 td/osd-backfill-space/4kdata 2024-05-08T17:54:45.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:45.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj296 td/osd-backfill-space/4kdata 2024-05-08T17:54:45.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:45.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj297 td/osd-backfill-space/4kdata 2024-05-08T17:54:45.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:45.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj298 td/osd-backfill-space/4kdata 2024-05-08T17:54:46.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:46.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj299 td/osd-backfill-space/4kdata 2024-05-08T17:54:46.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:46.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj300 td/osd-backfill-space/4kdata 2024-05-08T17:54:46.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:46.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj301 td/osd-backfill-space/4kdata 2024-05-08T17:54:46.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:46.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj302 td/osd-backfill-space/4kdata 2024-05-08T17:54:46.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:46.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj303 td/osd-backfill-space/4kdata 2024-05-08T17:54:47.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:47.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj304 td/osd-backfill-space/4kdata 2024-05-08T17:54:47.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:47.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj305 td/osd-backfill-space/4kdata 2024-05-08T17:54:47.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:47.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj306 td/osd-backfill-space/4kdata 2024-05-08T17:54:47.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:47.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj307 td/osd-backfill-space/4kdata 2024-05-08T17:54:47.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:47.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj308 td/osd-backfill-space/4kdata 2024-05-08T17:54:48.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:48.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj309 td/osd-backfill-space/4kdata 2024-05-08T17:54:48.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:48.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj310 td/osd-backfill-space/4kdata 2024-05-08T17:54:48.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:48.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj311 td/osd-backfill-space/4kdata 2024-05-08T17:54:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj312 td/osd-backfill-space/4kdata 2024-05-08T17:54:48.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:48.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj313 td/osd-backfill-space/4kdata 2024-05-08T17:54:48.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:48.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj314 td/osd-backfill-space/4kdata 2024-05-08T17:54:49.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:49.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj315 td/osd-backfill-space/4kdata 2024-05-08T17:54:49.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:49.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj316 td/osd-backfill-space/4kdata 2024-05-08T17:54:49.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:49.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj317 td/osd-backfill-space/4kdata 2024-05-08T17:54:49.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:49.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj318 td/osd-backfill-space/4kdata 2024-05-08T17:54:49.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:49.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj319 td/osd-backfill-space/4kdata 2024-05-08T17:54:50.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:50.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj320 td/osd-backfill-space/4kdata 2024-05-08T17:54:50.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:50.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj321 td/osd-backfill-space/4kdata 2024-05-08T17:54:50.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:50.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj322 td/osd-backfill-space/4kdata 2024-05-08T17:54:50.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:50.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj323 td/osd-backfill-space/4kdata 2024-05-08T17:54:51.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:51.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj324 td/osd-backfill-space/4kdata 2024-05-08T17:54:51.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:51.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj325 td/osd-backfill-space/4kdata 2024-05-08T17:54:51.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:51.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj326 td/osd-backfill-space/4kdata 2024-05-08T17:54:51.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:51.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj327 td/osd-backfill-space/4kdata 2024-05-08T17:54:51.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:51.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj328 td/osd-backfill-space/4kdata 2024-05-08T17:54:52.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:52.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj329 td/osd-backfill-space/4kdata 2024-05-08T17:54:52.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:52.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj330 td/osd-backfill-space/4kdata 2024-05-08T17:54:52.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:52.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj331 td/osd-backfill-space/4kdata 2024-05-08T17:54:52.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:52.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj332 td/osd-backfill-space/4kdata 2024-05-08T17:54:52.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:52.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj333 td/osd-backfill-space/4kdata 2024-05-08T17:54:52.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:52.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj334 td/osd-backfill-space/4kdata 2024-05-08T17:54:53.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:53.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj335 td/osd-backfill-space/4kdata 2024-05-08T17:54:53.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:53.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj336 td/osd-backfill-space/4kdata 2024-05-08T17:54:53.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:53.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj337 td/osd-backfill-space/4kdata 2024-05-08T17:54:53.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:53.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj338 td/osd-backfill-space/4kdata 2024-05-08T17:54:53.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:53.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj339 td/osd-backfill-space/4kdata 2024-05-08T17:54:54.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:54.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj340 td/osd-backfill-space/4kdata 2024-05-08T17:54:54.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:54.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj341 td/osd-backfill-space/4kdata 2024-05-08T17:54:54.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:54.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj342 td/osd-backfill-space/4kdata 2024-05-08T17:54:54.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:54.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj343 td/osd-backfill-space/4kdata 2024-05-08T17:54:54.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:54.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj344 td/osd-backfill-space/4kdata 2024-05-08T17:54:55.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:55.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj345 td/osd-backfill-space/4kdata 2024-05-08T17:54:55.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:55.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj346 td/osd-backfill-space/4kdata 2024-05-08T17:54:55.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:55.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj347 td/osd-backfill-space/4kdata 2024-05-08T17:54:55.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:55.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj348 td/osd-backfill-space/4kdata 2024-05-08T17:54:55.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:55.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj349 td/osd-backfill-space/4kdata 2024-05-08T17:54:55.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:55.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj350 td/osd-backfill-space/4kdata 2024-05-08T17:54:56.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:56.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj351 td/osd-backfill-space/4kdata 2024-05-08T17:54:56.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:56.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj352 td/osd-backfill-space/4kdata 2024-05-08T17:54:56.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:56.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj353 td/osd-backfill-space/4kdata 2024-05-08T17:54:56.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:56.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj354 td/osd-backfill-space/4kdata 2024-05-08T17:54:56.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:56.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj355 td/osd-backfill-space/4kdata 2024-05-08T17:54:57.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:57.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj356 td/osd-backfill-space/4kdata 2024-05-08T17:54:57.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:57.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj357 td/osd-backfill-space/4kdata 2024-05-08T17:54:57.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:57.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj358 td/osd-backfill-space/4kdata 2024-05-08T17:54:57.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:57.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj359 td/osd-backfill-space/4kdata 2024-05-08T17:54:57.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:57.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj360 td/osd-backfill-space/4kdata 2024-05-08T17:54:57.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:57.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj361 td/osd-backfill-space/4kdata 2024-05-08T17:54:58.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:58.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj362 td/osd-backfill-space/4kdata 2024-05-08T17:54:58.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:58.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj363 td/osd-backfill-space/4kdata 2024-05-08T17:54:58.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:58.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj364 td/osd-backfill-space/4kdata 2024-05-08T17:54:58.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:58.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj365 td/osd-backfill-space/4kdata 2024-05-08T17:54:58.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:58.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj366 td/osd-backfill-space/4kdata 2024-05-08T17:54:59.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:59.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj367 td/osd-backfill-space/4kdata 2024-05-08T17:54:59.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:59.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj368 td/osd-backfill-space/4kdata 2024-05-08T17:54:59.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:59.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj369 td/osd-backfill-space/4kdata 2024-05-08T17:54:59.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:59.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj370 td/osd-backfill-space/4kdata 2024-05-08T17:54:59.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:59.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj371 td/osd-backfill-space/4kdata 2024-05-08T17:54:59.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:54:59.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj372 td/osd-backfill-space/4kdata 2024-05-08T17:55:00.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:00.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj373 td/osd-backfill-space/4kdata 2024-05-08T17:55:00.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:00.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj374 td/osd-backfill-space/4kdata 2024-05-08T17:55:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj375 td/osd-backfill-space/4kdata 2024-05-08T17:55:00.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:00.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj376 td/osd-backfill-space/4kdata 2024-05-08T17:55:00.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:00.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj377 td/osd-backfill-space/4kdata 2024-05-08T17:55:01.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:01.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj378 td/osd-backfill-space/4kdata 2024-05-08T17:55:01.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:01.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj379 td/osd-backfill-space/4kdata 2024-05-08T17:55:01.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:01.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj380 td/osd-backfill-space/4kdata 2024-05-08T17:55:01.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:01.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj381 td/osd-backfill-space/4kdata 2024-05-08T17:55:01.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:01.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj382 td/osd-backfill-space/4kdata 2024-05-08T17:55:02.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:02.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj383 td/osd-backfill-space/4kdata 2024-05-08T17:55:02.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:02.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj384 td/osd-backfill-space/4kdata 2024-05-08T17:55:02.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:02.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj385 td/osd-backfill-space/4kdata 2024-05-08T17:55:02.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:02.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj386 td/osd-backfill-space/4kdata 2024-05-08T17:55:02.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:02.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj387 td/osd-backfill-space/4kdata 2024-05-08T17:55:02.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:02.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj388 td/osd-backfill-space/4kdata 2024-05-08T17:55:03.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:03.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj389 td/osd-backfill-space/4kdata 2024-05-08T17:55:03.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:03.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj390 td/osd-backfill-space/4kdata 2024-05-08T17:55:03.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:03.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj391 td/osd-backfill-space/4kdata 2024-05-08T17:55:03.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:03.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj392 td/osd-backfill-space/4kdata 2024-05-08T17:55:03.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:03.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj393 td/osd-backfill-space/4kdata 2024-05-08T17:55:04.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:04.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj394 td/osd-backfill-space/4kdata 2024-05-08T17:55:04.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:04.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj395 td/osd-backfill-space/4kdata 2024-05-08T17:55:04.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:04.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj396 td/osd-backfill-space/4kdata 2024-05-08T17:55:04.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:04.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj397 td/osd-backfill-space/4kdata 2024-05-08T17:55:04.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:04.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj398 td/osd-backfill-space/4kdata 2024-05-08T17:55:04.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:04.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj399 td/osd-backfill-space/4kdata 2024-05-08T17:55:05.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:05.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj400 td/osd-backfill-space/4kdata 2024-05-08T17:55:05.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:05.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj401 td/osd-backfill-space/4kdata 2024-05-08T17:55:05.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:05.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj402 td/osd-backfill-space/4kdata 2024-05-08T17:55:05.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:05.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj403 td/osd-backfill-space/4kdata 2024-05-08T17:55:05.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:05.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj404 td/osd-backfill-space/4kdata 2024-05-08T17:55:06.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:06.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj405 td/osd-backfill-space/4kdata 2024-05-08T17:55:06.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:06.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj406 td/osd-backfill-space/4kdata 2024-05-08T17:55:06.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:06.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj407 td/osd-backfill-space/4kdata 2024-05-08T17:55:06.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:06.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj408 td/osd-backfill-space/4kdata 2024-05-08T17:55:06.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:06.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj409 td/osd-backfill-space/4kdata 2024-05-08T17:55:07.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:07.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj410 td/osd-backfill-space/4kdata 2024-05-08T17:55:07.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:07.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj411 td/osd-backfill-space/4kdata 2024-05-08T17:55:07.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:07.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj412 td/osd-backfill-space/4kdata 2024-05-08T17:55:07.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:07.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj413 td/osd-backfill-space/4kdata 2024-05-08T17:55:07.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:07.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj414 td/osd-backfill-space/4kdata 2024-05-08T17:55:08.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:08.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj415 td/osd-backfill-space/4kdata 2024-05-08T17:55:08.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:08.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj416 td/osd-backfill-space/4kdata 2024-05-08T17:55:08.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:08.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj417 td/osd-backfill-space/4kdata 2024-05-08T17:55:08.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:08.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj418 td/osd-backfill-space/4kdata 2024-05-08T17:55:08.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:08.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj419 td/osd-backfill-space/4kdata 2024-05-08T17:55:08.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:08.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj420 td/osd-backfill-space/4kdata 2024-05-08T17:55:09.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:09.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj421 td/osd-backfill-space/4kdata 2024-05-08T17:55:09.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:09.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj422 td/osd-backfill-space/4kdata 2024-05-08T17:55:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj423 td/osd-backfill-space/4kdata 2024-05-08T17:55:09.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:09.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj424 td/osd-backfill-space/4kdata 2024-05-08T17:55:09.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:09.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj425 td/osd-backfill-space/4kdata 2024-05-08T17:55:10.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:10.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj426 td/osd-backfill-space/4kdata 2024-05-08T17:55:10.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:10.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj427 td/osd-backfill-space/4kdata 2024-05-08T17:55:10.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:10.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj428 td/osd-backfill-space/4kdata 2024-05-08T17:55:10.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:10.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj429 td/osd-backfill-space/4kdata 2024-05-08T17:55:10.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:10.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj430 td/osd-backfill-space/4kdata 2024-05-08T17:55:10.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:10.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj431 td/osd-backfill-space/4kdata 2024-05-08T17:55:11.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:11.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj432 td/osd-backfill-space/4kdata 2024-05-08T17:55:11.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:11.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj433 td/osd-backfill-space/4kdata 2024-05-08T17:55:11.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:11.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj434 td/osd-backfill-space/4kdata 2024-05-08T17:55:11.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:11.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj435 td/osd-backfill-space/4kdata 2024-05-08T17:55:11.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:11.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj436 td/osd-backfill-space/4kdata 2024-05-08T17:55:12.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:12.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj437 td/osd-backfill-space/4kdata 2024-05-08T17:55:12.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:12.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj438 td/osd-backfill-space/4kdata 2024-05-08T17:55:12.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:12.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj439 td/osd-backfill-space/4kdata 2024-05-08T17:55:12.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:12.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj440 td/osd-backfill-space/4kdata 2024-05-08T17:55:12.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:12.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj441 td/osd-backfill-space/4kdata 2024-05-08T17:55:13.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:13.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj442 td/osd-backfill-space/4kdata 2024-05-08T17:55:13.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:13.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj443 td/osd-backfill-space/4kdata 2024-05-08T17:55:13.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:13.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj444 td/osd-backfill-space/4kdata 2024-05-08T17:55:13.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:13.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj445 td/osd-backfill-space/4kdata 2024-05-08T17:55:13.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:13.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj446 td/osd-backfill-space/4kdata 2024-05-08T17:55:13.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:13.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj447 td/osd-backfill-space/4kdata 2024-05-08T17:55:14.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:14.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj448 td/osd-backfill-space/4kdata 2024-05-08T17:55:14.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:14.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj449 td/osd-backfill-space/4kdata 2024-05-08T17:55:14.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:14.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj450 td/osd-backfill-space/4kdata 2024-05-08T17:55:14.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:14.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj451 td/osd-backfill-space/4kdata 2024-05-08T17:55:14.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:14.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj452 td/osd-backfill-space/4kdata 2024-05-08T17:55:15.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:15.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj453 td/osd-backfill-space/4kdata 2024-05-08T17:55:15.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:15.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj454 td/osd-backfill-space/4kdata 2024-05-08T17:55:15.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:15.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj455 td/osd-backfill-space/4kdata 2024-05-08T17:55:15.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:15.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj456 td/osd-backfill-space/4kdata 2024-05-08T17:55:15.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:15.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj457 td/osd-backfill-space/4kdata 2024-05-08T17:55:16.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:16.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj458 td/osd-backfill-space/4kdata 2024-05-08T17:55:16.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:16.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj459 td/osd-backfill-space/4kdata 2024-05-08T17:55:16.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:16.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj460 td/osd-backfill-space/4kdata 2024-05-08T17:55:16.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:16.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj461 td/osd-backfill-space/4kdata 2024-05-08T17:55:16.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:16.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj462 td/osd-backfill-space/4kdata 2024-05-08T17:55:17.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:17.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj463 td/osd-backfill-space/4kdata 2024-05-08T17:55:17.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:17.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj464 td/osd-backfill-space/4kdata 2024-05-08T17:55:17.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:17.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj465 td/osd-backfill-space/4kdata 2024-05-08T17:55:17.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:17.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj466 td/osd-backfill-space/4kdata 2024-05-08T17:55:17.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:17.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj467 td/osd-backfill-space/4kdata 2024-05-08T17:55:17.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:17.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj468 td/osd-backfill-space/4kdata 2024-05-08T17:55:18.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:18.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj469 td/osd-backfill-space/4kdata 2024-05-08T17:55:18.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:18.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj470 td/osd-backfill-space/4kdata 2024-05-08T17:55:18.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:18.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj471 td/osd-backfill-space/4kdata 2024-05-08T17:55:18.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:18.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj472 td/osd-backfill-space/4kdata 2024-05-08T17:55:18.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:18.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj473 td/osd-backfill-space/4kdata 2024-05-08T17:55:19.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:19.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj474 td/osd-backfill-space/4kdata 2024-05-08T17:55:19.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:19.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj475 td/osd-backfill-space/4kdata 2024-05-08T17:55:19.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:19.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj476 td/osd-backfill-space/4kdata 2024-05-08T17:55:19.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:19.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj477 td/osd-backfill-space/4kdata 2024-05-08T17:55:19.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:19.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj478 td/osd-backfill-space/4kdata 2024-05-08T17:55:19.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:19.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj479 td/osd-backfill-space/4kdata 2024-05-08T17:55:20.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:20.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj480 td/osd-backfill-space/4kdata 2024-05-08T17:55:20.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:20.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj481 td/osd-backfill-space/4kdata 2024-05-08T17:55:20.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:20.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj482 td/osd-backfill-space/4kdata 2024-05-08T17:55:20.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:20.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj483 td/osd-backfill-space/4kdata 2024-05-08T17:55:20.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:20.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj484 td/osd-backfill-space/4kdata 2024-05-08T17:55:21.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:21.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj485 td/osd-backfill-space/4kdata 2024-05-08T17:55:21.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:21.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj486 td/osd-backfill-space/4kdata 2024-05-08T17:55:21.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:21.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj487 td/osd-backfill-space/4kdata 2024-05-08T17:55:21.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:21.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj488 td/osd-backfill-space/4kdata 2024-05-08T17:55:22.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:22.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj489 td/osd-backfill-space/4kdata 2024-05-08T17:55:22.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:22.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj490 td/osd-backfill-space/4kdata 2024-05-08T17:55:22.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:22.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj491 td/osd-backfill-space/4kdata 2024-05-08T17:55:22.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:22.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj492 td/osd-backfill-space/4kdata 2024-05-08T17:55:22.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:22.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj493 td/osd-backfill-space/4kdata 2024-05-08T17:55:22.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:22.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj494 td/osd-backfill-space/4kdata 2024-05-08T17:55:23.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:23.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj495 td/osd-backfill-space/4kdata 2024-05-08T17:55:23.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:23.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj496 td/osd-backfill-space/4kdata 2024-05-08T17:55:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:23.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj497 td/osd-backfill-space/4kdata 2024-05-08T17:55:23.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:23.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj498 td/osd-backfill-space/4kdata 2024-05-08T17:55:23.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:23.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj499 td/osd-backfill-space/4kdata 2024-05-08T17:55:24.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:24.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj500 td/osd-backfill-space/4kdata 2024-05-08T17:55:24.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:24.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj501 td/osd-backfill-space/4kdata 2024-05-08T17:55:24.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:24.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj502 td/osd-backfill-space/4kdata 2024-05-08T17:55:24.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:24.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj503 td/osd-backfill-space/4kdata 2024-05-08T17:55:24.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:24.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj504 td/osd-backfill-space/4kdata 2024-05-08T17:55:24.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:24.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj505 td/osd-backfill-space/4kdata 2024-05-08T17:55:25.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:25.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj506 td/osd-backfill-space/4kdata 2024-05-08T17:55:25.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:25.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj507 td/osd-backfill-space/4kdata 2024-05-08T17:55:25.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:25.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj508 td/osd-backfill-space/4kdata 2024-05-08T17:55:25.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:25.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj509 td/osd-backfill-space/4kdata 2024-05-08T17:55:25.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:25.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj510 td/osd-backfill-space/4kdata 2024-05-08T17:55:26.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:26.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj511 td/osd-backfill-space/4kdata 2024-05-08T17:55:26.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:26.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj512 td/osd-backfill-space/4kdata 2024-05-08T17:55:26.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:26.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj513 td/osd-backfill-space/4kdata 2024-05-08T17:55:26.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:26.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj514 td/osd-backfill-space/4kdata 2024-05-08T17:55:26.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:26.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj515 td/osd-backfill-space/4kdata 2024-05-08T17:55:26.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:26.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj516 td/osd-backfill-space/4kdata 2024-05-08T17:55:27.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:27.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj517 td/osd-backfill-space/4kdata 2024-05-08T17:55:27.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:27.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj518 td/osd-backfill-space/4kdata 2024-05-08T17:55:27.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:27.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj519 td/osd-backfill-space/4kdata 2024-05-08T17:55:27.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:27.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj520 td/osd-backfill-space/4kdata 2024-05-08T17:55:27.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:27.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj521 td/osd-backfill-space/4kdata 2024-05-08T17:55:28.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:28.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj522 td/osd-backfill-space/4kdata 2024-05-08T17:55:28.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:28.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj523 td/osd-backfill-space/4kdata 2024-05-08T17:55:28.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:28.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj524 td/osd-backfill-space/4kdata 2024-05-08T17:55:28.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:28.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj525 td/osd-backfill-space/4kdata 2024-05-08T17:55:28.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:28.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj526 td/osd-backfill-space/4kdata 2024-05-08T17:55:28.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:28.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj527 td/osd-backfill-space/4kdata 2024-05-08T17:55:29.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:29.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj528 td/osd-backfill-space/4kdata 2024-05-08T17:55:29.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:29.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj529 td/osd-backfill-space/4kdata 2024-05-08T17:55:29.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:29.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj530 td/osd-backfill-space/4kdata 2024-05-08T17:55:29.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:29.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj531 td/osd-backfill-space/4kdata 2024-05-08T17:55:29.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:29.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj532 td/osd-backfill-space/4kdata 2024-05-08T17:55:30.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:30.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj533 td/osd-backfill-space/4kdata 2024-05-08T17:55:30.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:30.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj534 td/osd-backfill-space/4kdata 2024-05-08T17:55:30.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:30.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj535 td/osd-backfill-space/4kdata 2024-05-08T17:55:30.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:30.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj536 td/osd-backfill-space/4kdata 2024-05-08T17:55:30.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:30.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj537 td/osd-backfill-space/4kdata 2024-05-08T17:55:30.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:30.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj538 td/osd-backfill-space/4kdata 2024-05-08T17:55:31.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:31.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj539 td/osd-backfill-space/4kdata 2024-05-08T17:55:31.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:31.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj540 td/osd-backfill-space/4kdata 2024-05-08T17:55:31.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:31.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj541 td/osd-backfill-space/4kdata 2024-05-08T17:55:31.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:31.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj542 td/osd-backfill-space/4kdata 2024-05-08T17:55:31.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:31.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj543 td/osd-backfill-space/4kdata 2024-05-08T17:55:32.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:32.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj544 td/osd-backfill-space/4kdata 2024-05-08T17:55:32.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:32.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj545 td/osd-backfill-space/4kdata 2024-05-08T17:55:32.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:32.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj546 td/osd-backfill-space/4kdata 2024-05-08T17:55:32.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj547 td/osd-backfill-space/4kdata 2024-05-08T17:55:32.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:32.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj548 td/osd-backfill-space/4kdata 2024-05-08T17:55:32.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:32.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj549 td/osd-backfill-space/4kdata 2024-05-08T17:55:33.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:33.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj550 td/osd-backfill-space/4kdata 2024-05-08T17:55:33.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:33.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj551 td/osd-backfill-space/4kdata 2024-05-08T17:55:33.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:33.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj552 td/osd-backfill-space/4kdata 2024-05-08T17:55:33.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:33.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj553 td/osd-backfill-space/4kdata 2024-05-08T17:55:33.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:33.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj554 td/osd-backfill-space/4kdata 2024-05-08T17:55:34.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:34.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj555 td/osd-backfill-space/4kdata 2024-05-08T17:55:34.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:34.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj556 td/osd-backfill-space/4kdata 2024-05-08T17:55:34.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:34.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj557 td/osd-backfill-space/4kdata 2024-05-08T17:55:34.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:34.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj558 td/osd-backfill-space/4kdata 2024-05-08T17:55:34.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:34.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj559 td/osd-backfill-space/4kdata 2024-05-08T17:55:35.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:35.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj560 td/osd-backfill-space/4kdata 2024-05-08T17:55:35.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:35.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj561 td/osd-backfill-space/4kdata 2024-05-08T17:55:35.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:35.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj562 td/osd-backfill-space/4kdata 2024-05-08T17:55:35.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:35.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj563 td/osd-backfill-space/4kdata 2024-05-08T17:55:35.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:35.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj564 td/osd-backfill-space/4kdata 2024-05-08T17:55:35.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:35.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj565 td/osd-backfill-space/4kdata 2024-05-08T17:55:36.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:36.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj566 td/osd-backfill-space/4kdata 2024-05-08T17:55:36.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:36.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj567 td/osd-backfill-space/4kdata 2024-05-08T17:55:36.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:36.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj568 td/osd-backfill-space/4kdata 2024-05-08T17:55:36.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:36.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj569 td/osd-backfill-space/4kdata 2024-05-08T17:55:36.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:36.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj570 td/osd-backfill-space/4kdata 2024-05-08T17:55:36.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:36.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj571 td/osd-backfill-space/4kdata 2024-05-08T17:55:37.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:37.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj572 td/osd-backfill-space/4kdata 2024-05-08T17:55:37.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:37.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj573 td/osd-backfill-space/4kdata 2024-05-08T17:55:37.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:37.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj574 td/osd-backfill-space/4kdata 2024-05-08T17:55:37.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:37.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj575 td/osd-backfill-space/4kdata 2024-05-08T17:55:37.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:37.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj576 td/osd-backfill-space/4kdata 2024-05-08T17:55:38.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:38.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj577 td/osd-backfill-space/4kdata 2024-05-08T17:55:38.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:38.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj578 td/osd-backfill-space/4kdata 2024-05-08T17:55:38.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:38.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj579 td/osd-backfill-space/4kdata 2024-05-08T17:55:38.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:38.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj580 td/osd-backfill-space/4kdata 2024-05-08T17:55:38.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:38.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj581 td/osd-backfill-space/4kdata 2024-05-08T17:55:38.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:38.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj582 td/osd-backfill-space/4kdata 2024-05-08T17:55:38.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:38.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj583 td/osd-backfill-space/4kdata 2024-05-08T17:55:39.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:39.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj584 td/osd-backfill-space/4kdata 2024-05-08T17:55:39.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:39.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj585 td/osd-backfill-space/4kdata 2024-05-08T17:55:39.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:39.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj586 td/osd-backfill-space/4kdata 2024-05-08T17:55:39.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:39.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj587 td/osd-backfill-space/4kdata 2024-05-08T17:55:39.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:39.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj588 td/osd-backfill-space/4kdata 2024-05-08T17:55:39.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:39.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj589 td/osd-backfill-space/4kdata 2024-05-08T17:55:39.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:39.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj590 td/osd-backfill-space/4kdata 2024-05-08T17:55:40.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:40.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj591 td/osd-backfill-space/4kdata 2024-05-08T17:55:40.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:40.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj592 td/osd-backfill-space/4kdata 2024-05-08T17:55:40.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:40.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj593 td/osd-backfill-space/4kdata 2024-05-08T17:55:40.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:40.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj594 td/osd-backfill-space/4kdata 2024-05-08T17:55:40.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:40.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj595 td/osd-backfill-space/4kdata 2024-05-08T17:55:40.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:40.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj596 td/osd-backfill-space/4kdata 2024-05-08T17:55:40.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:40.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj597 td/osd-backfill-space/4kdata 2024-05-08T17:55:41.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:41.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj598 td/osd-backfill-space/4kdata 2024-05-08T17:55:41.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:41.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj599 td/osd-backfill-space/4kdata 2024-05-08T17:55:41.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-05-08T17:55:41.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj600 td/osd-backfill-space/4kdata 2024-05-08T17:55:41.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:584: TEST_backfill_grow: get_pg test obj1 2024-05-08T17:55:41.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T17:55:41.502 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T17:55:41.502 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T17:55:41.502 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T17:55:41.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:584: TEST_backfill_grow: local PG=1.0 2024-05-08T17:55:41.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:586: TEST_backfill_grow: get_primary test obj1 2024-05-08T17:55:41.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T17:55:41.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T17:55:41.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T17:55:41.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T17:55:42.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:586: TEST_backfill_grow: local primary=1 2024-05-08T17:55:42.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:587: TEST_backfill_grow: get_not_primary test obj1 2024-05-08T17:55:42.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T17:55:42.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T17:55:42.386 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T17:55:42.386 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T17:55:42.386 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T17:55:42.386 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T17:55:42.386 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T17:55:42.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T17:55:42.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T17:55:42.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T17:55:43.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:587: TEST_backfill_grow: local otherosd=0 2024-05-08T17:55:43.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:589: TEST_backfill_grow: ceph osd set noout 2024-05-08T17:55:43.927 INFO:tasks.workunit.client.0.smithi117.stderr:noout is set 2024-05-08T17:55:43.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:590: TEST_backfill_grow: kill_daemons td/osd-backfill-space TERM 0 2024-05-08T17:55:43.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:55:43.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:55:43.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:55:43.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:55:43.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:55:45.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:55:45.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:592: TEST_backfill_grow: expr 600 / 4 2024-05-08T17:55:45.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:592: TEST_backfill_grow: rmobjects=150 2024-05-08T17:55:45.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: seq 1 150 2024-05-08T17:55:45.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:45.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj1 2024-05-08T17:55:45.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:45.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj2 2024-05-08T17:55:45.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:45.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj3 2024-05-08T17:55:45.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:45.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj4 2024-05-08T17:55:45.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:45.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj5 2024-05-08T17:55:45.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:45.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj6 2024-05-08T17:55:45.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:45.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj7 2024-05-08T17:55:46.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:46.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj8 2024-05-08T17:55:46.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:46.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj9 2024-05-08T17:55:46.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:46.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj10 2024-05-08T17:55:46.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:46.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj11 2024-05-08T17:55:46.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:46.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj12 2024-05-08T17:55:46.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:46.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj13 2024-05-08T17:55:46.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:46.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj14 2024-05-08T17:55:46.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:46.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj15 2024-05-08T17:55:47.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:47.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj16 2024-05-08T17:55:47.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:47.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj17 2024-05-08T17:55:47.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:47.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj18 2024-05-08T17:55:47.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:47.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj19 2024-05-08T17:55:47.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:47.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj20 2024-05-08T17:55:47.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:47.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj21 2024-05-08T17:55:47.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:47.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj22 2024-05-08T17:55:48.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:48.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj23 2024-05-08T17:55:48.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:48.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj24 2024-05-08T17:55:48.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:48.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj25 2024-05-08T17:55:48.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:48.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj26 2024-05-08T17:55:48.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:48.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj27 2024-05-08T17:55:48.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:48.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj28 2024-05-08T17:55:48.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:48.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj29 2024-05-08T17:55:48.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:48.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj30 2024-05-08T17:55:49.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj31 2024-05-08T17:55:49.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj32 2024-05-08T17:55:49.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj33 2024-05-08T17:55:49.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj34 2024-05-08T17:55:49.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj35 2024-05-08T17:55:49.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj36 2024-05-08T17:55:49.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj37 2024-05-08T17:55:49.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj38 2024-05-08T17:55:49.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:49.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj39 2024-05-08T17:55:50.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj40 2024-05-08T17:55:50.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj41 2024-05-08T17:55:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj42 2024-05-08T17:55:50.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj43 2024-05-08T17:55:50.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj44 2024-05-08T17:55:50.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj45 2024-05-08T17:55:50.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj46 2024-05-08T17:55:50.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj47 2024-05-08T17:55:50.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:50.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj48 2024-05-08T17:55:51.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:51.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj49 2024-05-08T17:55:51.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:51.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj50 2024-05-08T17:55:51.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:51.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj51 2024-05-08T17:55:51.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:51.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj52 2024-05-08T17:55:51.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj53 2024-05-08T17:55:51.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:51.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj54 2024-05-08T17:55:51.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:51.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj55 2024-05-08T17:55:51.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:51.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj56 2024-05-08T17:55:52.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:52.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj57 2024-05-08T17:55:52.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:52.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj58 2024-05-08T17:55:52.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:52.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj59 2024-05-08T17:55:52.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:52.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj60 2024-05-08T17:55:52.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:52.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj61 2024-05-08T17:55:52.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:52.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj62 2024-05-08T17:55:53.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj63 2024-05-08T17:55:53.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj64 2024-05-08T17:55:53.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj65 2024-05-08T17:55:53.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj66 2024-05-08T17:55:53.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj67 2024-05-08T17:55:53.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj68 2024-05-08T17:55:53.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj69 2024-05-08T17:55:53.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj70 2024-05-08T17:55:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj71 2024-05-08T17:55:54.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:54.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj72 2024-05-08T17:55:54.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:54.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj73 2024-05-08T17:55:54.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:54.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj74 2024-05-08T17:55:54.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:54.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj75 2024-05-08T17:55:54.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:54.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj76 2024-05-08T17:55:54.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:54.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj77 2024-05-08T17:55:54.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:54.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj78 2024-05-08T17:55:54.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:54.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj79 2024-05-08T17:55:55.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj80 2024-05-08T17:55:55.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj81 2024-05-08T17:55:55.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj82 2024-05-08T17:55:55.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj83 2024-05-08T17:55:55.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj84 2024-05-08T17:55:55.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj85 2024-05-08T17:55:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj86 2024-05-08T17:55:55.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj87 2024-05-08T17:55:55.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:55.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj88 2024-05-08T17:55:56.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj89 2024-05-08T17:55:56.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj90 2024-05-08T17:55:56.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj91 2024-05-08T17:55:56.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj92 2024-05-08T17:55:56.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj93 2024-05-08T17:55:56.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj94 2024-05-08T17:55:56.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj95 2024-05-08T17:55:56.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj96 2024-05-08T17:55:56.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:56.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj97 2024-05-08T17:55:57.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:57.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj98 2024-05-08T17:55:57.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:57.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj99 2024-05-08T17:55:57.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:57.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj100 2024-05-08T17:55:57.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:57.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj101 2024-05-08T17:55:57.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:57.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj102 2024-05-08T17:55:57.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:57.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj103 2024-05-08T17:55:57.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:57.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj104 2024-05-08T17:55:57.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:57.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj105 2024-05-08T17:55:58.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj106 2024-05-08T17:55:58.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj107 2024-05-08T17:55:58.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj108 2024-05-08T17:55:58.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj109 2024-05-08T17:55:58.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj110 2024-05-08T17:55:58.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj111 2024-05-08T17:55:58.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj112 2024-05-08T17:55:58.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj113 2024-05-08T17:55:58.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:58.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj114 2024-05-08T17:55:59.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:59.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj115 2024-05-08T17:55:59.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:59.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj116 2024-05-08T17:55:59.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:59.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj117 2024-05-08T17:55:59.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:59.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj118 2024-05-08T17:55:59.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:59.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj119 2024-05-08T17:55:59.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:59.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj120 2024-05-08T17:55:59.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:59.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj121 2024-05-08T17:55:59.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:55:59.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj122 2024-05-08T17:56:00.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj123 2024-05-08T17:56:00.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj124 2024-05-08T17:56:00.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj125 2024-05-08T17:56:00.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj126 2024-05-08T17:56:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj127 2024-05-08T17:56:00.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj128 2024-05-08T17:56:00.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj129 2024-05-08T17:56:00.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj130 2024-05-08T17:56:00.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:00.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj131 2024-05-08T17:56:01.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:01.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj132 2024-05-08T17:56:01.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:01.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj133 2024-05-08T17:56:01.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:01.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj134 2024-05-08T17:56:01.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:01.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj135 2024-05-08T17:56:01.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:01.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj136 2024-05-08T17:56:01.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:01.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj137 2024-05-08T17:56:01.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:01.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj138 2024-05-08T17:56:01.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:01.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj139 2024-05-08T17:56:02.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:02.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj140 2024-05-08T17:56:02.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:02.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj141 2024-05-08T17:56:02.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:02.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj142 2024-05-08T17:56:02.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:02.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj143 2024-05-08T17:56:02.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:02.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj144 2024-05-08T17:56:02.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:02.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj145 2024-05-08T17:56:02.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:02.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj146 2024-05-08T17:56:02.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:02.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj147 2024-05-08T17:56:03.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:03.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj148 2024-05-08T17:56:03.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:03.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj149 2024-05-08T17:56:03.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T17:56:03.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj150 2024-05-08T17:56:03.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:598: TEST_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/6kdata bs=6k count=1 2024-05-08T17:56:03.399 INFO:tasks.workunit.client.0.smithi117.stderr:1+0 records in 2024-05-08T17:56:03.399 INFO:tasks.workunit.client.0.smithi117.stderr:1+0 records out 2024-05-08T17:56:03.399 INFO:tasks.workunit.client.0.smithi117.stderr:6144 bytes (6.1 kB, 6.0 KiB) copied, 0.000309907 s, 19.8 MB/s 2024-05-08T17:56:03.400 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: expr 150 + 1 2024-05-08T17:56:03.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: seq 151 600 2024-05-08T17:56:03.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:03.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj151 td/osd-backfill-space/6kdata 2024-05-08T17:56:03.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:03.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj152 td/osd-backfill-space/6kdata 2024-05-08T17:56:03.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:03.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj153 td/osd-backfill-space/6kdata 2024-05-08T17:56:03.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:03.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj154 td/osd-backfill-space/6kdata 2024-05-08T17:56:03.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:03.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj155 td/osd-backfill-space/6kdata 2024-05-08T17:56:03.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:03.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj156 td/osd-backfill-space/6kdata 2024-05-08T17:56:04.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:04.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj157 td/osd-backfill-space/6kdata 2024-05-08T17:56:04.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:04.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj158 td/osd-backfill-space/6kdata 2024-05-08T17:56:04.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:04.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj159 td/osd-backfill-space/6kdata 2024-05-08T17:56:04.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:04.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj160 td/osd-backfill-space/6kdata 2024-05-08T17:56:04.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:04.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj161 td/osd-backfill-space/6kdata 2024-05-08T17:56:04.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:04.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj162 td/osd-backfill-space/6kdata 2024-05-08T17:56:04.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:04.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj163 td/osd-backfill-space/6kdata 2024-05-08T17:56:04.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:04.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj164 td/osd-backfill-space/6kdata 2024-05-08T17:56:05.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:05.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj165 td/osd-backfill-space/6kdata 2024-05-08T17:56:05.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:05.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj166 td/osd-backfill-space/6kdata 2024-05-08T17:56:05.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:05.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj167 td/osd-backfill-space/6kdata 2024-05-08T17:56:05.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:05.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj168 td/osd-backfill-space/6kdata 2024-05-08T17:56:05.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:05.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj169 td/osd-backfill-space/6kdata 2024-05-08T17:56:05.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:05.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj170 td/osd-backfill-space/6kdata 2024-05-08T17:56:05.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:05.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj171 td/osd-backfill-space/6kdata 2024-05-08T17:56:05.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:05.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj172 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj173 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj174 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj175 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj176 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj177 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj178 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj179 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj180 td/osd-backfill-space/6kdata 2024-05-08T17:56:06.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:06.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj181 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj182 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj183 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj184 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj185 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj186 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj187 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj188 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj189 td/osd-backfill-space/6kdata 2024-05-08T17:56:07.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:07.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj190 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj191 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj192 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj193 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj194 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj195 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj196 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj197 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj198 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj199 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj200 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj201 td/osd-backfill-space/6kdata 2024-05-08T17:56:08.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:08.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj202 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj203 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj204 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj205 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj206 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj207 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj208 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj209 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj210 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj211 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj212 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj213 td/osd-backfill-space/6kdata 2024-05-08T17:56:09.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:09.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj214 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj215 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj216 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj217 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj218 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj219 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj220 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj221 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj222 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj223 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj224 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj225 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj226 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj227 td/osd-backfill-space/6kdata 2024-05-08T17:56:10.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:10.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj228 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj229 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj230 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj231 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj232 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj233 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj234 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj235 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj236 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj237 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj238 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj239 td/osd-backfill-space/6kdata 2024-05-08T17:56:11.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:11.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj240 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj241 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj242 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj243 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj244 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj245 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj246 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj247 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj248 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj249 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj250 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj251 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj252 td/osd-backfill-space/6kdata 2024-05-08T17:56:12.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:12.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj253 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj254 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj255 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj256 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj257 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj258 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj259 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj260 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj261 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj262 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj263 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj264 td/osd-backfill-space/6kdata 2024-05-08T17:56:13.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:13.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj265 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj266 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj267 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj268 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj269 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj270 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj271 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj272 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj273 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj274 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj275 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj276 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj277 td/osd-backfill-space/6kdata 2024-05-08T17:56:14.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:14.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj278 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj279 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj280 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj281 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj282 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj283 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj284 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj285 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj286 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj287 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj288 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj289 td/osd-backfill-space/6kdata 2024-05-08T17:56:15.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:15.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj290 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj291 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj292 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj293 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj294 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj295 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj296 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj297 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj298 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj299 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj300 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj301 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj302 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj303 td/osd-backfill-space/6kdata 2024-05-08T17:56:16.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:16.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj304 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj305 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj306 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj307 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj308 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj309 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj310 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj311 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj312 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj313 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj314 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj315 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj316 td/osd-backfill-space/6kdata 2024-05-08T17:56:17.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:17.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj317 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj318 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj319 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj320 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj321 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj322 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj323 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj324 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj325 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj326 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj327 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj328 td/osd-backfill-space/6kdata 2024-05-08T17:56:18.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:18.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj329 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj330 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj331 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj332 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj333 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj334 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj335 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj336 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj337 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj338 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj339 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj340 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj341 td/osd-backfill-space/6kdata 2024-05-08T17:56:19.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:19.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj342 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj343 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj344 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj345 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj346 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj347 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj348 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj349 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj350 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj351 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj352 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj353 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj354 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj355 td/osd-backfill-space/6kdata 2024-05-08T17:56:20.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:20.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj356 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj357 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj358 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj359 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj360 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj361 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj362 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj363 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj364 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj365 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj366 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj367 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj368 td/osd-backfill-space/6kdata 2024-05-08T17:56:21.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:21.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj369 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj370 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj371 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj372 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj373 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj374 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj375 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj376 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj377 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj378 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj379 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj380 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj381 td/osd-backfill-space/6kdata 2024-05-08T17:56:22.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:22.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj382 td/osd-backfill-space/6kdata 2024-05-08T17:56:23.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:23.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj383 td/osd-backfill-space/6kdata 2024-05-08T17:56:23.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:23.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj384 td/osd-backfill-space/6kdata 2024-05-08T17:56:23.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:23.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj385 td/osd-backfill-space/6kdata 2024-05-08T17:56:23.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:23.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj386 td/osd-backfill-space/6kdata 2024-05-08T17:56:23.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:23.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj387 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj388 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj389 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj390 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj391 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj392 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj393 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj394 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj395 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj396 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj397 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj398 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj399 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj400 td/osd-backfill-space/6kdata 2024-05-08T17:56:24.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:24.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj401 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj402 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj403 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj404 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj405 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj406 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj407 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj408 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj409 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj410 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj411 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj412 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj413 td/osd-backfill-space/6kdata 2024-05-08T17:56:25.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:25.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj414 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj415 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj416 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj417 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj418 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj419 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj420 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj421 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj422 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj423 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj424 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj425 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj426 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj427 td/osd-backfill-space/6kdata 2024-05-08T17:56:26.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:26.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj428 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj429 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj430 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj431 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj432 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj433 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj434 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj435 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj436 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj437 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj438 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj439 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj440 td/osd-backfill-space/6kdata 2024-05-08T17:56:27.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:27.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj441 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj442 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj443 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj444 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj445 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj446 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj447 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj448 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj449 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj450 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj451 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj452 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj453 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj454 td/osd-backfill-space/6kdata 2024-05-08T17:56:28.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:28.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj455 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj456 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj457 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj458 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj459 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj460 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj461 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj462 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj463 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj464 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj465 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj466 td/osd-backfill-space/6kdata 2024-05-08T17:56:29.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:29.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj467 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj468 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj469 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj470 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj471 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj472 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj473 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj474 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj475 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj476 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj477 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj478 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj479 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj480 td/osd-backfill-space/6kdata 2024-05-08T17:56:30.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:30.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj481 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj482 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj483 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj484 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj485 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj486 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj487 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj488 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj489 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj490 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj491 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj492 td/osd-backfill-space/6kdata 2024-05-08T17:56:31.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:31.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj493 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj494 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj495 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj496 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj497 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj498 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj499 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj500 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj501 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj502 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj503 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj504 td/osd-backfill-space/6kdata 2024-05-08T17:56:32.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:32.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj505 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj506 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj507 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj508 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj509 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj510 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj511 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj512 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj513 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj514 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj515 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj516 td/osd-backfill-space/6kdata 2024-05-08T17:56:33.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:33.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj517 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj518 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj519 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj520 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj521 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj522 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj523 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj524 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj525 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj526 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj527 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj528 td/osd-backfill-space/6kdata 2024-05-08T17:56:34.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:34.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj529 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj530 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj531 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj532 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj533 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj534 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj535 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj536 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj537 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj538 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj539 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj540 td/osd-backfill-space/6kdata 2024-05-08T17:56:35.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:35.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj541 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj542 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj543 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj544 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj545 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj546 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj547 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj548 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj549 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj550 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj551 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj552 td/osd-backfill-space/6kdata 2024-05-08T17:56:36.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:36.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj553 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj554 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj555 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj556 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj557 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj558 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj559 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj560 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj561 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj562 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj563 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj564 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj565 td/osd-backfill-space/6kdata 2024-05-08T17:56:37.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:37.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj566 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj567 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj568 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj569 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj570 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj571 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj572 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj573 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj574 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj575 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj576 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj577 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj578 td/osd-backfill-space/6kdata 2024-05-08T17:56:38.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:38.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj579 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj580 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj581 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj582 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj583 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj584 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj585 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj586 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj587 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj588 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj589 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj590 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj591 td/osd-backfill-space/6kdata 2024-05-08T17:56:39.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:39.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj592 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:40.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj593 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:40.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj594 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:40.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj595 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:40.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj596 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:40.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj597 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:40.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj598 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:40.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj599 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-05-08T17:56:40.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj600 td/osd-backfill-space/6kdata 2024-05-08T17:56:40.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:604: TEST_backfill_grow: activate_osd td/osd-backfill-space 0 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/osd-backfill-space 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2024-05-08T17:56:40.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2024-05-08T17:56:40.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T17:56:40.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2024-05-08T17:56:40.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:56:40.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:56:40.643 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:56:40.643 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:56:40.643 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:56:40.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:56:40.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:56:40.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:56:40.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T17:56:40.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T17:56:40.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:56:40.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:56:40.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:56:40.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:56:40.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2024-05-08T17:56:40.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2024-05-08T17:56:40.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T17:56:40.645 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:56:40.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2024-05-08T17:56:40.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:56:40.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/osd-backfill-space/0/whoami 2024-05-08T17:56:40.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2024-05-08T17:56:40.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2024-05-08T17:56:40.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2024-05-08T17:56:40.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2024-05-08T17:56:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:56:40.681+0000 7ffaf5f687c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:56:40.681 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:56:40.685+0000 7ffaf5f687c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:56:40.682 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:56:40.685+0000 7ffaf5f687c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:56:41.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2024-05-08T17:56:41.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:56:41.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:56:41.084 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:56:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:56:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:56:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:56:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:56:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:56:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:56:41.254 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:56:41.257+0000 7ffaf5f687c0 -1 Falling back to public interface 2024-05-08T17:56:41.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:56:42.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:56:42.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:56:42.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:56:42.522 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:56:42.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:56:42.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:56:42.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:56:43.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:56:43.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:56:43.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:56:43.997 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:56:43.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:56:43.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:56:44.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:56:44.530 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:56:44.533+0000 7ffaf5f687c0 -1 osd.0 24 log_to_monitors true 2024-05-08T17:56:45.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:56:45.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:56:45.414 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:56:45.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:56:45.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:56:45.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:56:45.847 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 28 up_thru 0 down_at 25 last_clean_interval [5,24) [v2:127.0.0.1:6802/1750363760,v1:127.0.0.1:6803/1750363760] [v2:127.0.0.1:6804/1750363760,v1:127.0.0.1:6805/1750363760] exists,up 4873b7f8-1f5b-4d4c-a7ea-03f1a984efe8 2024-05-08T17:56:45.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:56:45.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:56:45.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:56:45.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:606: TEST_backfill_grow: ceph tell osd.1 debug kick_recovery_wq 0 2024-05-08T17:56:46.034 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T17:56:46.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:608: TEST_backfill_grow: sleep 2 2024-05-08T17:56:48.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:610: TEST_backfill_grow: wait_for_clean 2024-05-08T17:56:48.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:56:48.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:56:48.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:56:48.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:56:48.054 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:56:48.054 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:56:48.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:56:48.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:56:48.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:56:48.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:56:48.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:56:48.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:56:48.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:56:48.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:56:48.176 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:56:48.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:56:48.619 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:56:48.619 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T17:56:48.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:56:48.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:56:48.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:56:48.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=120259084291 2024-05-08T17:56:48.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 120259084291 2024-05-08T17:56:48.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-120259084291' 2024-05-08T17:56:48.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:56:48.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:56:49.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673017 2024-05-08T17:56:49.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673017 2024-05-08T17:56:49.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-120259084291 1-42949673017' 2024-05-08T17:56:49.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:56:49.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:56:49.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509494 2024-05-08T17:56:49.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509494 2024-05-08T17:56:49.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-120259084291 1-42949673017 2-64424509494' 2024-05-08T17:56:49.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:56:49.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-120259084291 2024-05-08T17:56:49.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:56:49.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:56:49.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-120259084291 2024-05-08T17:56:49.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:56:49.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=120259084291 2024-05-08T17:56:49.382 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 120259084291 2024-05-08T17:56:49.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 120259084291' 2024-05-08T17:56:49.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:56:49.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 1 -lt 120259084291 2024-05-08T17:56:49.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:56:50.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:56:50.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:56:51.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 120259084292 -lt 120259084291 2024-05-08T17:56:51.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:56:51.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:56:51.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673017 2024-05-08T17:56:51.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:56:51.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673017 2024-05-08T17:56:51.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:56:51.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673017 2024-05-08T17:56:51.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673017' 2024-05-08T17:56:51.257 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673017 2024-05-08T17:56:51.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:56:51.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673017 -lt 42949673017 2024-05-08T17:56:51.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:56:51.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509494 2024-05-08T17:56:51.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:56:51.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:56:51.718 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509494 2024-05-08T17:56:51.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:56:51.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509494 2024-05-08T17:56:51.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509494' 2024-05-08T17:56:51.720 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509494 2024-05-08T17:56:51.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:56:52.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509494 -lt 64424509494 2024-05-08T17:56:52.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:56:52.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:56:52.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:56:52.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T17:56:52.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:56:52.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:56:52.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:56:52.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:56:52.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:56:52.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:56:52.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:56:53.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:56:53.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:56:53.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:56:53.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:56:54.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:56:54.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T17:56:54.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T17:56:54.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T17:56:54.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:56:54.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:56:54.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:56:54.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:56:54.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:56:54.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:56:54.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:56:54.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:56:54.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:56:54.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:56:54.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:56:54.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:56:54.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:56:54.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:56:55.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:56:55.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:56:55.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:56:55.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:56:55.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:56:55.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:56:55.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:56:55.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:56:55.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:56:55.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=35348 2024-05-08T17:56:55.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 35348 '!=' null 2024-05-08T17:56:55.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:56:55.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:56:55.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:56:55.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:56:55.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:56:55.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:56:55.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:56:55.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:56:55.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:56:55.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:56:55.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:56:56.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:56:56.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:56:56.386 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:56:56.386 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:56:56.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:56:57.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=29487 2024-05-08T17:56:57.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 29487 '!=' null 2024-05-08T17:56:57.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:56:57.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:56:57.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:56:57.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:56:57.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:56:57.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:56:57.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:56:57.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:56:57.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:56:57.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:56:57.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:56:58.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:56:58.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:56:58.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:56:58.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:56:58.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:56:58.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:56:58.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:56:58.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:56:58.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:56:58.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:56:58.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:56:58.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:56:58.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:56:59.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=48809 2024-05-08T17:56:59.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 48809 '!=' null 2024-05-08T17:56:59.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:56:59.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:56:59.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:56:59.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:56:59.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:56:59.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:56:59.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:56:59.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:56:59.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:56:59.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:56:59.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:56:59.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:56:59.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:56:59.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:56:59.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:00.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:00.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:01.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=48633 2024-05-08T17:57:01.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 48633 '!=' null 2024-05-08T17:57:01.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:01.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:01.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:01.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:01.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:01.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:01.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:01.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:01.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:01.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:01.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:01.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:01.610 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:01.610 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:01.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:02.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:02.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:02.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:02.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:02.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:02.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:02.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:02.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:02.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:02.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=48633 2024-05-08T17:57:02.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 48633 '!=' null 2024-05-08T17:57:02.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:02.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:02.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:02.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:02.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:02.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:02.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:02.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:02.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:02.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:02.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:03.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:03.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:03.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:03.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:03.926 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:03.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:04.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=96756 2024-05-08T17:57:04.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 96756 '!=' null 2024-05-08T17:57:04.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:04.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:04.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:04.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:04.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:04.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:04.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:04.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:04.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:04.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:04.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:05.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:05.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:05.166 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:05.166 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:05.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:05.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:05.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:05.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:05.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:05.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:05.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:05.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:05.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:06.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=79351 2024-05-08T17:57:06.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 79351 '!=' null 2024-05-08T17:57:06.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:06.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:06.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:06.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:06.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:06.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:06.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:06.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:06.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:06.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:06.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:06.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:06.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:06.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:06.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:07.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:07.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:07.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:07.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:07.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:07.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:07.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:07.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:07.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:08.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=79351 2024-05-08T17:57:08.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 79351 '!=' null 2024-05-08T17:57:08.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:08.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:08.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:08.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:08.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:08.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:08.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:08.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:08.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:08.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:08.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:08.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:08.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:08.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:08.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:09.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:09.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:09.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:09.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:09.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:09.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:09.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:09.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:09.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=140273 2024-05-08T17:57:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 140273 '!=' null 2024-05-08T17:57:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:10.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:10.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:10.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:10.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:10.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:10.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:10.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:10.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:10.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:10.457 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:10.457 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:10.457 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:10.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:10.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:10.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:10.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:10.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:10.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:10.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:10.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:10.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:11.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=116211 2024-05-08T17:57:11.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 116211 '!=' null 2024-05-08T17:57:11.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:11.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:11.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:11.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:11.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:11.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:11.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:11.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:11.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:11.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:11.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:12.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:12.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:12.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:12.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:12.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:12.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:13.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=176109 2024-05-08T17:57:13.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 176109 '!=' null 2024-05-08T17:57:13.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:13.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:13.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:13.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:13.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:13.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:13.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:13.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:13.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:13.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:13.351 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:13.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:13.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:13.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:13.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:14.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:14.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:14.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:14.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:14.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:14.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:14.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:14.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:14.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:14.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=181236 2024-05-08T17:57:14.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 181236 '!=' null 2024-05-08T17:57:14.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:14.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:14.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:15.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:15.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:15.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:15.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:15.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:15.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:15.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:15.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:15.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:15.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:15.470 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:15.470 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:15.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:15.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:15.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:15.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:15.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:15.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:15.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:15.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:15.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:16.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=181236 2024-05-08T17:57:16.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 181236 '!=' null 2024-05-08T17:57:16.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:16.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:16.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:16.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:16.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:16.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:16.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:16.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:16.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:16.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:16.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:17.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T17:57:17.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:17.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:17.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:17.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T17:57:17.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T17:57:17.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T17:57:17.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T17:57:17.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T17:57:17.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T17:57:17.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T17:57:17.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T17:57:17.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T17:57:18.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=89847 2024-05-08T17:57:18.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 89847 '!=' null 2024-05-08T17:57:18.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T17:57:18.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T17:57:18.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T17:57:18.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T17:57:18.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:57:18.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:57:18.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:57:18.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:57:18.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:57:18.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:57:18.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:57:18.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T17:57:18.706 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:57:18.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:57:18.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:57:19.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T17:57:19.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:57:19.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:57:19.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:612: TEST_backfill_grow: delete_pool test 2024-05-08T17:57:19.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T17:57:19.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T17:57:19.799 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T17:57:19.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:613: TEST_backfill_grow: kill_daemons td/osd-backfill-space 2024-05-08T17:57:19.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:57:19.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:57:19.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:57:19.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:57:19.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:57:25.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:57:25.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:614: TEST_backfill_grow: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2024-05-08T17:57:25.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-05-08T17:57:25.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T17:57:25.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:57:25.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T17:57:25.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:57:25.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:57:25.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:57:25.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:57:25.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:57:25.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:57:25.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:57:25.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:57:25.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:57:25.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:57:25.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:57:25.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:57:25.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:57:25.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:57:25.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:57:25.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:57:25.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:57:25.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:57:25.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T17:57:25.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:57:25.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:57:25.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:57:25.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T17:57:25.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T17:57:25.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T17:57:25.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T17:57:25.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T17:57:25.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T17:57:25.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T17:57:25.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T17:57:25.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T17:57:25.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T17:57:25.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:57:25.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:57:25.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T17:57:25.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T17:57:25.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T17:57:25.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2024-05-08T17:57:25.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T17:57:25.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:57:25.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:57:25.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.109971 2024-05-08T17:57:25.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_multi_partial td/osd-backfill-space 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:430: TEST_backfill_multi_partial: local dir=td/osd-backfill-space 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:431: TEST_backfill_multi_partial: local EC= 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:432: TEST_backfill_multi_partial: local pools=2 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:433: TEST_backfill_multi_partial: local OSDS=3 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:435: TEST_backfill_multi_partial: run_mon td/osd-backfill-space a 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2024-05-08T17:57:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T17:57:25.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T17:57:25.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T17:57:25.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2024-05-08T17:57:25.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-05-08T17:57:25.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T17:57:25.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:57:25.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:57:25.686 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:57:25.686 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:57:25.686 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:57:25.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:57:25.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T17:57:25.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T17:57:25.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T17:57:25.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:57:25.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:57:25.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T17:57:25.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T17:57:25.917 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:57:25.918 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:57:25.918 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:57:25.918 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:57:25.918 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:57:25.918 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:57:25.918 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T17:57:25.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:57:25.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get fsid 2024-05-08T17:57:26.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T17:57:26.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T17:57:26.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T17:57:26.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T17:57:26.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T17:57:26.038 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T17:57:26.038 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T17:57:26.038 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T17:57:26.038 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T17:57:26.038 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:57:26.038 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:57:26.038 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T17:57:26.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T17:57:26.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get mon_host 2024-05-08T17:57:26.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:436: TEST_backfill_multi_partial: run_mgr td/osd-backfill-space x 2024-05-08T17:57:26.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-space 2024-05-08T17:57:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T17:57:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T17:57:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T17:57:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-space/x 2024-05-08T17:57:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T17:57:27.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T17:57:27.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:57:27.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:57:27.085 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:57:27.085 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:57:27.085 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:57:27.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:57:27.086 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:57:27.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T17:57:27.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:437: TEST_backfill_multi_partial: export CEPH_ARGS 2024-05-08T17:57:27.125 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: expr 3 - 1 2024-05-08T17:57:27.126 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: seq 0 2 2024-05-08T17:57:27.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:57:27.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:441: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 0 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:57:27.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:57:27.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:57:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:57:27.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T17:57:27.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:57:27.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e4caa3aa-b807-43b5-875e-92bdd1c24997 2024-05-08T17:57:27.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 e4caa3aa-b807-43b5-875e-92bdd1c24997' 2024-05-08T17:57:27.134 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 e4caa3aa-b807-43b5-875e-92bdd1c24997 2024-05-08T17:57:27.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:57:27.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAHvTtmviZjCRAA6Qo8Jpgwqudfhv68QNw4Ew== 2024-05-08T17:57:27.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAHvTtmviZjCRAA6Qo8Jpgwqudfhv68QNw4Ew=="}' 2024-05-08T17:57:27.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e4caa3aa-b807-43b5-875e-92bdd1c24997 -i td/osd-backfill-space/0/new.json 2024-05-08T17:57:27.451 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:57:27.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/0/new.json 2024-05-08T17:57:27.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAHvTtmviZjCRAA6Qo8Jpgwqudfhv68QNw4Ew== --osd-uuid e4caa3aa-b807-43b5-875e-92bdd1c24997 2024-05-08T17:57:27.500 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:27.500+0000 7faeb0c477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:57:27.519 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:27.520+0000 7faeb0c477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:57:27.520 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:27.520+0000 7faeb0c477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:57:27.521 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:27.520+0000 7faeb0c477c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T17:57:27.521 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:27.520+0000 7faeb0c477c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T17:57:27.521 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:27.520+0000 7faeb0c477c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T17:57:27.559 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:27.560+0000 7faeb0c477c0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-05-08T17:57:34.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-05-08T17:57:34.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:57:34.075 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T17:57:34.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T17:57:34.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:57:34.653 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T17:57:34.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T17:57:34.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:57:34.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:57:34.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:57:34.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:57:34.691 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:34.691+0000 7f842bba77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:57:34.736 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:34.735+0000 7f842bba77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:57:34.738 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:34.739+0000 7f842bba77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:57:35.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T17:57:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:57:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T17:57:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:57:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:57:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:57:35.099 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:57:35.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:35.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:35.304 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:35.303+0000 7f842bba77c0 -1 Falling back to public interface 2024-05-08T17:57:35.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:36.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:36.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:36.523 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:57:36.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:57:36.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:36.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:36.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:37.908 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:57:37.907+0000 7f842bba77c0 -1 osd.0 0 log_to_monitors true 2024-05-08T17:57:37.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:37.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:37.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:57:37.941 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:57:37.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:37.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:38.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:39.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:39.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:39.456 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:57:39.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:57:39.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:39.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:39.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:40.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:40.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:40.924 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:57:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:57:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:41.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:42.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:42.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:42.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:57:42.387 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:57:42.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:42.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:43.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:44.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:44.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:44.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:57:44.011 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:57:44.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:44.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:44.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:45.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:45.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:45.465 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:57:45.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:57:45.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:45.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:45.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:46.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:46.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:46.980 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:57:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:57:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:47.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:48.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:48.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:48.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:57:48.420 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:57:48.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:48.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:48.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:49.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:49.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:49.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:57:49.900 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:57:49.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:49.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:50.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:51.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:51.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:51.382 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:57:51.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:57:51.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:51.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:52.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:53.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:53.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:53.680 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:57:53.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:57:53.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:53.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:55.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:56.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:56.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:56.131 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:57:56.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:57:56.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:56.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:57.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:57:58.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:57:58.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:57:58.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:57:58.020 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:57:58.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:57:58.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:57:59.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:00.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:00.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:00.141 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:58:00.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:58:00.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:00.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:58:00.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:01.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:01.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:01.813 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:58:01.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:58:01.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:01.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:58:02.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:03.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:03.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:03.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:58:03.963 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:58:03.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:03.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T17:58:04.483 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4232844997,v1:127.0.0.1:6803/4232844997] [v2:127.0.0.1:6804/4232844997,v1:127.0.0.1:6805/4232844997] exists,up e4caa3aa-b807-43b5-875e-92bdd1c24997 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:441: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 1 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T17:58:04.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:58:04.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:58:04.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:58:04.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T17:58:04.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:58:04.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=83e506b4-d223-4635-bdd2-899e68cc9fac 2024-05-08T17:58:04.490 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 83e506b4-d223-4635-bdd2-899e68cc9fac 2024-05-08T17:58:04.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 83e506b4-d223-4635-bdd2-899e68cc9fac' 2024-05-08T17:58:04.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:58:04.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAsvTtmL3wrHxAABStPD0v5GVzGB1KO26DY1Q== 2024-05-08T17:58:04.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAsvTtmL3wrHxAABStPD0v5GVzGB1KO26DY1Q=="}' 2024-05-08T17:58:04.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 83e506b4-d223-4635-bdd2-899e68cc9fac -i td/osd-backfill-space/1/new.json 2024-05-08T17:58:05.006 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:58:05.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/1/new.json 2024-05-08T17:58:05.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAsvTtmL3wrHxAABStPD0v5GVzGB1KO26DY1Q== --osd-uuid 83e506b4-d223-4635-bdd2-899e68cc9fac 2024-05-08T17:58:05.060 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:05.059+0000 7fbe070027c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:05.083 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:05.083+0000 7fbe070027c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:05.084 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:05.083+0000 7fbe070027c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:05.084 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:05.083+0000 7fbe070027c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T17:58:05.084 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:05.083+0000 7fbe070027c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T17:58:05.084 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:05.083+0000 7fbe070027c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T17:58:05.123 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:05.123+0000 7fbe070027c0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-05-08T17:58:12.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-05-08T17:58:12.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:58:12.157 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T17:58:12.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T17:58:12.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:58:12.719 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T17:58:12.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T17:58:12.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:58:12.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:58:12.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:58:12.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:58:12.754 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:12.751+0000 7f1b883eb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:12.771 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:12.771+0000 7f1b883eb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:12.772 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:12.771+0000 7f1b883eb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:13.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T17:58:13.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:58:13.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T17:58:13.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:58:13.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:58:13.136 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:58:13.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:13.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:58:13.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:13.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:13.368 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:13.367+0000 7f1b883eb7c0 -1 Falling back to public interface 2024-05-08T17:58:13.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:14.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:14.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:14.595 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:58:14.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:58:14.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:14.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:15.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:16.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:16.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:16.024 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:58:16.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:58:16.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:16.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:16.029 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:16.026+0000 7f1b883eb7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T17:58:16.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:17.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:17.434 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:58:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:58:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:18.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:19.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:19.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:19.037 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:58:19.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:58:19.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:19.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:20.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:20.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:20.497 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:58:20.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:58:20.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:20.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:21.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:22.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:22.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:22.047 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:58:22.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:58:22.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:22.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:22.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:23.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:23.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:23.656 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:58:23.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:58:23.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:23.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:24.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:25.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:25.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:25.198 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:58:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:58:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:25.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:26.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:26.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:26.630 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:58:26.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:58:26.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:26.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:27.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:28.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:28.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:28.190 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:58:28.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:58:28.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:28.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:28.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:29.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:29.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:29.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:58:29.626 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:58:29.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:29.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:30.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:31.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:31.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:31.174 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:58:31.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:58:31.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:31.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:32.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:33.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:33.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:33.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:58:33.285 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:58:33.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:33.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:34.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:35.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:35.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:35.246 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:58:35.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:58:35.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:35.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:36.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:37.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:37.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:37.096 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:58:37.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:58:37.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:37.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:37.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:38.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:38.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:38.847 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:58:38.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:58:38.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:38.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:39.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:40.678 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:58:40.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:58:40.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:40.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:41.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:42.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:42.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:42.579 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:58:42.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:58:42.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:42.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T17:58:43.090 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2673522908,v1:127.0.0.1:6811/2673522908] [v2:127.0.0.1:6812/2673522908,v1:127.0.0.1:6813/2673522908] exists,up 83e506b4-d223-4635-bdd2-899e68cc9fac 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:441: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 2 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T17:58:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T17:58:43.095 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T17:58:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T17:58:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T17:58:43.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:58:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T17:58:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T17:58:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T17:58:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T17:58:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T17:58:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T17:58:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T17:58:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T17:58:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T17:58:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T17:58:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T17:58:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T17:58:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T17:58:43.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T17:58:43.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4205a16a-8ecb-4a91-9a81-75815dc07592 2024-05-08T17:58:43.098 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 4205a16a-8ecb-4a91-9a81-75815dc07592 2024-05-08T17:58:43.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 4205a16a-8ecb-4a91-9a81-75815dc07592' 2024-05-08T17:58:43.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T17:58:43.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBTvTtmVZK8BxAA6r1D79Hhx6f/TuRkLcxS3w== 2024-05-08T17:58:43.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBTvTtmVZK8BxAA6r1D79Hhx6f/TuRkLcxS3w=="}' 2024-05-08T17:58:43.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4205a16a-8ecb-4a91-9a81-75815dc07592 -i td/osd-backfill-space/2/new.json 2024-05-08T17:58:43.722 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:58:43.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/2/new.json 2024-05-08T17:58:43.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBTvTtmVZK8BxAA6r1D79Hhx6f/TuRkLcxS3w== --osd-uuid 4205a16a-8ecb-4a91-9a81-75815dc07592 2024-05-08T17:58:43.773 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:43.774+0000 7f545888b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:43.815 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:43.818+0000 7f545888b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:43.817 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:43.818+0000 7f545888b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:43.817 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:43.818+0000 7f545888b7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T17:58:43.817 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:43.818+0000 7f545888b7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T17:58:43.817 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:43.818+0000 7f545888b7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T17:58:43.922 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:43.926+0000 7f545888b7c0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-05-08T17:58:50.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-05-08T17:58:50.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T17:58:50.685 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T17:58:50.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T17:58:50.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T17:58:51.239 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T17:58:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T17:58:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T17:58:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T17:58:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T17:58:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T17:58:51.277 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:51.278+0000 7fe262dfc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:51.312 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:51.314+0000 7fe262dfc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:51.314 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:51.318+0000 7fe262dfc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T17:58:51.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T17:58:51.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T17:58:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T17:58:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T17:58:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T17:58:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T17:58:51.695 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T17:58:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:51.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:58:51.872 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:51.874+0000 7fe262dfc7c0 -1 Falling back to public interface 2024-05-08T17:58:52.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:53.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:53.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:53.103 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T17:58:53.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T17:58:53.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:53.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:58:53.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:54.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:54.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:54.531 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T17:58:54.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T17:58:54.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:54.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:58:54.576 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T17:58:54.578+0000 7fe262dfc7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T17:58:55.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:56.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:56.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:56.143 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T17:58:56.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T17:58:56.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:56.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:58:56.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:57.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:57.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:57.591 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T17:58:57.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T17:58:57.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:57.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:58:58.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:58:59.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:58:59.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:58:59.002 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T17:58:59.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T17:58:59.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:58:59.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:58:59.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:00.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:00.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:00.575 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T17:59:00.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T17:59:00.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:00.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:01.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:02.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:02.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:02.034 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T17:59:02.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T17:59:02.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:02.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:02.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:03.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:03.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:03.616 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T17:59:03.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T17:59:03.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:03.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:04.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:05.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:05.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:05.144 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T17:59:05.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T17:59:05.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:05.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:05.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:06.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:06.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:06.619 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T17:59:06.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T17:59:06.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:06.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:07.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:08.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:08.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:08.085 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T17:59:08.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T17:59:08.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:08.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:08.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:09.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:09.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:09.635 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T17:59:09.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T17:59:09.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:09.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:10.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:11.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:11.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:11.796 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T17:59:11.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T17:59:11.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:11.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:12.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:13.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:13.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:13.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T17:59:13.667 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T17:59:13.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:13.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:14.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:15.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:15.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:15.584 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T17:59:15.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T17:59:15.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:15.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:16.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:17.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:17.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:17.475 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T17:59:17.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T17:59:17.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:17.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:18.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:19.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:19.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:19.305 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T17:59:19.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T17:59:19.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:19.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:20.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T17:59:21.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T17:59:21.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T17:59:21.210 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T17:59:21.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T17:59:21.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T17:59:21.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T17:59:21.693 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2852278508,v1:127.0.0.1:6819/2852278508] [v2:127.0.0.1:6820/2852278508,v1:127.0.0.1:6821/2852278508] exists,up 4205a16a-8ecb-4a91-9a81-75815dc07592 2024-05-08T17:59:21.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T17:59:21.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T17:59:21.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T17:59:21.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:444: TEST_backfill_multi_partial: ceph osd set-backfillfull-ratio .85 2024-05-08T17:59:22.387 INFO:tasks.workunit.client.0.smithi117.stderr:osd set-backfillfull-ratio 0.85 2024-05-08T17:59:22.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:446: TEST_backfill_multi_partial: ceph osd set-require-min-compat-client luminous 2024-05-08T17:59:23.224 INFO:tasks.workunit.client.0.smithi117.stderr:set require_min_compat_client to luminous 2024-05-08T17:59:23.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:447: TEST_backfill_multi_partial: create_pool fillpool 1 1 2024-05-08T17:59:23.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create fillpool 1 1 2024-05-08T17:59:24.138 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'fillpool' already exists 2024-05-08T17:59:24.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:59:25.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:448: TEST_backfill_multi_partial: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2024-05-08T17:59:26.196 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T17:59:26.222 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:449: TEST_backfill_multi_partial: seq 1 2 2024-05-08T17:59:26.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:449: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T17:59:26.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:451: TEST_backfill_multi_partial: create_pool test1 1 1 2024-05-08T17:59:26.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test1 1 1 2024-05-08T17:59:27.025 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' already exists 2024-05-08T17:59:27.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:59:28.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:452: TEST_backfill_multi_partial: ceph osd pool set test1 size 2 2024-05-08T17:59:28.934 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 2 2024-05-08T17:59:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:449: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T17:59:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:451: TEST_backfill_multi_partial: create_pool test2 1 1 2024-05-08T17:59:28.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test2 1 1 2024-05-08T17:59:29.671 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' already exists 2024-05-08T17:59:29.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T17:59:30.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:452: TEST_backfill_multi_partial: ceph osd pool set test2 size 2 2024-05-08T17:59:31.537 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 3 size to 2 2024-05-08T17:59:31.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:455: TEST_backfill_multi_partial: wait_for_clean 2024-05-08T17:59:31.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T17:59:31.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T17:59:31.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T17:59:31.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T17:59:31.561 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T17:59:31.561 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T17:59:31.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T17:59:31.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T17:59:31.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T17:59:31.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T17:59:31.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T17:59:31.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T17:59:31.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T17:59:31.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T17:59:31.678 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T17:59:32.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T17:59:32.230 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T17:59:32.230 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T17:59:32.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T17:59:32.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:59:32.230 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T17:59:32.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836504 2024-05-08T17:59:32.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836504 2024-05-08T17:59:32.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836504' 2024-05-08T17:59:32.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:59:32.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T17:59:32.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672974 2024-05-08T17:59:32.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672974 2024-05-08T17:59:32.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836504 1-42949672974' 2024-05-08T17:59:32.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T17:59:32.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T17:59:32.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509450 2024-05-08T17:59:32.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509450 2024-05-08T17:59:32.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836504 1-42949672974 2-64424509450' 2024-05-08T17:59:32.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:59:32.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836504 2024-05-08T17:59:32.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:59:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T17:59:32.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836504 2024-05-08T17:59:32.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:59:32.856 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836504 2024-05-08T17:59:32.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836504 2024-05-08T17:59:32.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836504' 2024-05-08T17:59:32.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:59:33.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836502 -lt 21474836504 2024-05-08T17:59:33.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T17:59:34.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T17:59:34.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T17:59:34.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836504 -lt 21474836504 2024-05-08T17:59:34.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:59:34.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672974 2024-05-08T17:59:34.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:59:34.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T17:59:34.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672974 2024-05-08T17:59:34.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:59:34.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672974 2024-05-08T17:59:34.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2024-05-08T17:59:34.699 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672974 2024-05-08T17:59:34.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T17:59:35.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672975 -lt 42949672974 2024-05-08T17:59:35.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T17:59:35.110 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509450 2024-05-08T17:59:35.110 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T17:59:35.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T17:59:35.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509450 2024-05-08T17:59:35.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T17:59:35.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509450 2024-05-08T17:59:35.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509450' 2024-05-08T17:59:35.113 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509450 2024-05-08T17:59:35.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T17:59:35.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509450 -lt 64424509450 2024-05-08T17:59:35.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T17:59:35.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:59:35.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:59:36.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 3 == 0 2024-05-08T17:59:36.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T17:59:36.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T17:59:36.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T17:59:36.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T17:59:36.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T17:59:36.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T17:59:36.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T17:59:36.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=3 2024-05-08T17:59:36.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T17:59:36.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T17:59:36.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T17:59:37.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 3 = 3 2024-05-08T17:59:37.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T17:59:37.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T17:59:37.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:462: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=2611 count=1 2024-05-08T17:59:37.089 INFO:tasks.workunit.client.0.smithi117.stderr:1+0 records in 2024-05-08T17:59:37.089 INFO:tasks.workunit.client.0.smithi117.stderr:1+0 records out 2024-05-08T17:59:37.089 INFO:tasks.workunit.client.0.smithi117.stderr:2611 bytes (2.6 kB, 2.5 KiB) copied, 0.000114799 s, 22.7 MB/s 2024-05-08T17:59:37.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: seq 1 600 2024-05-08T17:59:37.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:37.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-1 td/osd-backfill-space/datafile 2024-05-08T17:59:37.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:37.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-2 td/osd-backfill-space/datafile 2024-05-08T17:59:37.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:37.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-3 td/osd-backfill-space/datafile 2024-05-08T17:59:37.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:37.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-4 td/osd-backfill-space/datafile 2024-05-08T17:59:37.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:37.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-5 td/osd-backfill-space/datafile 2024-05-08T17:59:37.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:37.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-6 td/osd-backfill-space/datafile 2024-05-08T17:59:37.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:37.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-7 td/osd-backfill-space/datafile 2024-05-08T17:59:37.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:37.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-8 td/osd-backfill-space/datafile 2024-05-08T17:59:38.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-9 td/osd-backfill-space/datafile 2024-05-08T17:59:38.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-10 td/osd-backfill-space/datafile 2024-05-08T17:59:38.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-11 td/osd-backfill-space/datafile 2024-05-08T17:59:38.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-12 td/osd-backfill-space/datafile 2024-05-08T17:59:38.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-13 td/osd-backfill-space/datafile 2024-05-08T17:59:38.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-14 td/osd-backfill-space/datafile 2024-05-08T17:59:38.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-15 td/osd-backfill-space/datafile 2024-05-08T17:59:38.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-16 td/osd-backfill-space/datafile 2024-05-08T17:59:38.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:38.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-17 td/osd-backfill-space/datafile 2024-05-08T17:59:39.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:39.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-18 td/osd-backfill-space/datafile 2024-05-08T17:59:39.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:39.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-19 td/osd-backfill-space/datafile 2024-05-08T17:59:39.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:39.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-20 td/osd-backfill-space/datafile 2024-05-08T17:59:39.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:39.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-21 td/osd-backfill-space/datafile 2024-05-08T17:59:39.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:39.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-22 td/osd-backfill-space/datafile 2024-05-08T17:59:39.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:39.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-23 td/osd-backfill-space/datafile 2024-05-08T17:59:39.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:39.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-24 td/osd-backfill-space/datafile 2024-05-08T17:59:39.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:39.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-25 td/osd-backfill-space/datafile 2024-05-08T17:59:40.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-26 td/osd-backfill-space/datafile 2024-05-08T17:59:40.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-27 td/osd-backfill-space/datafile 2024-05-08T17:59:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-28 td/osd-backfill-space/datafile 2024-05-08T17:59:40.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-29 td/osd-backfill-space/datafile 2024-05-08T17:59:40.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-30 td/osd-backfill-space/datafile 2024-05-08T17:59:40.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-31 td/osd-backfill-space/datafile 2024-05-08T17:59:40.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-32 td/osd-backfill-space/datafile 2024-05-08T17:59:40.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-33 td/osd-backfill-space/datafile 2024-05-08T17:59:40.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-34 td/osd-backfill-space/datafile 2024-05-08T17:59:40.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:40.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-35 td/osd-backfill-space/datafile 2024-05-08T17:59:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-36 td/osd-backfill-space/datafile 2024-05-08T17:59:41.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-37 td/osd-backfill-space/datafile 2024-05-08T17:59:41.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-38 td/osd-backfill-space/datafile 2024-05-08T17:59:41.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-39 td/osd-backfill-space/datafile 2024-05-08T17:59:41.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-40 td/osd-backfill-space/datafile 2024-05-08T17:59:41.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-41 td/osd-backfill-space/datafile 2024-05-08T17:59:41.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-42 td/osd-backfill-space/datafile 2024-05-08T17:59:41.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-43 td/osd-backfill-space/datafile 2024-05-08T17:59:41.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:41.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-44 td/osd-backfill-space/datafile 2024-05-08T17:59:42.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-45 td/osd-backfill-space/datafile 2024-05-08T17:59:42.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-46 td/osd-backfill-space/datafile 2024-05-08T17:59:42.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-47 td/osd-backfill-space/datafile 2024-05-08T17:59:42.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-48 td/osd-backfill-space/datafile 2024-05-08T17:59:42.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-49 td/osd-backfill-space/datafile 2024-05-08T17:59:42.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-50 td/osd-backfill-space/datafile 2024-05-08T17:59:42.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-51 td/osd-backfill-space/datafile 2024-05-08T17:59:42.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-52 td/osd-backfill-space/datafile 2024-05-08T17:59:42.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:42.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-53 td/osd-backfill-space/datafile 2024-05-08T17:59:43.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-54 td/osd-backfill-space/datafile 2024-05-08T17:59:43.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-55 td/osd-backfill-space/datafile 2024-05-08T17:59:43.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-56 td/osd-backfill-space/datafile 2024-05-08T17:59:43.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-57 td/osd-backfill-space/datafile 2024-05-08T17:59:43.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-58 td/osd-backfill-space/datafile 2024-05-08T17:59:43.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-59 td/osd-backfill-space/datafile 2024-05-08T17:59:43.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-60 td/osd-backfill-space/datafile 2024-05-08T17:59:43.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-61 td/osd-backfill-space/datafile 2024-05-08T17:59:43.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-62 td/osd-backfill-space/datafile 2024-05-08T17:59:43.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:43.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-63 td/osd-backfill-space/datafile 2024-05-08T17:59:44.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:44.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-64 td/osd-backfill-space/datafile 2024-05-08T17:59:44.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:44.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-65 td/osd-backfill-space/datafile 2024-05-08T17:59:44.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:44.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-66 td/osd-backfill-space/datafile 2024-05-08T17:59:44.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:44.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-67 td/osd-backfill-space/datafile 2024-05-08T17:59:44.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:44.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-68 td/osd-backfill-space/datafile 2024-05-08T17:59:44.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:44.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-69 td/osd-backfill-space/datafile 2024-05-08T17:59:44.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:44.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-70 td/osd-backfill-space/datafile 2024-05-08T17:59:44.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:44.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-71 td/osd-backfill-space/datafile 2024-05-08T17:59:45.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-72 td/osd-backfill-space/datafile 2024-05-08T17:59:45.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-73 td/osd-backfill-space/datafile 2024-05-08T17:59:45.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-74 td/osd-backfill-space/datafile 2024-05-08T17:59:45.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-75 td/osd-backfill-space/datafile 2024-05-08T17:59:45.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-76 td/osd-backfill-space/datafile 2024-05-08T17:59:45.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-77 td/osd-backfill-space/datafile 2024-05-08T17:59:45.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-78 td/osd-backfill-space/datafile 2024-05-08T17:59:45.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-79 td/osd-backfill-space/datafile 2024-05-08T17:59:45.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-80 td/osd-backfill-space/datafile 2024-05-08T17:59:45.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:45.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-81 td/osd-backfill-space/datafile 2024-05-08T17:59:46.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-82 td/osd-backfill-space/datafile 2024-05-08T17:59:46.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-83 td/osd-backfill-space/datafile 2024-05-08T17:59:46.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-84 td/osd-backfill-space/datafile 2024-05-08T17:59:46.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-85 td/osd-backfill-space/datafile 2024-05-08T17:59:46.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-86 td/osd-backfill-space/datafile 2024-05-08T17:59:46.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-87 td/osd-backfill-space/datafile 2024-05-08T17:59:46.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-88 td/osd-backfill-space/datafile 2024-05-08T17:59:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-89 td/osd-backfill-space/datafile 2024-05-08T17:59:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-90 td/osd-backfill-space/datafile 2024-05-08T17:59:47.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-91 td/osd-backfill-space/datafile 2024-05-08T17:59:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-92 td/osd-backfill-space/datafile 2024-05-08T17:59:47.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-93 td/osd-backfill-space/datafile 2024-05-08T17:59:47.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-94 td/osd-backfill-space/datafile 2024-05-08T17:59:47.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-95 td/osd-backfill-space/datafile 2024-05-08T17:59:47.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-96 td/osd-backfill-space/datafile 2024-05-08T17:59:47.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-97 td/osd-backfill-space/datafile 2024-05-08T17:59:47.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-98 td/osd-backfill-space/datafile 2024-05-08T17:59:47.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:47.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-99 td/osd-backfill-space/datafile 2024-05-08T17:59:48.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:48.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-100 td/osd-backfill-space/datafile 2024-05-08T17:59:48.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:48.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-101 td/osd-backfill-space/datafile 2024-05-08T17:59:48.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:48.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-102 td/osd-backfill-space/datafile 2024-05-08T17:59:48.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:48.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-103 td/osd-backfill-space/datafile 2024-05-08T17:59:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:48.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-104 td/osd-backfill-space/datafile 2024-05-08T17:59:48.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:48.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-105 td/osd-backfill-space/datafile 2024-05-08T17:59:48.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:48.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-106 td/osd-backfill-space/datafile 2024-05-08T17:59:48.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:48.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-107 td/osd-backfill-space/datafile 2024-05-08T17:59:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-108 td/osd-backfill-space/datafile 2024-05-08T17:59:49.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-109 td/osd-backfill-space/datafile 2024-05-08T17:59:49.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-110 td/osd-backfill-space/datafile 2024-05-08T17:59:49.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-111 td/osd-backfill-space/datafile 2024-05-08T17:59:49.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-112 td/osd-backfill-space/datafile 2024-05-08T17:59:49.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-113 td/osd-backfill-space/datafile 2024-05-08T17:59:49.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-114 td/osd-backfill-space/datafile 2024-05-08T17:59:49.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-115 td/osd-backfill-space/datafile 2024-05-08T17:59:49.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:49.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-116 td/osd-backfill-space/datafile 2024-05-08T17:59:50.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-117 td/osd-backfill-space/datafile 2024-05-08T17:59:50.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-118 td/osd-backfill-space/datafile 2024-05-08T17:59:50.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-119 td/osd-backfill-space/datafile 2024-05-08T17:59:50.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-120 td/osd-backfill-space/datafile 2024-05-08T17:59:50.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-121 td/osd-backfill-space/datafile 2024-05-08T17:59:50.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-122 td/osd-backfill-space/datafile 2024-05-08T17:59:50.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-123 td/osd-backfill-space/datafile 2024-05-08T17:59:50.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-124 td/osd-backfill-space/datafile 2024-05-08T17:59:50.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:50.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-125 td/osd-backfill-space/datafile 2024-05-08T17:59:51.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-126 td/osd-backfill-space/datafile 2024-05-08T17:59:51.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-127 td/osd-backfill-space/datafile 2024-05-08T17:59:51.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-128 td/osd-backfill-space/datafile 2024-05-08T17:59:51.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-129 td/osd-backfill-space/datafile 2024-05-08T17:59:51.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-130 td/osd-backfill-space/datafile 2024-05-08T17:59:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-131 td/osd-backfill-space/datafile 2024-05-08T17:59:51.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-132 td/osd-backfill-space/datafile 2024-05-08T17:59:51.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-133 td/osd-backfill-space/datafile 2024-05-08T17:59:51.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-134 td/osd-backfill-space/datafile 2024-05-08T17:59:51.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:51.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-135 td/osd-backfill-space/datafile 2024-05-08T17:59:52.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:52.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-136 td/osd-backfill-space/datafile 2024-05-08T17:59:52.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:52.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-137 td/osd-backfill-space/datafile 2024-05-08T17:59:52.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:52.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-138 td/osd-backfill-space/datafile 2024-05-08T17:59:52.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:52.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-139 td/osd-backfill-space/datafile 2024-05-08T17:59:52.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:52.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-140 td/osd-backfill-space/datafile 2024-05-08T17:59:52.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:52.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-141 td/osd-backfill-space/datafile 2024-05-08T17:59:52.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:52.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-142 td/osd-backfill-space/datafile 2024-05-08T17:59:52.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:52.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-143 td/osd-backfill-space/datafile 2024-05-08T17:59:53.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-144 td/osd-backfill-space/datafile 2024-05-08T17:59:53.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-145 td/osd-backfill-space/datafile 2024-05-08T17:59:53.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-146 td/osd-backfill-space/datafile 2024-05-08T17:59:53.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-147 td/osd-backfill-space/datafile 2024-05-08T17:59:53.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-148 td/osd-backfill-space/datafile 2024-05-08T17:59:53.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-149 td/osd-backfill-space/datafile 2024-05-08T17:59:53.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-150 td/osd-backfill-space/datafile 2024-05-08T17:59:53.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-151 td/osd-backfill-space/datafile 2024-05-08T17:59:53.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-152 td/osd-backfill-space/datafile 2024-05-08T17:59:53.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:53.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-153 td/osd-backfill-space/datafile 2024-05-08T17:59:54.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:54.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-154 td/osd-backfill-space/datafile 2024-05-08T17:59:54.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:54.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-155 td/osd-backfill-space/datafile 2024-05-08T17:59:54.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:54.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-156 td/osd-backfill-space/datafile 2024-05-08T17:59:54.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:54.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-157 td/osd-backfill-space/datafile 2024-05-08T17:59:54.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:54.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-158 td/osd-backfill-space/datafile 2024-05-08T17:59:54.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:54.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-159 td/osd-backfill-space/datafile 2024-05-08T17:59:54.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:54.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-160 td/osd-backfill-space/datafile 2024-05-08T17:59:54.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:54.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-161 td/osd-backfill-space/datafile 2024-05-08T17:59:55.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-162 td/osd-backfill-space/datafile 2024-05-08T17:59:55.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-163 td/osd-backfill-space/datafile 2024-05-08T17:59:55.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-164 td/osd-backfill-space/datafile 2024-05-08T17:59:55.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-165 td/osd-backfill-space/datafile 2024-05-08T17:59:55.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-166 td/osd-backfill-space/datafile 2024-05-08T17:59:55.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-167 td/osd-backfill-space/datafile 2024-05-08T17:59:55.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-168 td/osd-backfill-space/datafile 2024-05-08T17:59:55.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-169 td/osd-backfill-space/datafile 2024-05-08T17:59:55.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-170 td/osd-backfill-space/datafile 2024-05-08T17:59:55.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:55.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-171 td/osd-backfill-space/datafile 2024-05-08T17:59:56.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:56.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-172 td/osd-backfill-space/datafile 2024-05-08T17:59:56.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:56.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-173 td/osd-backfill-space/datafile 2024-05-08T17:59:56.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:56.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-174 td/osd-backfill-space/datafile 2024-05-08T17:59:56.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:56.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-175 td/osd-backfill-space/datafile 2024-05-08T17:59:56.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:56.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-176 td/osd-backfill-space/datafile 2024-05-08T17:59:56.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:56.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-177 td/osd-backfill-space/datafile 2024-05-08T17:59:56.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:56.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-178 td/osd-backfill-space/datafile 2024-05-08T17:59:56.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:56.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-179 td/osd-backfill-space/datafile 2024-05-08T17:59:57.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-180 td/osd-backfill-space/datafile 2024-05-08T17:59:57.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-181 td/osd-backfill-space/datafile 2024-05-08T17:59:57.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-182 td/osd-backfill-space/datafile 2024-05-08T17:59:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-183 td/osd-backfill-space/datafile 2024-05-08T17:59:57.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-184 td/osd-backfill-space/datafile 2024-05-08T17:59:57.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-185 td/osd-backfill-space/datafile 2024-05-08T17:59:57.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-186 td/osd-backfill-space/datafile 2024-05-08T17:59:57.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-187 td/osd-backfill-space/datafile 2024-05-08T17:59:57.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:57.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-188 td/osd-backfill-space/datafile 2024-05-08T17:59:58.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-189 td/osd-backfill-space/datafile 2024-05-08T17:59:58.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-190 td/osd-backfill-space/datafile 2024-05-08T17:59:58.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-191 td/osd-backfill-space/datafile 2024-05-08T17:59:58.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-192 td/osd-backfill-space/datafile 2024-05-08T17:59:58.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-193 td/osd-backfill-space/datafile 2024-05-08T17:59:58.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-194 td/osd-backfill-space/datafile 2024-05-08T17:59:58.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-195 td/osd-backfill-space/datafile 2024-05-08T17:59:58.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-196 td/osd-backfill-space/datafile 2024-05-08T17:59:58.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:58.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-197 td/osd-backfill-space/datafile 2024-05-08T17:59:59.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-198 td/osd-backfill-space/datafile 2024-05-08T17:59:59.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-199 td/osd-backfill-space/datafile 2024-05-08T17:59:59.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-200 td/osd-backfill-space/datafile 2024-05-08T17:59:59.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-201 td/osd-backfill-space/datafile 2024-05-08T17:59:59.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-202 td/osd-backfill-space/datafile 2024-05-08T17:59:59.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-203 td/osd-backfill-space/datafile 2024-05-08T17:59:59.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-204 td/osd-backfill-space/datafile 2024-05-08T17:59:59.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-205 td/osd-backfill-space/datafile 2024-05-08T17:59:59.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T17:59:59.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-206 td/osd-backfill-space/datafile 2024-05-08T18:00:00.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:00.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-207 td/osd-backfill-space/datafile 2024-05-08T18:00:00.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:00.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-208 td/osd-backfill-space/datafile 2024-05-08T18:00:00.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:00.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-209 td/osd-backfill-space/datafile 2024-05-08T18:00:00.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:00.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-210 td/osd-backfill-space/datafile 2024-05-08T18:00:00.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:00.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-211 td/osd-backfill-space/datafile 2024-05-08T18:00:00.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:00.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-212 td/osd-backfill-space/datafile 2024-05-08T18:00:00.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:00.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-213 td/osd-backfill-space/datafile 2024-05-08T18:00:00.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:00.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-214 td/osd-backfill-space/datafile 2024-05-08T18:00:01.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-215 td/osd-backfill-space/datafile 2024-05-08T18:00:01.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-216 td/osd-backfill-space/datafile 2024-05-08T18:00:01.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-217 td/osd-backfill-space/datafile 2024-05-08T18:00:01.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-218 td/osd-backfill-space/datafile 2024-05-08T18:00:01.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-219 td/osd-backfill-space/datafile 2024-05-08T18:00:01.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-220 td/osd-backfill-space/datafile 2024-05-08T18:00:01.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-221 td/osd-backfill-space/datafile 2024-05-08T18:00:01.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-222 td/osd-backfill-space/datafile 2024-05-08T18:00:01.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:01.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-223 td/osd-backfill-space/datafile 2024-05-08T18:00:02.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-224 td/osd-backfill-space/datafile 2024-05-08T18:00:02.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-225 td/osd-backfill-space/datafile 2024-05-08T18:00:02.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-226 td/osd-backfill-space/datafile 2024-05-08T18:00:02.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-227 td/osd-backfill-space/datafile 2024-05-08T18:00:02.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-228 td/osd-backfill-space/datafile 2024-05-08T18:00:02.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-229 td/osd-backfill-space/datafile 2024-05-08T18:00:02.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-230 td/osd-backfill-space/datafile 2024-05-08T18:00:02.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-231 td/osd-backfill-space/datafile 2024-05-08T18:00:02.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:02.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-232 td/osd-backfill-space/datafile 2024-05-08T18:00:03.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:03.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-233 td/osd-backfill-space/datafile 2024-05-08T18:00:03.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:03.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-234 td/osd-backfill-space/datafile 2024-05-08T18:00:03.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:03.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-235 td/osd-backfill-space/datafile 2024-05-08T18:00:03.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:03.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-236 td/osd-backfill-space/datafile 2024-05-08T18:00:03.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:03.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-237 td/osd-backfill-space/datafile 2024-05-08T18:00:03.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:03.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-238 td/osd-backfill-space/datafile 2024-05-08T18:00:04.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:04.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-239 td/osd-backfill-space/datafile 2024-05-08T18:00:04.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:04.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-240 td/osd-backfill-space/datafile 2024-05-08T18:00:04.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:04.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-241 td/osd-backfill-space/datafile 2024-05-08T18:00:04.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:04.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-242 td/osd-backfill-space/datafile 2024-05-08T18:00:04.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:04.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-243 td/osd-backfill-space/datafile 2024-05-08T18:00:04.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:04.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-244 td/osd-backfill-space/datafile 2024-05-08T18:00:04.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:04.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-245 td/osd-backfill-space/datafile 2024-05-08T18:00:04.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:04.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-246 td/osd-backfill-space/datafile 2024-05-08T18:00:05.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-247 td/osd-backfill-space/datafile 2024-05-08T18:00:05.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-248 td/osd-backfill-space/datafile 2024-05-08T18:00:05.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-249 td/osd-backfill-space/datafile 2024-05-08T18:00:05.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-250 td/osd-backfill-space/datafile 2024-05-08T18:00:05.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-251 td/osd-backfill-space/datafile 2024-05-08T18:00:05.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-252 td/osd-backfill-space/datafile 2024-05-08T18:00:05.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-253 td/osd-backfill-space/datafile 2024-05-08T18:00:05.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-254 td/osd-backfill-space/datafile 2024-05-08T18:00:05.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:05.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-255 td/osd-backfill-space/datafile 2024-05-08T18:00:06.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:06.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-256 td/osd-backfill-space/datafile 2024-05-08T18:00:06.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:06.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-257 td/osd-backfill-space/datafile 2024-05-08T18:00:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-258 td/osd-backfill-space/datafile 2024-05-08T18:00:06.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:06.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-259 td/osd-backfill-space/datafile 2024-05-08T18:00:06.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:06.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-260 td/osd-backfill-space/datafile 2024-05-08T18:00:06.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:06.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-261 td/osd-backfill-space/datafile 2024-05-08T18:00:06.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:06.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-262 td/osd-backfill-space/datafile 2024-05-08T18:00:06.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:06.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-263 td/osd-backfill-space/datafile 2024-05-08T18:00:07.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-264 td/osd-backfill-space/datafile 2024-05-08T18:00:07.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-265 td/osd-backfill-space/datafile 2024-05-08T18:00:07.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-266 td/osd-backfill-space/datafile 2024-05-08T18:00:07.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-267 td/osd-backfill-space/datafile 2024-05-08T18:00:07.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-268 td/osd-backfill-space/datafile 2024-05-08T18:00:07.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-269 td/osd-backfill-space/datafile 2024-05-08T18:00:07.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-270 td/osd-backfill-space/datafile 2024-05-08T18:00:07.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-271 td/osd-backfill-space/datafile 2024-05-08T18:00:07.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-272 td/osd-backfill-space/datafile 2024-05-08T18:00:07.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:07.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-273 td/osd-backfill-space/datafile 2024-05-08T18:00:08.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:08.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-274 td/osd-backfill-space/datafile 2024-05-08T18:00:08.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:08.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-275 td/osd-backfill-space/datafile 2024-05-08T18:00:08.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:08.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-276 td/osd-backfill-space/datafile 2024-05-08T18:00:08.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:08.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-277 td/osd-backfill-space/datafile 2024-05-08T18:00:08.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:08.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-278 td/osd-backfill-space/datafile 2024-05-08T18:00:08.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:08.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-279 td/osd-backfill-space/datafile 2024-05-08T18:00:08.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:08.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-280 td/osd-backfill-space/datafile 2024-05-08T18:00:08.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:08.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-281 td/osd-backfill-space/datafile 2024-05-08T18:00:09.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:09.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-282 td/osd-backfill-space/datafile 2024-05-08T18:00:09.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:09.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-283 td/osd-backfill-space/datafile 2024-05-08T18:00:09.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:09.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-284 td/osd-backfill-space/datafile 2024-05-08T18:00:09.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:09.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-285 td/osd-backfill-space/datafile 2024-05-08T18:00:09.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:09.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-286 td/osd-backfill-space/datafile 2024-05-08T18:00:09.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:09.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-287 td/osd-backfill-space/datafile 2024-05-08T18:00:09.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:09.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-288 td/osd-backfill-space/datafile 2024-05-08T18:00:09.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:09.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-289 td/osd-backfill-space/datafile 2024-05-08T18:00:10.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-290 td/osd-backfill-space/datafile 2024-05-08T18:00:10.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-291 td/osd-backfill-space/datafile 2024-05-08T18:00:10.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-292 td/osd-backfill-space/datafile 2024-05-08T18:00:10.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-293 td/osd-backfill-space/datafile 2024-05-08T18:00:10.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-294 td/osd-backfill-space/datafile 2024-05-08T18:00:10.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-295 td/osd-backfill-space/datafile 2024-05-08T18:00:10.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-296 td/osd-backfill-space/datafile 2024-05-08T18:00:10.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-297 td/osd-backfill-space/datafile 2024-05-08T18:00:10.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:10.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-298 td/osd-backfill-space/datafile 2024-05-08T18:00:11.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-299 td/osd-backfill-space/datafile 2024-05-08T18:00:11.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-300 td/osd-backfill-space/datafile 2024-05-08T18:00:11.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-301 td/osd-backfill-space/datafile 2024-05-08T18:00:11.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-302 td/osd-backfill-space/datafile 2024-05-08T18:00:11.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-303 td/osd-backfill-space/datafile 2024-05-08T18:00:11.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-304 td/osd-backfill-space/datafile 2024-05-08T18:00:11.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-305 td/osd-backfill-space/datafile 2024-05-08T18:00:11.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-306 td/osd-backfill-space/datafile 2024-05-08T18:00:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-307 td/osd-backfill-space/datafile 2024-05-08T18:00:11.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:11.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-308 td/osd-backfill-space/datafile 2024-05-08T18:00:12.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-309 td/osd-backfill-space/datafile 2024-05-08T18:00:12.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-310 td/osd-backfill-space/datafile 2024-05-08T18:00:12.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-311 td/osd-backfill-space/datafile 2024-05-08T18:00:12.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-312 td/osd-backfill-space/datafile 2024-05-08T18:00:12.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-313 td/osd-backfill-space/datafile 2024-05-08T18:00:12.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-314 td/osd-backfill-space/datafile 2024-05-08T18:00:12.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-315 td/osd-backfill-space/datafile 2024-05-08T18:00:12.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-316 td/osd-backfill-space/datafile 2024-05-08T18:00:12.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:12.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-317 td/osd-backfill-space/datafile 2024-05-08T18:00:13.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-318 td/osd-backfill-space/datafile 2024-05-08T18:00:13.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-319 td/osd-backfill-space/datafile 2024-05-08T18:00:13.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-320 td/osd-backfill-space/datafile 2024-05-08T18:00:13.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-321 td/osd-backfill-space/datafile 2024-05-08T18:00:13.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-322 td/osd-backfill-space/datafile 2024-05-08T18:00:13.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-323 td/osd-backfill-space/datafile 2024-05-08T18:00:13.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-324 td/osd-backfill-space/datafile 2024-05-08T18:00:13.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-325 td/osd-backfill-space/datafile 2024-05-08T18:00:13.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:13.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-326 td/osd-backfill-space/datafile 2024-05-08T18:00:14.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-327 td/osd-backfill-space/datafile 2024-05-08T18:00:14.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-328 td/osd-backfill-space/datafile 2024-05-08T18:00:14.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-329 td/osd-backfill-space/datafile 2024-05-08T18:00:14.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-330 td/osd-backfill-space/datafile 2024-05-08T18:00:14.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-331 td/osd-backfill-space/datafile 2024-05-08T18:00:14.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-332 td/osd-backfill-space/datafile 2024-05-08T18:00:14.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-333 td/osd-backfill-space/datafile 2024-05-08T18:00:14.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-334 td/osd-backfill-space/datafile 2024-05-08T18:00:14.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:14.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-335 td/osd-backfill-space/datafile 2024-05-08T18:00:15.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-336 td/osd-backfill-space/datafile 2024-05-08T18:00:15.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-337 td/osd-backfill-space/datafile 2024-05-08T18:00:15.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-338 td/osd-backfill-space/datafile 2024-05-08T18:00:15.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-339 td/osd-backfill-space/datafile 2024-05-08T18:00:15.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-340 td/osd-backfill-space/datafile 2024-05-08T18:00:15.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-341 td/osd-backfill-space/datafile 2024-05-08T18:00:15.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-342 td/osd-backfill-space/datafile 2024-05-08T18:00:15.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-343 td/osd-backfill-space/datafile 2024-05-08T18:00:15.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:15.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-344 td/osd-backfill-space/datafile 2024-05-08T18:00:16.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:16.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-345 td/osd-backfill-space/datafile 2024-05-08T18:00:16.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:16.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-346 td/osd-backfill-space/datafile 2024-05-08T18:00:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-347 td/osd-backfill-space/datafile 2024-05-08T18:00:16.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:16.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-348 td/osd-backfill-space/datafile 2024-05-08T18:00:16.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:16.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-349 td/osd-backfill-space/datafile 2024-05-08T18:00:16.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:16.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-350 td/osd-backfill-space/datafile 2024-05-08T18:00:16.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:16.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-351 td/osd-backfill-space/datafile 2024-05-08T18:00:16.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:16.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-352 td/osd-backfill-space/datafile 2024-05-08T18:00:17.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-353 td/osd-backfill-space/datafile 2024-05-08T18:00:17.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-354 td/osd-backfill-space/datafile 2024-05-08T18:00:17.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-355 td/osd-backfill-space/datafile 2024-05-08T18:00:17.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-356 td/osd-backfill-space/datafile 2024-05-08T18:00:17.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-357 td/osd-backfill-space/datafile 2024-05-08T18:00:17.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-358 td/osd-backfill-space/datafile 2024-05-08T18:00:17.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-359 td/osd-backfill-space/datafile 2024-05-08T18:00:17.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-360 td/osd-backfill-space/datafile 2024-05-08T18:00:17.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-361 td/osd-backfill-space/datafile 2024-05-08T18:00:17.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:17.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-362 td/osd-backfill-space/datafile 2024-05-08T18:00:18.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:18.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-363 td/osd-backfill-space/datafile 2024-05-08T18:00:18.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:18.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-364 td/osd-backfill-space/datafile 2024-05-08T18:00:18.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:18.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-365 td/osd-backfill-space/datafile 2024-05-08T18:00:18.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:18.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-366 td/osd-backfill-space/datafile 2024-05-08T18:00:18.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:18.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-367 td/osd-backfill-space/datafile 2024-05-08T18:00:18.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:18.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-368 td/osd-backfill-space/datafile 2024-05-08T18:00:18.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:18.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-369 td/osd-backfill-space/datafile 2024-05-08T18:00:18.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:18.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-370 td/osd-backfill-space/datafile 2024-05-08T18:00:19.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-371 td/osd-backfill-space/datafile 2024-05-08T18:00:19.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-372 td/osd-backfill-space/datafile 2024-05-08T18:00:19.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-373 td/osd-backfill-space/datafile 2024-05-08T18:00:19.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-374 td/osd-backfill-space/datafile 2024-05-08T18:00:19.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-375 td/osd-backfill-space/datafile 2024-05-08T18:00:19.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-376 td/osd-backfill-space/datafile 2024-05-08T18:00:19.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-377 td/osd-backfill-space/datafile 2024-05-08T18:00:19.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-378 td/osd-backfill-space/datafile 2024-05-08T18:00:19.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:19.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-379 td/osd-backfill-space/datafile 2024-05-08T18:00:20.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-380 td/osd-backfill-space/datafile 2024-05-08T18:00:20.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-381 td/osd-backfill-space/datafile 2024-05-08T18:00:20.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-382 td/osd-backfill-space/datafile 2024-05-08T18:00:20.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-383 td/osd-backfill-space/datafile 2024-05-08T18:00:20.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-384 td/osd-backfill-space/datafile 2024-05-08T18:00:20.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-385 td/osd-backfill-space/datafile 2024-05-08T18:00:20.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-386 td/osd-backfill-space/datafile 2024-05-08T18:00:20.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-387 td/osd-backfill-space/datafile 2024-05-08T18:00:20.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:20.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-388 td/osd-backfill-space/datafile 2024-05-08T18:00:21.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-389 td/osd-backfill-space/datafile 2024-05-08T18:00:21.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-390 td/osd-backfill-space/datafile 2024-05-08T18:00:21.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-391 td/osd-backfill-space/datafile 2024-05-08T18:00:21.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-392 td/osd-backfill-space/datafile 2024-05-08T18:00:21.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-393 td/osd-backfill-space/datafile 2024-05-08T18:00:21.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-394 td/osd-backfill-space/datafile 2024-05-08T18:00:21.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-395 td/osd-backfill-space/datafile 2024-05-08T18:00:21.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-396 td/osd-backfill-space/datafile 2024-05-08T18:00:21.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:21.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-397 td/osd-backfill-space/datafile 2024-05-08T18:00:22.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:22.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-398 td/osd-backfill-space/datafile 2024-05-08T18:00:22.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:22.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-399 td/osd-backfill-space/datafile 2024-05-08T18:00:22.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:22.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-400 td/osd-backfill-space/datafile 2024-05-08T18:00:22.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:22.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-401 td/osd-backfill-space/datafile 2024-05-08T18:00:22.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:22.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-402 td/osd-backfill-space/datafile 2024-05-08T18:00:22.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:22.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-403 td/osd-backfill-space/datafile 2024-05-08T18:00:22.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:22.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-404 td/osd-backfill-space/datafile 2024-05-08T18:00:22.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:22.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-405 td/osd-backfill-space/datafile 2024-05-08T18:00:23.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-406 td/osd-backfill-space/datafile 2024-05-08T18:00:23.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-407 td/osd-backfill-space/datafile 2024-05-08T18:00:23.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-408 td/osd-backfill-space/datafile 2024-05-08T18:00:23.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-409 td/osd-backfill-space/datafile 2024-05-08T18:00:23.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-410 td/osd-backfill-space/datafile 2024-05-08T18:00:23.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-411 td/osd-backfill-space/datafile 2024-05-08T18:00:23.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-412 td/osd-backfill-space/datafile 2024-05-08T18:00:23.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-413 td/osd-backfill-space/datafile 2024-05-08T18:00:23.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:23.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-414 td/osd-backfill-space/datafile 2024-05-08T18:00:24.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-415 td/osd-backfill-space/datafile 2024-05-08T18:00:24.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-416 td/osd-backfill-space/datafile 2024-05-08T18:00:24.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-417 td/osd-backfill-space/datafile 2024-05-08T18:00:24.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-418 td/osd-backfill-space/datafile 2024-05-08T18:00:24.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-419 td/osd-backfill-space/datafile 2024-05-08T18:00:24.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-420 td/osd-backfill-space/datafile 2024-05-08T18:00:24.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-421 td/osd-backfill-space/datafile 2024-05-08T18:00:24.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-422 td/osd-backfill-space/datafile 2024-05-08T18:00:24.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:24.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-423 td/osd-backfill-space/datafile 2024-05-08T18:00:25.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-424 td/osd-backfill-space/datafile 2024-05-08T18:00:25.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-425 td/osd-backfill-space/datafile 2024-05-08T18:00:25.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-426 td/osd-backfill-space/datafile 2024-05-08T18:00:25.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-427 td/osd-backfill-space/datafile 2024-05-08T18:00:25.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-428 td/osd-backfill-space/datafile 2024-05-08T18:00:25.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-429 td/osd-backfill-space/datafile 2024-05-08T18:00:25.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-430 td/osd-backfill-space/datafile 2024-05-08T18:00:25.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-431 td/osd-backfill-space/datafile 2024-05-08T18:00:25.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:25.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-432 td/osd-backfill-space/datafile 2024-05-08T18:00:26.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-433 td/osd-backfill-space/datafile 2024-05-08T18:00:26.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-434 td/osd-backfill-space/datafile 2024-05-08T18:00:26.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-435 td/osd-backfill-space/datafile 2024-05-08T18:00:26.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-436 td/osd-backfill-space/datafile 2024-05-08T18:00:26.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-437 td/osd-backfill-space/datafile 2024-05-08T18:00:26.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-438 td/osd-backfill-space/datafile 2024-05-08T18:00:26.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-439 td/osd-backfill-space/datafile 2024-05-08T18:00:26.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-440 td/osd-backfill-space/datafile 2024-05-08T18:00:26.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:26.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-441 td/osd-backfill-space/datafile 2024-05-08T18:00:27.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-442 td/osd-backfill-space/datafile 2024-05-08T18:00:27.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-443 td/osd-backfill-space/datafile 2024-05-08T18:00:27.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-444 td/osd-backfill-space/datafile 2024-05-08T18:00:27.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-445 td/osd-backfill-space/datafile 2024-05-08T18:00:27.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-446 td/osd-backfill-space/datafile 2024-05-08T18:00:27.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-447 td/osd-backfill-space/datafile 2024-05-08T18:00:27.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-448 td/osd-backfill-space/datafile 2024-05-08T18:00:27.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-449 td/osd-backfill-space/datafile 2024-05-08T18:00:27.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:27.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-450 td/osd-backfill-space/datafile 2024-05-08T18:00:28.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:28.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-451 td/osd-backfill-space/datafile 2024-05-08T18:00:28.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:28.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-452 td/osd-backfill-space/datafile 2024-05-08T18:00:28.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:28.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-453 td/osd-backfill-space/datafile 2024-05-08T18:00:28.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:28.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-454 td/osd-backfill-space/datafile 2024-05-08T18:00:28.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:28.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-455 td/osd-backfill-space/datafile 2024-05-08T18:00:28.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:28.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-456 td/osd-backfill-space/datafile 2024-05-08T18:00:28.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:28.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-457 td/osd-backfill-space/datafile 2024-05-08T18:00:28.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:28.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-458 td/osd-backfill-space/datafile 2024-05-08T18:00:29.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-459 td/osd-backfill-space/datafile 2024-05-08T18:00:29.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-460 td/osd-backfill-space/datafile 2024-05-08T18:00:29.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-461 td/osd-backfill-space/datafile 2024-05-08T18:00:29.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-462 td/osd-backfill-space/datafile 2024-05-08T18:00:29.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-463 td/osd-backfill-space/datafile 2024-05-08T18:00:29.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-464 td/osd-backfill-space/datafile 2024-05-08T18:00:29.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-465 td/osd-backfill-space/datafile 2024-05-08T18:00:29.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-466 td/osd-backfill-space/datafile 2024-05-08T18:00:29.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-467 td/osd-backfill-space/datafile 2024-05-08T18:00:29.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:29.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-468 td/osd-backfill-space/datafile 2024-05-08T18:00:30.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-469 td/osd-backfill-space/datafile 2024-05-08T18:00:30.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-470 td/osd-backfill-space/datafile 2024-05-08T18:00:30.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-471 td/osd-backfill-space/datafile 2024-05-08T18:00:30.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-472 td/osd-backfill-space/datafile 2024-05-08T18:00:30.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-473 td/osd-backfill-space/datafile 2024-05-08T18:00:30.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-474 td/osd-backfill-space/datafile 2024-05-08T18:00:30.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-475 td/osd-backfill-space/datafile 2024-05-08T18:00:30.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-476 td/osd-backfill-space/datafile 2024-05-08T18:00:30.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:30.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-477 td/osd-backfill-space/datafile 2024-05-08T18:00:31.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:31.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-478 td/osd-backfill-space/datafile 2024-05-08T18:00:31.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:31.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-479 td/osd-backfill-space/datafile 2024-05-08T18:00:31.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:31.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-480 td/osd-backfill-space/datafile 2024-05-08T18:00:31.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:31.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-481 td/osd-backfill-space/datafile 2024-05-08T18:00:31.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:31.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-482 td/osd-backfill-space/datafile 2024-05-08T18:00:31.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:31.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-483 td/osd-backfill-space/datafile 2024-05-08T18:00:31.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:31.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-484 td/osd-backfill-space/datafile 2024-05-08T18:00:31.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:31.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-485 td/osd-backfill-space/datafile 2024-05-08T18:00:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-486 td/osd-backfill-space/datafile 2024-05-08T18:00:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-487 td/osd-backfill-space/datafile 2024-05-08T18:00:32.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-488 td/osd-backfill-space/datafile 2024-05-08T18:00:32.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-489 td/osd-backfill-space/datafile 2024-05-08T18:00:32.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-490 td/osd-backfill-space/datafile 2024-05-08T18:00:32.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-491 td/osd-backfill-space/datafile 2024-05-08T18:00:32.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-492 td/osd-backfill-space/datafile 2024-05-08T18:00:32.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-493 td/osd-backfill-space/datafile 2024-05-08T18:00:32.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-494 td/osd-backfill-space/datafile 2024-05-08T18:00:32.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:32.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-495 td/osd-backfill-space/datafile 2024-05-08T18:00:33.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-496 td/osd-backfill-space/datafile 2024-05-08T18:00:33.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-497 td/osd-backfill-space/datafile 2024-05-08T18:00:33.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-498 td/osd-backfill-space/datafile 2024-05-08T18:00:33.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-499 td/osd-backfill-space/datafile 2024-05-08T18:00:33.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-500 td/osd-backfill-space/datafile 2024-05-08T18:00:33.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-501 td/osd-backfill-space/datafile 2024-05-08T18:00:33.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-502 td/osd-backfill-space/datafile 2024-05-08T18:00:33.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-503 td/osd-backfill-space/datafile 2024-05-08T18:00:33.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:33.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-504 td/osd-backfill-space/datafile 2024-05-08T18:00:34.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:34.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-505 td/osd-backfill-space/datafile 2024-05-08T18:00:34.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:34.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-506 td/osd-backfill-space/datafile 2024-05-08T18:00:34.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:34.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-507 td/osd-backfill-space/datafile 2024-05-08T18:00:34.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:34.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-508 td/osd-backfill-space/datafile 2024-05-08T18:00:34.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:34.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-509 td/osd-backfill-space/datafile 2024-05-08T18:00:34.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:34.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-510 td/osd-backfill-space/datafile 2024-05-08T18:00:35.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-511 td/osd-backfill-space/datafile 2024-05-08T18:00:35.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-512 td/osd-backfill-space/datafile 2024-05-08T18:00:35.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-513 td/osd-backfill-space/datafile 2024-05-08T18:00:35.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-514 td/osd-backfill-space/datafile 2024-05-08T18:00:35.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-515 td/osd-backfill-space/datafile 2024-05-08T18:00:35.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-516 td/osd-backfill-space/datafile 2024-05-08T18:00:35.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-517 td/osd-backfill-space/datafile 2024-05-08T18:00:35.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-518 td/osd-backfill-space/datafile 2024-05-08T18:00:35.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:35.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-519 td/osd-backfill-space/datafile 2024-05-08T18:00:36.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-520 td/osd-backfill-space/datafile 2024-05-08T18:00:36.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-521 td/osd-backfill-space/datafile 2024-05-08T18:00:36.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-522 td/osd-backfill-space/datafile 2024-05-08T18:00:36.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-523 td/osd-backfill-space/datafile 2024-05-08T18:00:36.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-524 td/osd-backfill-space/datafile 2024-05-08T18:00:36.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-525 td/osd-backfill-space/datafile 2024-05-08T18:00:36.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-526 td/osd-backfill-space/datafile 2024-05-08T18:00:36.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-527 td/osd-backfill-space/datafile 2024-05-08T18:00:36.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-528 td/osd-backfill-space/datafile 2024-05-08T18:00:36.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:36.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-529 td/osd-backfill-space/datafile 2024-05-08T18:00:37.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-530 td/osd-backfill-space/datafile 2024-05-08T18:00:37.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-531 td/osd-backfill-space/datafile 2024-05-08T18:00:37.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-532 td/osd-backfill-space/datafile 2024-05-08T18:00:37.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-533 td/osd-backfill-space/datafile 2024-05-08T18:00:37.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-534 td/osd-backfill-space/datafile 2024-05-08T18:00:37.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-535 td/osd-backfill-space/datafile 2024-05-08T18:00:37.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-536 td/osd-backfill-space/datafile 2024-05-08T18:00:37.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-537 td/osd-backfill-space/datafile 2024-05-08T18:00:37.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-538 td/osd-backfill-space/datafile 2024-05-08T18:00:37.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-539 td/osd-backfill-space/datafile 2024-05-08T18:00:37.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-540 td/osd-backfill-space/datafile 2024-05-08T18:00:37.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:37.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-541 td/osd-backfill-space/datafile 2024-05-08T18:00:38.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-542 td/osd-backfill-space/datafile 2024-05-08T18:00:38.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-543 td/osd-backfill-space/datafile 2024-05-08T18:00:38.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-544 td/osd-backfill-space/datafile 2024-05-08T18:00:38.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-545 td/osd-backfill-space/datafile 2024-05-08T18:00:38.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-546 td/osd-backfill-space/datafile 2024-05-08T18:00:38.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-547 td/osd-backfill-space/datafile 2024-05-08T18:00:38.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-548 td/osd-backfill-space/datafile 2024-05-08T18:00:38.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-549 td/osd-backfill-space/datafile 2024-05-08T18:00:38.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-550 td/osd-backfill-space/datafile 2024-05-08T18:00:38.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-551 td/osd-backfill-space/datafile 2024-05-08T18:00:38.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-552 td/osd-backfill-space/datafile 2024-05-08T18:00:38.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:38.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-553 td/osd-backfill-space/datafile 2024-05-08T18:00:39.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-554 td/osd-backfill-space/datafile 2024-05-08T18:00:39.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-555 td/osd-backfill-space/datafile 2024-05-08T18:00:39.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-556 td/osd-backfill-space/datafile 2024-05-08T18:00:39.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-557 td/osd-backfill-space/datafile 2024-05-08T18:00:39.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-558 td/osd-backfill-space/datafile 2024-05-08T18:00:39.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-559 td/osd-backfill-space/datafile 2024-05-08T18:00:39.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-560 td/osd-backfill-space/datafile 2024-05-08T18:00:39.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-561 td/osd-backfill-space/datafile 2024-05-08T18:00:39.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-562 td/osd-backfill-space/datafile 2024-05-08T18:00:39.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-563 td/osd-backfill-space/datafile 2024-05-08T18:00:39.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:39.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-564 td/osd-backfill-space/datafile 2024-05-08T18:00:40.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-565 td/osd-backfill-space/datafile 2024-05-08T18:00:40.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-566 td/osd-backfill-space/datafile 2024-05-08T18:00:40.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-567 td/osd-backfill-space/datafile 2024-05-08T18:00:40.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-568 td/osd-backfill-space/datafile 2024-05-08T18:00:40.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-569 td/osd-backfill-space/datafile 2024-05-08T18:00:40.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-570 td/osd-backfill-space/datafile 2024-05-08T18:00:40.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-571 td/osd-backfill-space/datafile 2024-05-08T18:00:40.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-572 td/osd-backfill-space/datafile 2024-05-08T18:00:40.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-573 td/osd-backfill-space/datafile 2024-05-08T18:00:40.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-574 td/osd-backfill-space/datafile 2024-05-08T18:00:40.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:40.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-575 td/osd-backfill-space/datafile 2024-05-08T18:00:41.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-576 td/osd-backfill-space/datafile 2024-05-08T18:00:41.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-577 td/osd-backfill-space/datafile 2024-05-08T18:00:41.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-578 td/osd-backfill-space/datafile 2024-05-08T18:00:41.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-579 td/osd-backfill-space/datafile 2024-05-08T18:00:41.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-580 td/osd-backfill-space/datafile 2024-05-08T18:00:41.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-581 td/osd-backfill-space/datafile 2024-05-08T18:00:41.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-582 td/osd-backfill-space/datafile 2024-05-08T18:00:41.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-583 td/osd-backfill-space/datafile 2024-05-08T18:00:41.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-584 td/osd-backfill-space/datafile 2024-05-08T18:00:41.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-585 td/osd-backfill-space/datafile 2024-05-08T18:00:41.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:41.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-586 td/osd-backfill-space/datafile 2024-05-08T18:00:42.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-587 td/osd-backfill-space/datafile 2024-05-08T18:00:42.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-588 td/osd-backfill-space/datafile 2024-05-08T18:00:42.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-589 td/osd-backfill-space/datafile 2024-05-08T18:00:42.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-590 td/osd-backfill-space/datafile 2024-05-08T18:00:42.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-591 td/osd-backfill-space/datafile 2024-05-08T18:00:42.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-592 td/osd-backfill-space/datafile 2024-05-08T18:00:42.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-593 td/osd-backfill-space/datafile 2024-05-08T18:00:42.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-594 td/osd-backfill-space/datafile 2024-05-08T18:00:42.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-595 td/osd-backfill-space/datafile 2024-05-08T18:00:42.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-596 td/osd-backfill-space/datafile 2024-05-08T18:00:42.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-597 td/osd-backfill-space/datafile 2024-05-08T18:00:42.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:42.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-598 td/osd-backfill-space/datafile 2024-05-08T18:00:43.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:43.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-599 td/osd-backfill-space/datafile 2024-05-08T18:00:43.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:43.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-600 td/osd-backfill-space/datafile 2024-05-08T18:00:43.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:468: TEST_backfill_multi_partial: get_primary fillpool obj-fill-1 2024-05-08T18:00:43.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=fillpool 2024-05-08T18:00:43.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj-fill-1 2024-05-08T18:00:43.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map fillpool obj-fill-1 2024-05-08T18:00:43.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T18:00:43.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:468: TEST_backfill_multi_partial: local fillosd=1 2024-05-08T18:00:43.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:469: TEST_backfill_multi_partial: expr 1 + 1 2024-05-08T18:00:43.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:469: TEST_backfill_multi_partial: osd=2 2024-05-08T18:00:43.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:470: TEST_backfill_multi_partial: '[' 2 = 3 ']' 2024-05-08T18:00:43.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:474: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2024-05-08T18:00:43.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2024-05-08T18:00:43.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=145008 2024-05-08T18:00:43.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2024-05-08T18:00:43.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-05-08T18:00:43.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2024-05-08T18:00:43.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:00:43.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 145008 2024-05-08T18:00:43.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T18:00:43.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T18:00:43.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2024-05-08T18:00:43.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:00:43.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 145008 2024-05-08T18:00:43.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T18:00:43.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T18:00:43.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.2 2024-05-08T18:00:43.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:00:43.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 145008 2024-05-08T18:00:43.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2024-05-08T18:00:43.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2024-05-08T18:00:43.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2024-05-08T18:00:43.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:475: TEST_backfill_multi_partial: ceph osd out osd.1 2024-05-08T18:00:44.772 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T18:00:44.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:477: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op export-remove --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2024-05-08T18:00:44.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-05-08T18:00:44.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T18:00:44.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2024-05-08T18:00:44.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T18:00:44.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2024-05-08T18:00:44.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op export-remove --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2024-05-08T18:00:46.840 INFO:tasks.workunit.client.0.smithi117.stderr:Exporting 1.0 info 1.0( v 36'600 (36'500,36'600] local-lis/les=24/25 n=600 ec=21/21 lis/c=24/24 les/c/f=25/25/0 sis=24) 2024-05-08T18:00:46.847 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0002d87b:::obj-fill-318:head# 2024-05-08T18:00:46.851 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:00676868:::obj-fill-583:head# 2024-05-08T18:00:46.857 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:00f4514e:::obj-fill-547:head# 2024-05-08T18:00:46.864 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:01596a3c:::obj-fill-533:head# 2024-05-08T18:00:46.865 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0285e89c:::obj-fill-190:head# 2024-05-08T18:00:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:02bd591e:::obj-fill-463:head# 2024-05-08T18:00:46.874 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:02c01ffe:::obj-fill-28:head# 2024-05-08T18:00:46.875 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:03ada31e:::obj-fill-285:head# 2024-05-08T18:00:46.883 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:03b07c3f:::obj-fill-568:head# 2024-05-08T18:00:46.884 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:03b85770:::obj-fill-573:head# 2024-05-08T18:00:46.885 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:03dcbe89:::obj-fill-375:head# 2024-05-08T18:00:46.885 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:04231826:::obj-fill-594:head# 2024-05-08T18:00:46.886 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:04d48684:::obj-fill-421:head# 2024-05-08T18:00:46.887 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:05385fcc:::obj-fill-299:head# 2024-05-08T18:00:46.887 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:05785d38:::obj-fill-159:head# 2024-05-08T18:00:46.889 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:057ec231:::obj-fill-138:head# 2024-05-08T18:00:46.889 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:06058b5e:::obj-fill-569:head# 2024-05-08T18:00:46.890 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:06d2a3d9:::obj-fill-284:head# 2024-05-08T18:00:46.894 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:07597b63:::obj-fill-459:head# 2024-05-08T18:00:46.894 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:075f4069:::obj-fill-550:head# 2024-05-08T18:00:46.894 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:08234052:::obj-fill-17:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:091ce2ec:::obj-fill-472:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:095fd509:::obj-fill-210:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0a52a594:::obj-fill-116:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0a63716b:::obj-fill-225:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0b0fa6fb:::obj-fill-541:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0b673f72:::obj-fill-232:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0bbcd1b2:::obj-fill-582:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0caf8ce3:::obj-fill-214:head# 2024-05-08T18:00:46.899 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0d94b9fb:::obj-fill-415:head# 2024-05-08T18:00:46.900 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0de4e6f7:::obj-fill-94:head# 2024-05-08T18:00:46.901 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0ef75768:::obj-fill-489:head# 2024-05-08T18:00:46.901 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0f67284f:::obj-fill-213:head# 2024-05-08T18:00:46.901 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:0f823df2:::obj-fill-234:head# 2024-05-08T18:00:46.902 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1005c08d:::obj-fill-490:head# 2024-05-08T18:00:46.902 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1039525f:::obj-fill-369:head# 2024-05-08T18:00:46.902 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:105fb36c:::obj-fill-226:head# 2024-05-08T18:00:46.905 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:111abdeb:::obj-fill-554:head# 2024-05-08T18:00:46.905 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:11392f3d:::obj-fill-453:head# 2024-05-08T18:00:46.905 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1169976c:::obj-fill-417:head# 2024-05-08T18:00:46.906 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:11840a2a:::obj-fill-477:head# 2024-05-08T18:00:46.906 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:11a4832e:::obj-fill-279:head# 2024-05-08T18:00:46.917 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:11a4d2f6:::obj-fill-256:head# 2024-05-08T18:00:46.919 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:12d52a31:::obj-fill-22:head# 2024-05-08T18:00:46.919 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:133c45db:::obj-fill-257:head# 2024-05-08T18:00:46.920 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:13563256:::obj-fill-150:head# 2024-05-08T18:00:46.920 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:13c09e00:::obj-fill-71:head# 2024-05-08T18:00:46.921 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:13e9fbed:::obj-fill-242:head# 2024-05-08T18:00:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:13fae6c2:::obj-fill-163:head# 2024-05-08T18:00:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:145025e0:::obj-fill-543:head# 2024-05-08T18:00:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:14517c84:::obj-fill-13:head# 2024-05-08T18:00:46.927 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:14802e9c:::obj-fill-127:head# 2024-05-08T18:00:46.927 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:150f1c96:::obj-fill-62:head# 2024-05-08T18:00:46.927 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:155e90a2:::obj-fill-537:head# 2024-05-08T18:00:46.927 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1632c776:::obj-fill-262:head# 2024-05-08T18:00:46.927 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:163bde28:::obj-fill-523:head# 2024-05-08T18:00:46.927 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:169c4ad0:::obj-fill-85:head# 2024-05-08T18:00:46.930 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:16c4da1d:::obj-fill-436:head# 2024-05-08T18:00:46.931 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:17b28c32:::obj-fill-345:head# 2024-05-08T18:00:46.931 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:17b34255:::obj-fill-577:head# 2024-05-08T18:00:46.932 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:17d2541f:::obj-fill-426:head# 2024-05-08T18:00:46.932 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:17ea19f2:::obj-fill-542:head# 2024-05-08T18:00:46.932 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:189155ea:::obj-fill-496:head# 2024-05-08T18:00:46.932 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:191a6d81:::obj-fill-548:head# 2024-05-08T18:00:46.934 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1a964993:::obj-fill-576:head# 2024-05-08T18:00:46.934 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1aa623dc:::obj-fill-356:head# 2024-05-08T18:00:46.934 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1abe5c38:::obj-fill-561:head# 2024-05-08T18:00:46.935 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1bddc06b:::obj-fill-7:head# 2024-05-08T18:00:46.935 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1be86b71:::obj-fill-295:head# 2024-05-08T18:00:46.935 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1c499bca:::obj-fill-240:head# 2024-05-08T18:00:46.936 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1c545e27:::obj-fill-509:head# 2024-05-08T18:00:46.937 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1c63c8f4:::obj-fill-4:head# 2024-05-08T18:00:46.938 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1d5a8f59:::obj-fill-377:head# 2024-05-08T18:00:46.938 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1d85b5df:::obj-fill-201:head# 2024-05-08T18:00:46.939 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1d9a0d5b:::obj-fill-581:head# 2024-05-08T18:00:46.939 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1dcf5667:::obj-fill-488:head# 2024-05-08T18:00:46.940 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1fa3090d:::obj-fill-458:head# 2024-05-08T18:00:46.941 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1fe937f6:::obj-fill-337:head# 2024-05-08T18:00:46.941 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:1ff54542:::obj-fill-349:head# 2024-05-08T18:00:46.945 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:20d9e0ca:::obj-fill-367:head# 2024-05-08T18:00:46.945 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:21b8e3bb:::obj-fill-538:head# 2024-05-08T18:00:46.945 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:227183d4:::obj-fill-235:head# 2024-05-08T18:00:46.945 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:229e5e5d:::obj-fill-522:head# 2024-05-08T18:00:46.945 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:234f8861:::obj-fill-476:head# 2024-05-08T18:00:46.946 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:23ac2c9d:::obj-fill-471:head# 2024-05-08T18:00:46.946 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:25db1742:::obj-fill-200:head# 2024-05-08T18:00:46.947 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:264f8545:::obj-fill-230:head# 2024-05-08T18:00:46.947 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:267ba97f:::obj-fill-493:head# 2024-05-08T18:00:46.948 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:26b067e8:::obj-fill-208:head# 2024-05-08T18:00:46.948 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:26f521cb:::obj-fill-300:head# 2024-05-08T18:00:46.949 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:27e70a11:::obj-fill-368:head# 2024-05-08T18:00:46.949 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:29357d4a:::obj-fill-456:head# 2024-05-08T18:00:46.950 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:29f2567e:::obj-fill-414:head# 2024-05-08T18:00:46.951 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2a10cbb6:::obj-fill-228:head# 2024-05-08T18:00:46.951 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2a1519a6:::obj-fill-148:head# 2024-05-08T18:00:46.955 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2a686ca6:::obj-fill-411:head# 2024-05-08T18:00:46.955 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2ab3f384:::obj-fill-77:head# 2024-05-08T18:00:46.956 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2ae6a1d0:::obj-fill-187:head# 2024-05-08T18:00:46.956 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2b890959:::obj-fill-222:head# 2024-05-08T18:00:46.956 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2bcc26c4:::obj-fill-114:head# 2024-05-08T18:00:46.956 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2bd3a3a2:::obj-fill-281:head# 2024-05-08T18:00:46.956 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2c1a21d7:::obj-fill-505:head# 2024-05-08T18:00:46.956 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2c255347:::obj-fill-95:head# 2024-05-08T18:00:46.957 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2c2a3f62:::obj-fill-131:head# 2024-05-08T18:00:46.957 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2c7d92ce:::obj-fill-442:head# 2024-05-08T18:00:46.958 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2d1ad117:::obj-fill-443:head# 2024-05-08T18:00:46.958 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2d57b2f7:::obj-fill-192:head# 2024-05-08T18:00:46.959 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2d7b53ea:::obj-fill-79:head# 2024-05-08T18:00:46.959 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2db25266:::obj-fill-121:head# 2024-05-08T18:00:46.960 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2e27853e:::obj-fill-473:head# 2024-05-08T18:00:46.960 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2f12cb21:::obj-fill-386:head# 2024-05-08T18:00:46.963 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2f957332:::obj-fill-422:head# 2024-05-08T18:00:46.963 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:2feae493:::obj-fill-301:head# 2024-05-08T18:00:46.963 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:302c95d2:::obj-fill-110:head# 2024-05-08T18:00:46.963 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:302d6b76:::obj-fill-374:head# 2024-05-08T18:00:46.963 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:30581f34:::obj-fill-313:head# 2024-05-08T18:00:46.964 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:307e86ac:::obj-fill-381:head# 2024-05-08T18:00:46.964 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:30ab77bf:::obj-fill-275:head# 2024-05-08T18:00:46.965 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:31127e6d:::obj-fill-250:head# 2024-05-08T18:00:46.965 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:32c93500:::obj-fill-155:head# 2024-05-08T18:00:46.966 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:339880b7:::obj-fill-227:head# 2024-05-08T18:00:46.967 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:34069e1e:::obj-fill-292:head# 2024-05-08T18:00:46.967 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:346dff31:::obj-fill-157:head# 2024-05-08T18:00:46.968 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:34ade0f1:::obj-fill-575:head# 2024-05-08T18:00:46.968 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:34bbae43:::obj-fill-90:head# 2024-05-08T18:00:46.969 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:34e97cf8:::obj-fill-334:head# 2024-05-08T18:00:46.970 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:35d7ccc2:::obj-fill-510:head# 2024-05-08T18:00:46.970 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:35f519b6:::obj-fill-513:head# 2024-05-08T18:00:46.971 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:364727e8:::obj-fill-130:head# 2024-05-08T18:00:46.971 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:364c0361:::obj-fill-586:head# 2024-05-08T18:00:46.973 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:368e7baf:::obj-fill-546:head# 2024-05-08T18:00:46.973 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:36ffb224:::obj-fill-82:head# 2024-05-08T18:00:46.973 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:371cb800:::obj-fill-330:head# 2024-05-08T18:00:46.974 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:37d5378d:::obj-fill-175:head# 2024-05-08T18:00:46.974 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:385593f3:::obj-fill-325:head# 2024-05-08T18:00:46.975 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:388d5073:::obj-fill-317:head# 2024-05-08T18:00:46.975 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:394af079:::obj-fill-59:head# 2024-05-08T18:00:46.976 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3a41ad37:::obj-fill-409:head# 2024-05-08T18:00:46.976 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3b3c63d2:::obj-fill-136:head# 2024-05-08T18:00:46.977 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3bb50131:::obj-fill-512:head# 2024-05-08T18:00:46.978 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3bb52bb5:::obj-fill-188:head# 2024-05-08T18:00:46.978 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3c0683d1:::obj-fill-372:head# 2024-05-08T18:00:46.979 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3c67d3f4:::obj-fill-249:head# 2024-05-08T18:00:46.979 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3c6a4a4c:::obj-fill-495:head# 2024-05-08T18:00:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3c7fc8c9:::obj-fill-324:head# 2024-05-08T18:00:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3d940c50:::obj-fill-591:head# 2024-05-08T18:00:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3ed5508e:::obj-fill-558:head# 2024-05-08T18:00:46.982 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:3f598316:::obj-fill-389:head# 2024-05-08T18:00:46.982 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:401cd0ce:::obj-fill-251:head# 2024-05-08T18:00:46.983 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:40fae006:::obj-fill-14:head# 2024-05-08T18:00:46.983 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4120b10f:::obj-fill-165:head# 2024-05-08T18:00:46.984 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:41b382c2:::obj-fill-289:head# 2024-05-08T18:00:46.984 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4277cdea:::obj-fill-319:head# 2024-05-08T18:00:46.985 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:42978c3c:::obj-fill-174:head# 2024-05-08T18:00:46.986 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:42b08dc2:::obj-fill-553:head# 2024-05-08T18:00:46.987 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:42ec4bf6:::obj-fill-209:head# 2024-05-08T18:00:46.987 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:430c129d:::obj-fill-448:head# 2024-05-08T18:00:46.988 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4335d553:::obj-fill-600:head# 2024-05-08T18:00:46.988 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:44804f62:::obj-fill-532:head# 2024-05-08T18:00:46.989 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:44954d54:::obj-fill-2:head# 2024-05-08T18:00:46.990 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4502f904:::obj-fill-429:head# 2024-05-08T18:00:46.990 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4568ddcb:::obj-fill-382:head# 2024-05-08T18:00:46.991 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:45939974:::obj-fill-563:head# 2024-05-08T18:00:46.993 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:462a5bbd:::obj-fill-567:head# 2024-05-08T18:00:46.993 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:47773ae4:::obj-fill-307:head# 2024-05-08T18:00:46.993 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4802b263:::obj-fill-387:head# 2024-05-08T18:00:46.993 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:483d938e:::obj-fill-128:head# 2024-05-08T18:00:46.994 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:48a7ad29:::obj-fill-147:head# 2024-05-08T18:00:46.994 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:493b61ce:::obj-fill-454:head# 2024-05-08T18:00:46.995 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4afb70fe:::obj-fill-186:head# 2024-05-08T18:00:46.995 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4bff08e3:::obj-fill-352:head# 2024-05-08T18:00:46.996 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4c01eabe:::obj-fill-370:head# 2024-05-08T18:00:46.996 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4c131560:::obj-fill-6:head# 2024-05-08T18:00:46.996 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4c4c5e14:::obj-fill-350:head# 2024-05-08T18:00:46.997 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4c80dc2c:::obj-fill-357:head# 2024-05-08T18:00:46.997 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4c9dee9b:::obj-fill-540:head# 2024-05-08T18:00:46.998 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4ce40c18:::obj-fill-280:head# 2024-05-08T18:00:46.999 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4d854fc3:::obj-fill-585:head# 2024-05-08T18:00:46.999 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:4f615b53:::obj-fill-101:head# 2024-05-08T18:00:47.000 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5042b30f:::obj-fill-84:head# 2024-05-08T18:00:47.000 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:507dc08b:::obj-fill-336:head# 2024-05-08T18:00:47.001 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:512fcf5a:::obj-fill-169:head# 2024-05-08T18:00:47.001 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:51a0c8f8:::obj-fill-578:head# 2024-05-08T18:00:47.002 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:51fd05a2:::obj-fill-425:head# 2024-05-08T18:00:47.003 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:52400ebc:::obj-fill-81:head# 2024-05-08T18:00:47.004 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5288d40c:::obj-fill-16:head# 2024-05-08T18:00:47.004 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5295b0ee:::obj-fill-224:head# 2024-05-08T18:00:47.005 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:531e4c60:::obj-fill-103:head# 2024-05-08T18:00:47.005 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:54259f28:::obj-fill-584:head# 2024-05-08T18:00:47.006 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:542d619c:::obj-fill-528:head# 2024-05-08T18:00:47.007 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5503ca3e:::obj-fill-494:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5555c48b:::obj-fill-403:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:558d1ec7:::obj-fill-447:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:55aa2233:::obj-fill-21:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:55aaf8c4:::obj-fill-29:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:55e246e1:::obj-fill-65:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:563b14a8:::obj-fill-120:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:56e1df25:::obj-fill-305:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5702979c:::obj-fill-73:head# 2024-05-08T18:00:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:570722ba:::obj-fill-219:head# 2024-05-08T18:00:47.013 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:57f7a09b:::obj-fill-571:head# 2024-05-08T18:00:47.013 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:585309ba:::obj-fill-144:head# 2024-05-08T18:00:47.013 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:585c7c9c:::obj-fill-437:head# 2024-05-08T18:00:47.015 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:587c63db:::obj-fill-182:head# 2024-05-08T18:00:47.015 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:58f34d6b:::obj-fill-598:head# 2024-05-08T18:00:47.015 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:58f40088:::obj-fill-298:head# 2024-05-08T18:00:47.016 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:591e150c:::obj-fill-32:head# 2024-05-08T18:00:47.016 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:59971ddb:::obj-fill-559:head# 2024-05-08T18:00:47.017 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5adafca4:::obj-fill-56:head# 2024-05-08T18:00:47.018 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5b32b04f:::obj-fill-484:head# 2024-05-08T18:00:47.019 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5bdaeb16:::obj-fill-99:head# 2024-05-08T18:00:47.019 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5c1d6f4b:::obj-fill-133:head# 2024-05-08T18:00:47.019 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5c92b8f1:::obj-fill-255:head# 2024-05-08T18:00:47.020 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5ca4850f:::obj-fill-238:head# 2024-05-08T18:00:47.021 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5d928a5b:::obj-fill-395:head# 2024-05-08T18:00:47.022 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5dd49320:::obj-fill-423:head# 2024-05-08T18:00:47.022 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5e7bc368:::obj-fill-506:head# 2024-05-08T18:00:47.023 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5ebd5ee3:::obj-fill-322:head# 2024-05-08T18:00:47.023 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5edeedf1:::obj-fill-557:head# 2024-05-08T18:00:47.031 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:5facf8e2:::obj-fill-15:head# 2024-05-08T18:00:47.031 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:603a2c76:::obj-fill-439:head# 2024-05-08T18:00:47.031 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:60b30714:::obj-fill-53:head# 2024-05-08T18:00:47.031 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:612b4a8a:::obj-fill-412:head# 2024-05-08T18:00:47.032 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:61a111b6:::obj-fill-87:head# 2024-05-08T18:00:47.032 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:63a0e8a2:::obj-fill-266:head# 2024-05-08T18:00:47.032 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:63aa4d60:::obj-fill-68:head# 2024-05-08T18:00:47.032 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:63ac5b95:::obj-fill-405:head# 2024-05-08T18:00:47.032 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6415a9e3:::obj-fill-400:head# 2024-05-08T18:00:47.032 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:64ba03ae:::obj-fill-20:head# 2024-05-08T18:00:47.033 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6512f015:::obj-fill-597:head# 2024-05-08T18:00:47.033 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:65433104:::obj-fill-504:head# 2024-05-08T18:00:47.036 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:65950c58:::obj-fill-86:head# 2024-05-08T18:00:47.037 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:65b6b2d7:::obj-fill-39:head# 2024-05-08T18:00:47.037 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:661c8afd:::obj-fill-267:head# 2024-05-08T18:00:47.038 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:66f87c94:::obj-fill-229:head# 2024-05-08T18:00:47.038 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:67292cef:::obj-fill-93:head# 2024-05-08T18:00:47.038 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:67f0e12c:::obj-fill-363:head# 2024-05-08T18:00:47.038 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:696eb83b:::obj-fill-185:head# 2024-05-08T18:00:47.038 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6b33981c:::obj-fill-259:head# 2024-05-08T18:00:47.038 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6b5a527c:::obj-fill-485:head# 2024-05-08T18:00:47.038 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6b6f1852:::obj-fill-390:head# 2024-05-08T18:00:47.044 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6ba5c5f8:::obj-fill-304:head# 2024-05-08T18:00:47.044 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6bce929d:::obj-fill-518:head# 2024-05-08T18:00:47.044 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6c8ffc04:::obj-fill-61:head# 2024-05-08T18:00:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6ca7e551:::obj-fill-40:head# 2024-05-08T18:00:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6caff2cd:::obj-fill-332:head# 2024-05-08T18:00:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6ce4adc7:::obj-fill-574:head# 2024-05-08T18:00:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6d09d770:::obj-fill-74:head# 2024-05-08T18:00:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6e039822:::obj-fill-278:head# 2024-05-08T18:00:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6f2cd109:::obj-fill-297:head# 2024-05-08T18:00:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6f3754c4:::obj-fill-88:head# 2024-05-08T18:00:47.046 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6f86cfd2:::obj-fill-511:head# 2024-05-08T18:00:47.046 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:6fe3f3f7:::obj-fill-193:head# 2024-05-08T18:00:47.046 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7002c57d:::obj-fill-50:head# 2024-05-08T18:00:47.046 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7030b2a3:::obj-fill-217:head# 2024-05-08T18:00:47.059 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:70665087:::obj-fill-51:head# 2024-05-08T18:00:47.060 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:70a0f5e0:::obj-fill-11:head# 2024-05-08T18:00:47.060 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:71f4643d:::obj-fill-236:head# 2024-05-08T18:00:47.060 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:722fbd0f:::obj-fill-302:head# 2024-05-08T18:00:47.060 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:72584da9:::obj-fill-445:head# 2024-05-08T18:00:47.060 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:72d91d24:::obj-fill-218:head# 2024-05-08T18:00:47.060 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:72f7268b:::obj-fill-106:head# 2024-05-08T18:00:47.061 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:74077abf:::obj-fill-435:head# 2024-05-08T18:00:47.061 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:740ca050:::obj-fill-112:head# 2024-05-08T18:00:47.061 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7435e881:::obj-fill-78:head# 2024-05-08T18:00:47.061 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:74ba0bb7:::obj-fill-478:head# 2024-05-08T18:00:47.061 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:74d82091:::obj-fill-96:head# 2024-05-08T18:00:47.061 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7515f56c:::obj-fill-483:head# 2024-05-08T18:00:47.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7550d6fe:::obj-fill-286:head# 2024-05-08T18:00:47.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:75807edc:::obj-fill-223:head# 2024-05-08T18:00:47.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:762ba324:::obj-fill-172:head# 2024-05-08T18:00:47.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:76369bda:::obj-fill-570:head# 2024-05-08T18:00:47.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7667a5b0:::obj-fill-196:head# 2024-05-08T18:00:47.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:77736c0c:::obj-fill-566:head# 2024-05-08T18:00:47.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:77fb47a4:::obj-fill-314:head# 2024-05-08T18:00:47.063 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:785ad894:::obj-fill-80:head# 2024-05-08T18:00:47.063 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:785e3d14:::obj-fill-530:head# 2024-05-08T18:00:47.063 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:788efef4:::obj-fill-595:head# 2024-05-08T18:00:47.063 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:789ec5ab:::obj-fill-44:head# 2024-05-08T18:00:47.063 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:798a3fa8:::obj-fill-517:head# 2024-05-08T18:00:47.063 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:79a105ef:::obj-fill-315:head# 2024-05-08T18:00:47.072 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:79d02f04:::obj-fill-243:head# 2024-05-08T18:00:47.072 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7a00dfcb:::obj-fill-402:head# 2024-05-08T18:00:47.072 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7b982684:::obj-fill-168:head# 2024-05-08T18:00:47.073 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7bb36851:::obj-fill-440:head# 2024-05-08T18:00:47.073 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7bb49d8c:::obj-fill-55:head# 2024-05-08T18:00:47.073 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7c77b783:::obj-fill-580:head# 2024-05-08T18:00:47.073 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7c89d75b:::obj-fill-555:head# 2024-05-08T18:00:47.073 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7d12fb67:::obj-fill-399:head# 2024-05-08T18:00:47.073 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7d139961:::obj-fill-92:head# 2024-05-08T18:00:47.074 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7d39ffd0:::obj-fill-135:head# 2024-05-08T18:00:47.074 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7e534cc4:::obj-fill-282:head# 2024-05-08T18:00:47.074 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7e7a08e0:::obj-fill-108:head# 2024-05-08T18:00:47.074 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7e8e2b67:::obj-fill-244:head# 2024-05-08T18:00:47.074 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7eea215e:::obj-fill-139:head# 2024-05-08T18:00:47.074 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7efa3c6e:::obj-fill-408:head# 2024-05-08T18:00:47.074 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7f03a24b:::obj-fill-45:head# 2024-05-08T18:00:47.075 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7f6a2e2b:::obj-fill-427:head# 2024-05-08T18:00:47.075 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7fb0abd6:::obj-fill-479:head# 2024-05-08T18:00:47.075 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:7fb77de1:::obj-fill-167:head# 2024-05-08T18:00:47.075 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:80012a03:::obj-fill-105:head# 2024-05-08T18:00:47.104 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:80075ae5:::obj-fill-376:head# 2024-05-08T18:00:47.104 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8089baa5:::obj-fill-97:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:80d0b4c5:::obj-fill-123:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:810f319f:::obj-fill-552:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:81427ef2:::obj-fill-474:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:818d780c:::obj-fill-33:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:819f31b9:::obj-fill-366:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8205549d:::obj-fill-125:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:821f56e5:::obj-fill-339:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:822807c6:::obj-fill-69:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:822fcf61:::obj-fill-560:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:82ad696b:::obj-fill-149:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:835cc771:::obj-fill-446:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8386bee1:::obj-fill-137:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:83c1303a:::obj-fill-311:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:83cf1c2a:::obj-fill-360:head# 2024-05-08T18:00:47.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:83d70321:::obj-fill-351:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:83ef162d:::obj-fill-331:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:840f8f20:::obj-fill-398:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:84d2e456:::obj-fill-207:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:856697ff:::obj-fill-333:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:858be937:::obj-fill-418:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:85a0b302:::obj-fill-438:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:85fa942e:::obj-fill-272:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:863eb6f8:::obj-fill-320:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:868d4588:::obj-fill-19:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8759d023:::obj-fill-466:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:88072111:::obj-fill-312:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:886edcef:::obj-fill-380:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:88ce753e:::obj-fill-43:head# 2024-05-08T18:00:47.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:890e1d83:::obj-fill-590:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:891566a3:::obj-fill-341:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:891ca235:::obj-fill-177:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:897fa9d0:::obj-fill-283:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:89cd304b:::obj-fill-592:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:89d04c4a:::obj-fill-388:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:89db45d9:::obj-fill-247:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8ad879c5:::obj-fill-492:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8af4b5de:::obj-fill-37:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8b132e86:::obj-fill-35:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8b80a60a:::obj-fill-100:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8bb64fa6:::obj-fill-599:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8bed03f5:::obj-fill-5:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8c60e135:::obj-fill-470:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8c774623:::obj-fill-38:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8cc528ae:::obj-fill-519:head# 2024-05-08T18:00:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8cf73826:::obj-fill-460:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8d3564b3:::obj-fill-452:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8dfe1ca2:::obj-fill-469:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8e527672:::obj-fill-246:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8e96103f:::obj-fill-444:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8ed6417f:::obj-fill-146:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8eda2ffc:::obj-fill-539:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8f08dd48:::obj-fill-26:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8f111b25:::obj-fill-18:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:8fde63f8:::obj-fill-338:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9030746d:::obj-fill-468:head# 2024-05-08T18:00:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9115d8a1:::obj-fill-260:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:91649909:::obj-fill-140:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:91c1081d:::obj-fill-404:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:91f42503:::obj-fill-216:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:927b34a0:::obj-fill-63:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:92a00a91:::obj-fill-467:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:930a7268:::obj-fill-450:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:93c3d0bf:::obj-fill-118:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:93ca7c9e:::obj-fill-132:head# 2024-05-08T18:00:47.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:942435d5:::obj-fill-378:head# 2024-05-08T18:00:47.112 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9445f8c5:::obj-fill-245:head# 2024-05-08T18:00:47.112 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9457c8d9:::obj-fill-535:head# 2024-05-08T18:00:47.112 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:950dc56e:::obj-fill-348:head# 2024-05-08T18:00:47.112 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9559ee1d:::obj-fill-545:head# 2024-05-08T18:00:47.113 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:957c5cc4:::obj-fill-212:head# 2024-05-08T18:00:47.114 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:95bdac02:::obj-fill-588:head# 2024-05-08T18:00:47.114 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:95f202af:::obj-fill-126:head# 2024-05-08T18:00:47.115 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:96789003:::obj-fill-83:head# 2024-05-08T18:00:47.116 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:96d494a8:::obj-fill-316:head# 2024-05-08T18:00:47.116 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:97adb85b:::obj-fill-233:head# 2024-05-08T18:00:47.117 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:980d998c:::obj-fill-197:head# 2024-05-08T18:00:47.117 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:98235c44:::obj-fill-396:head# 2024-05-08T18:00:47.118 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:987d3b87:::obj-fill-327:head# 2024-05-08T18:00:47.118 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:990a5e24:::obj-fill-515:head# 2024-05-08T18:00:47.119 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:995fec05:::obj-fill-191:head# 2024-05-08T18:00:47.120 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9a769b75:::obj-fill-587:head# 2024-05-08T18:00:47.121 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9b141990:::obj-fill-394:head# 2024-05-08T18:00:47.121 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9bb108fb:::obj-fill-579:head# 2024-05-08T18:00:47.122 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9ce19d92:::obj-fill-361:head# 2024-05-08T18:00:47.122 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9d8c3f95:::obj-fill-572:head# 2024-05-08T18:00:47.123 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9e283e00:::obj-fill-254:head# 2024-05-08T18:00:47.123 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9e3a1a61:::obj-fill-58:head# 2024-05-08T18:00:47.124 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9e8f6029:::obj-fill-41:head# 2024-05-08T18:00:47.124 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9ef117aa:::obj-fill-520:head# 2024-05-08T18:00:47.125 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9f3bdfc2:::obj-fill-184:head# 2024-05-08T18:00:47.126 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9fd89320:::obj-fill-364:head# 2024-05-08T18:00:47.127 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:9feb7062:::obj-fill-419:head# 2024-05-08T18:00:47.127 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a07504c4:::obj-fill-516:head# 2024-05-08T18:00:47.127 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a1897e34:::obj-fill-153:head# 2024-05-08T18:00:47.128 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a19a9d76:::obj-fill-30:head# 2024-05-08T18:00:47.128 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a1a49c98:::obj-fill-98:head# 2024-05-08T18:00:47.129 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a1ea911a:::obj-fill-36:head# 2024-05-08T18:00:47.129 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a24bad98:::obj-fill-335:head# 2024-05-08T18:00:47.129 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a263b16f:::obj-fill-326:head# 2024-05-08T18:00:47.130 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a27d661e:::obj-fill-152:head# 2024-05-08T18:00:47.130 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a282a129:::obj-fill-451:head# 2024-05-08T18:00:47.135 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a28f05ba:::obj-fill-241:head# 2024-05-08T18:00:47.135 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a2cdc5cc:::obj-fill-180:head# 2024-05-08T18:00:47.135 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a30777ea:::obj-fill-486:head# 2024-05-08T18:00:47.135 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a3a65661:::obj-fill-151:head# 2024-05-08T18:00:47.135 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a3cb2967:::obj-fill-195:head# 2024-05-08T18:00:47.135 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a3ffc098:::obj-fill-293:head# 2024-05-08T18:00:47.136 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a4a31ccc:::obj-fill-413:head# 2024-05-08T18:00:47.137 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a51c3677:::obj-fill-384:head# 2024-05-08T18:00:47.137 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a5e941a7:::obj-fill-141:head# 2024-05-08T18:00:47.137 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a6cdd8b2:::obj-fill-342:head# 2024-05-08T18:00:47.137 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a6e20b86:::obj-fill-593:head# 2024-05-08T18:00:47.138 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a7a9ccf9:::obj-fill-129:head# 2024-05-08T18:00:47.138 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a7b702d3:::obj-fill-49:head# 2024-05-08T18:00:47.139 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a8daf8bd:::obj-fill-391:head# 2024-05-08T18:00:47.139 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:a99c3cef:::obj-fill-171:head# 2024-05-08T18:00:47.140 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:aabb5718:::obj-fill-521:head# 2024-05-08T18:00:47.141 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ab0cb851:::obj-fill-183:head# 2024-05-08T18:00:47.141 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ab7a05e4:::obj-fill-203:head# 2024-05-08T18:00:47.142 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ab7dda83:::obj-fill-113:head# 2024-05-08T18:00:47.146 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:abb3502c:::obj-fill-461:head# 2024-05-08T18:00:47.146 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ac1c41be:::obj-fill-162:head# 2024-05-08T18:00:47.146 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ac2114ba:::obj-fill-239:head# 2024-05-08T18:00:47.146 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ad355fca:::obj-fill-271:head# 2024-05-08T18:00:47.146 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ad4634a0:::obj-fill-487:head# 2024-05-08T18:00:47.146 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:add2bb13:::obj-fill-31:head# 2024-05-08T18:00:47.146 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:aeb6258d:::obj-fill-124:head# 2024-05-08T18:00:47.147 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:af17f7d7:::obj-fill-464:head# 2024-05-08T18:00:47.147 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:af1e1cf0:::obj-fill-237:head# 2024-05-08T18:00:47.148 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:afc439ce:::obj-fill-248:head# 2024-05-08T18:00:47.148 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:afceab4d:::obj-fill-527:head# 2024-05-08T18:00:47.149 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b03af40c:::obj-fill-143:head# 2024-05-08T18:00:47.149 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b04cf0db:::obj-fill-507:head# 2024-05-08T18:00:47.151 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b07896f0:::obj-fill-269:head# 2024-05-08T18:00:47.151 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b0b954d5:::obj-fill-524:head# 2024-05-08T18:00:47.152 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b1cbfcb7:::obj-fill-134:head# 2024-05-08T18:00:47.152 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b2978fd3:::obj-fill-27:head# 2024-05-08T18:00:47.152 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b394798f:::obj-fill-156:head# 2024-05-08T18:00:47.153 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b3c6f36d:::obj-fill-401:head# 2024-05-08T18:00:47.153 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b3f8e5ac:::obj-fill-290:head# 2024-05-08T18:00:47.159 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b41ed5f8:::obj-fill-76:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b4878e76:::obj-fill-253:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b4e19741:::obj-fill-503:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b53a3690:::obj-fill-264:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b545ab4f:::obj-fill-24:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b55af5e6:::obj-fill-491:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b57edf82:::obj-fill-526:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b589d2be:::obj-fill-323:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b6207f32:::obj-fill-344:head# 2024-05-08T18:00:47.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b757ee2e:::obj-fill-433:head# 2024-05-08T18:00:47.161 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b75cc479:::obj-fill-34:head# 2024-05-08T18:00:47.161 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b7b03117:::obj-fill-42:head# 2024-05-08T18:00:47.161 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b7e6205d:::obj-fill-501:head# 2024-05-08T18:00:47.162 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b8d18b7a:::obj-fill-353:head# 2024-05-08T18:00:47.162 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b9189c29:::obj-fill-328:head# 2024-05-08T18:00:47.162 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b98e07aa:::obj-fill-54:head# 2024-05-08T18:00:47.162 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:b9cd1e9a:::obj-fill-371:head# 2024-05-08T18:00:47.163 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:bc3322bb:::obj-fill-340:head# 2024-05-08T18:00:47.163 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:bcf43161:::obj-fill-294:head# 2024-05-08T18:00:47.164 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:bd07fc4f:::obj-fill-549:head# 2024-05-08T18:00:47.165 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:bdf48e47:::obj-fill-430:head# 2024-05-08T18:00:47.166 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:be01c111:::obj-fill-1:head# 2024-05-08T18:00:47.167 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:be3a4bc7:::obj-fill-102:head# 2024-05-08T18:00:47.167 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:be8e1fcd:::obj-fill-321:head# 2024-05-08T18:00:47.167 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:bf5fcbac:::obj-fill-287:head# 2024-05-08T18:00:47.168 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:bf806d14:::obj-fill-115:head# 2024-05-08T18:00:47.168 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:bfb28823:::obj-fill-72:head# 2024-05-08T18:00:47.169 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:bfef805e:::obj-fill-119:head# 2024-05-08T18:00:47.169 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c02f8e10:::obj-fill-497:head# 2024-05-08T18:00:47.170 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c050cd6e:::obj-fill-8:head# 2024-05-08T18:00:47.170 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c218e297:::obj-fill-173:head# 2024-05-08T18:00:47.171 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c2bc66fe:::obj-fill-252:head# 2024-05-08T18:00:47.171 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c3b55903:::obj-fill-428:head# 2024-05-08T18:00:47.172 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c51907b0:::obj-fill-457:head# 2024-05-08T18:00:47.172 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c561dc83:::obj-fill-75:head# 2024-05-08T18:00:47.173 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c5d1e1a9:::obj-fill-268:head# 2024-05-08T18:00:47.173 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c60ab0d0:::obj-fill-303:head# 2024-05-08T18:00:47.191 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c644ce52:::obj-fill-514:head# 2024-05-08T18:00:47.191 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c6ab3a11:::obj-fill-407:head# 2024-05-08T18:00:47.191 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c74377bf:::obj-fill-432:head# 2024-05-08T18:00:47.191 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c767fff6:::obj-fill-531:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c7a9adad:::obj-fill-475:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c7e3a9c2:::obj-fill-465:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c850aed7:::obj-fill-424:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c8a0088a:::obj-fill-329:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:c9d419f9:::obj-fill-176:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:caf25ec2:::obj-fill-274:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cb625830:::obj-fill-70:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cbb65125:::obj-fill-529:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cbe2544c:::obj-fill-3:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cbfce4ee:::obj-fill-455:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cc62419c:::obj-fill-498:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cce831fa:::obj-fill-160:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cda71af4:::obj-fill-122:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cea7a728:::obj-fill-265:head# 2024-05-08T18:00:47.192 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cee19f0a:::obj-fill-142:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cf22117e:::obj-fill-499:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cfbfa66d:::obj-fill-66:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cfc2552c:::obj-fill-211:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:cfc563e8:::obj-fill-392:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d02d8880:::obj-fill-362:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d054947e:::obj-fill-67:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d061c977:::obj-fill-164:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d06a5f57:::obj-fill-296:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d110062a:::obj-fill-343:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d1b8ad47:::obj-fill-383:head# 2024-05-08T18:00:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d1e80db6:::obj-fill-117:head# 2024-05-08T18:00:47.194 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d210027e:::obj-fill-231:head# 2024-05-08T18:00:47.194 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d24428ed:::obj-fill-199:head# 2024-05-08T18:00:47.194 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d27c3c4b:::obj-fill-154:head# 2024-05-08T18:00:47.194 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d28957e3:::obj-fill-263:head# 2024-05-08T18:00:47.195 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d2d44da7:::obj-fill-544:head# 2024-05-08T18:00:47.195 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d31004a4:::obj-fill-434:head# 2024-05-08T18:00:47.197 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d32487c3:::obj-fill-385:head# 2024-05-08T18:00:47.197 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d340891c:::obj-fill-12:head# 2024-05-08T18:00:47.197 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d4135728:::obj-fill-310:head# 2024-05-08T18:00:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d5a43972:::obj-fill-9:head# 2024-05-08T18:00:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d5efeb15:::obj-fill-347:head# 2024-05-08T18:00:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d6463f70:::obj-fill-536:head# 2024-05-08T18:00:47.199 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d666d9b7:::obj-fill-420:head# 2024-05-08T18:00:47.200 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d6e86688:::obj-fill-166:head# 2024-05-08T18:00:47.201 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d730370d:::obj-fill-206:head# 2024-05-08T18:00:47.201 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d783551c:::obj-fill-109:head# 2024-05-08T18:00:47.202 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d7f77e5f:::obj-fill-551:head# 2024-05-08T18:00:47.202 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d843056c:::obj-fill-291:head# 2024-05-08T18:00:47.203 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d84eb173:::obj-fill-221:head# 2024-05-08T18:00:47.204 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d8dd069c:::obj-fill-60:head# 2024-05-08T18:00:47.204 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d8f2f750:::obj-fill-562:head# 2024-05-08T18:00:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d8f80ac2:::obj-fill-179:head# 2024-05-08T18:00:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:d9f904cf:::obj-fill-308:head# 2024-05-08T18:00:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:db0a534b:::obj-fill-410:head# 2024-05-08T18:00:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:dc4403f4:::obj-fill-416:head# 2024-05-08T18:00:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:dc66c3ca:::obj-fill-220:head# 2024-05-08T18:00:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:dc8198dc:::obj-fill-596:head# 2024-05-08T18:00:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:dcbade2b:::obj-fill-10:head# 2024-05-08T18:00:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ddb787ea:::obj-fill-556:head# 2024-05-08T18:00:47.210 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:de58065b:::obj-fill-306:head# 2024-05-08T18:00:47.211 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:deaa6fab:::obj-fill-194:head# 2024-05-08T18:00:47.211 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:dfee7714:::obj-fill-202:head# 2024-05-08T18:00:47.212 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:dff5df4a:::obj-fill-565:head# 2024-05-08T18:00:47.213 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e2053442:::obj-fill-107:head# 2024-05-08T18:00:47.213 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e32055b8:::obj-fill-57:head# 2024-05-08T18:00:47.214 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e37fac1e:::obj-fill-161:head# 2024-05-08T18:00:47.214 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e388f5aa:::obj-fill-273:head# 2024-05-08T18:00:47.215 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e38b1f4d:::obj-fill-393:head# 2024-05-08T18:00:47.216 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e4792474:::obj-fill-158:head# 2024-05-08T18:00:47.216 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e4899cb0:::obj-fill-270:head# 2024-05-08T18:00:47.217 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e62ae9f1:::obj-fill-288:head# 2024-05-08T18:00:47.217 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e64fd95a:::obj-fill-449:head# 2024-05-08T18:00:47.218 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e6682cfc:::obj-fill-373:head# 2024-05-08T18:00:47.219 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e716717b:::obj-fill-178:head# 2024-05-08T18:00:47.220 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e80226af:::obj-fill-354:head# 2024-05-08T18:00:47.222 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e83a5940:::obj-fill-564:head# 2024-05-08T18:00:47.222 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e854bfbe:::obj-fill-589:head# 2024-05-08T18:00:47.222 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e8b197bc:::obj-fill-89:head# 2024-05-08T18:00:47.222 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e92fca88:::obj-fill-397:head# 2024-05-08T18:00:47.223 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e94d8f7b:::obj-fill-261:head# 2024-05-08T18:00:47.224 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:e98cc0a4:::obj-fill-525:head# 2024-05-08T18:00:47.225 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ea5a9459:::obj-fill-431:head# 2024-05-08T18:00:47.226 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ebc54d47:::obj-fill-258:head# 2024-05-08T18:00:47.227 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ec0002dd:::obj-fill-205:head# 2024-05-08T18:00:47.228 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ec740b5c:::obj-fill-46:head# 2024-05-08T18:00:47.228 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ed35dda4:::obj-fill-170:head# 2024-05-08T18:00:47.228 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ed51b8f7:::obj-fill-91:head# 2024-05-08T18:00:47.229 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:edd96161:::obj-fill-48:head# 2024-05-08T18:00:47.229 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ee3f0d4b:::obj-fill-47:head# 2024-05-08T18:00:47.230 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ee4784dd:::obj-fill-480:head# 2024-05-08T18:00:47.231 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ee5a8271:::obj-fill-198:head# 2024-05-08T18:00:47.232 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ef745b66:::obj-fill-145:head# 2024-05-08T18:00:47.232 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:efa5309d:::obj-fill-215:head# 2024-05-08T18:00:47.233 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:efbdd3a1:::obj-fill-276:head# 2024-05-08T18:00:47.234 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f059d4c0:::obj-fill-482:head# 2024-05-08T18:00:47.234 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f0f9fb7a:::obj-fill-379:head# 2024-05-08T18:00:47.235 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f16a3656:::obj-fill-462:head# 2024-05-08T18:00:47.236 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f1b395ae:::obj-fill-25:head# 2024-05-08T18:00:47.236 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f5876dad:::obj-fill-359:head# 2024-05-08T18:00:47.237 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f5a283cd:::obj-fill-534:head# 2024-05-08T18:00:47.238 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f5cd905a:::obj-fill-358:head# 2024-05-08T18:00:47.239 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f5e48302:::obj-fill-406:head# 2024-05-08T18:00:47.239 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f5ea65fc:::obj-fill-52:head# 2024-05-08T18:00:47.240 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f642de6b:::obj-fill-204:head# 2024-05-08T18:00:47.241 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f716eafd:::obj-fill-502:head# 2024-05-08T18:00:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f752e9cb:::obj-fill-23:head# 2024-05-08T18:00:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f85fe42c:::obj-fill-346:head# 2024-05-08T18:00:47.243 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:f882fd3b:::obj-fill-355:head# 2024-05-08T18:00:47.243 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fa133332:::obj-fill-309:head# 2024-05-08T18:00:47.244 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fa875e52:::obj-fill-64:head# 2024-05-08T18:00:47.245 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fad91a22:::obj-fill-481:head# 2024-05-08T18:00:47.246 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fbbc3122:::obj-fill-111:head# 2024-05-08T18:00:47.246 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fc539ddb:::obj-fill-181:head# 2024-05-08T18:00:47.247 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fc54128d:::obj-fill-104:head# 2024-05-08T18:00:47.248 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fe00aded:::obj-fill-365:head# 2024-05-08T18:00:47.249 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fe1e9971:::obj-fill-189:head# 2024-05-08T18:00:47.249 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ff0e0563:::obj-fill-508:head# 2024-05-08T18:00:47.250 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ff4e156c:::obj-fill-441:head# 2024-05-08T18:00:47.251 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:ffa355f7:::obj-fill-500:head# 2024-05-08T18:00:47.252 INFO:tasks.workunit.client.0.smithi117.stderr:Read #1:fff6c93b:::obj-fill-277:head# 2024-05-08T18:00:47.253 INFO:tasks.workunit.client.0.smithi117.stderr:Export successful 2024-05-08T18:00:47.254 INFO:tasks.workunit.client.0.smithi117.stdout: marking collection for removal 2024-05-08T18:00:47.255 INFO:tasks.workunit.client.0.smithi117.stdout:setting '_remove' omap key 2024-05-08T18:00:47.255 INFO:tasks.workunit.client.0.smithi117.stdout:finish_remove_pgs 1.0_head removing 1.0 2024-05-08T18:00:48.381 INFO:tasks.workunit.client.0.smithi117.stderr:Remove successful 2024-05-08T18:00:48.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:478: TEST_backfill_multi_partial: activate_osd td/osd-backfill-space 1 2024-05-08T18:00:48.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/osd-backfill-space 2024-05-08T18:00:48.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2024-05-08T18:00:48.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2024-05-08T18:00:48.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2024-05-08T18:00:48.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T18:00:48.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:00:48.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:00:48.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:00:48.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:00:48.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T18:00:48.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T18:00:48.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2024-05-08T18:00:48.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2024-05-08T18:00:48.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:00:48.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2024-05-08T18:00:48.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:00:48.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:00:48.798 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:00:48.798 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:00:48.798 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:00:48.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:00:48.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:00:48.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:00:48.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:00:48.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:00:48.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:00:48.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:00:48.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:00:48.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:00:48.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2024-05-08T18:00:48.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2024-05-08T18:00:48.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T18:00:48.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2024-05-08T18:00:48.801 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T18:00:48.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:00:48.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/osd-backfill-space/1/whoami 2024-05-08T18:00:48.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2024-05-08T18:00:48.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2024-05-08T18:00:48.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2024-05-08T18:00:48.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2024-05-08T18:00:48.832 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:00:48.831+0000 7f24fc8467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:00:48.835 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:00:48.835+0000 7f24fc8467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:00:48.836 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:00:48.835+0000 7f24fc8467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:00:49.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2024-05-08T18:00:49.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:00:49.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T18:00:49.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:00:49.243 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:00:49.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:00:49.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:00:49.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:00:49.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:00:49.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:00:49.415 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:00:49.411+0000 7f24fc8467c0 -1 Falling back to public interface 2024-05-08T18:00:49.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:00:50.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:00:50.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:00:50.687 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:00:50.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:00:50.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:00:50.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:00:51.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:00:52.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:00:52.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:00:52.119 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:00:52.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:00:52.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:00:52.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:00:52.194 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:00:52.191+0000 7f24fc8467c0 -1 osd.1 36 log_to_monitors true 2024-05-08T18:00:52.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:00:53.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:00:53.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:00:53.576 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:00:53.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:00:53.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:00:53.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:00:53.988 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up out weight 0 up_from 42 up_thru 33 down_at 37 last_clean_interval [10,36) [v2:127.0.0.1:6810/1575393990,v1:127.0.0.1:6811/1575393990] [v2:127.0.0.1:6812/1575393990,v1:127.0.0.1:6813/1575393990] exists,up 83e506b4-d223-4635-bdd2-899e68cc9fac 2024-05-08T18:00:53.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:00:53.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:00:53.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:00:53.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:480: TEST_backfill_multi_partial: ceph pg dump pgs 2024-05-08T18:00:54.392 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:00:54.392 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:00:45.932885+0000 0'0 40:22 [2,0] 2 [2,0] 2 0'0 2024-05-08T17:59:29.398606+0000 0'0 2024-05-08T17:59:29.398606+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:06:15.848720+0000 0 0 2024-05-08T18:00:54.392 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:00:45.933299+0000 0'0 40:45 [2,0] 2 [2,0] 2 0'0 2024-05-08T17:59:26.608578+0000 0'0 2024-05-08T17:59:26.608578+0000 0 0 periodic scrub scheduled @ 2024-05-10T00:31:43.635480+0000 0 0 2024-05-08T18:00:54.392 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 600 0 0 0 0 1566600 0 0 100 500 100 stale+active+clean 2024-05-08T17:59:26.468644+0000 36'600 36:641 [1] 1 [1] 1 0'0 2024-05-08T17:59:23.872011+0000 0'0 2024-05-08T17:59:23.872011+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:36:40.373032+0000 0 0 2024-05-08T18:00:54.392 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:00:54.392 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:00:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:00:54.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:482: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=1 2024-05-08T18:00:54.408 INFO:tasks.workunit.client.0.smithi117.stderr:1+0 records in 2024-05-08T18:00:54.408 INFO:tasks.workunit.client.0.smithi117.stderr:1+0 records out 2024-05-08T18:00:54.408 INFO:tasks.workunit.client.0.smithi117.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000151277 s, 6.8 MB/s 2024-05-08T18:00:54.408 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: seq 1 600 2024-05-08T18:00:54.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:54.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-1 td/osd-backfill-space/datafile 2024-05-08T18:00:54.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:54.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-2 td/osd-backfill-space/datafile 2024-05-08T18:00:54.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:54.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-3 td/osd-backfill-space/datafile 2024-05-08T18:00:54.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:54.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-4 td/osd-backfill-space/datafile 2024-05-08T18:00:55.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:55.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-5 td/osd-backfill-space/datafile 2024-05-08T18:00:55.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:55.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-6 td/osd-backfill-space/datafile 2024-05-08T18:00:55.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:55.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-7 td/osd-backfill-space/datafile 2024-05-08T18:00:55.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:55.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-8 td/osd-backfill-space/datafile 2024-05-08T18:00:55.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:55.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-9 td/osd-backfill-space/datafile 2024-05-08T18:00:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-10 td/osd-backfill-space/datafile 2024-05-08T18:00:56.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:56.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-11 td/osd-backfill-space/datafile 2024-05-08T18:00:56.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:56.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-12 td/osd-backfill-space/datafile 2024-05-08T18:00:56.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:56.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-13 td/osd-backfill-space/datafile 2024-05-08T18:00:56.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:56.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-14 td/osd-backfill-space/datafile 2024-05-08T18:00:56.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:56.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-15 td/osd-backfill-space/datafile 2024-05-08T18:00:57.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:57.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-16 td/osd-backfill-space/datafile 2024-05-08T18:00:57.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:57.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-17 td/osd-backfill-space/datafile 2024-05-08T18:00:57.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:57.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-18 td/osd-backfill-space/datafile 2024-05-08T18:00:57.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:57.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-19 td/osd-backfill-space/datafile 2024-05-08T18:00:57.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:57.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-20 td/osd-backfill-space/datafile 2024-05-08T18:00:57.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:57.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-21 td/osd-backfill-space/datafile 2024-05-08T18:00:58.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:58.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-22 td/osd-backfill-space/datafile 2024-05-08T18:00:58.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:58.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-23 td/osd-backfill-space/datafile 2024-05-08T18:00:58.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:58.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-24 td/osd-backfill-space/datafile 2024-05-08T18:00:58.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:58.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-25 td/osd-backfill-space/datafile 2024-05-08T18:00:58.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:58.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-26 td/osd-backfill-space/datafile 2024-05-08T18:00:58.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:58.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-27 td/osd-backfill-space/datafile 2024-05-08T18:00:59.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:59.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-28 td/osd-backfill-space/datafile 2024-05-08T18:00:59.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:59.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-29 td/osd-backfill-space/datafile 2024-05-08T18:00:59.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:59.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-30 td/osd-backfill-space/datafile 2024-05-08T18:00:59.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:59.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-31 td/osd-backfill-space/datafile 2024-05-08T18:00:59.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:59.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-32 td/osd-backfill-space/datafile 2024-05-08T18:00:59.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:00:59.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-33 td/osd-backfill-space/datafile 2024-05-08T18:01:00.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:00.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-34 td/osd-backfill-space/datafile 2024-05-08T18:01:00.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:00.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-35 td/osd-backfill-space/datafile 2024-05-08T18:01:00.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:00.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-36 td/osd-backfill-space/datafile 2024-05-08T18:01:00.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:00.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-37 td/osd-backfill-space/datafile 2024-05-08T18:01:00.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:00.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-38 td/osd-backfill-space/datafile 2024-05-08T18:01:00.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:00.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-39 td/osd-backfill-space/datafile 2024-05-08T18:01:01.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:01.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-40 td/osd-backfill-space/datafile 2024-05-08T18:01:01.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:01.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-41 td/osd-backfill-space/datafile 2024-05-08T18:01:01.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:01.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-42 td/osd-backfill-space/datafile 2024-05-08T18:01:01.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:01.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-43 td/osd-backfill-space/datafile 2024-05-08T18:01:01.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:01.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-44 td/osd-backfill-space/datafile 2024-05-08T18:01:01.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:01.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-45 td/osd-backfill-space/datafile 2024-05-08T18:01:02.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:02.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-46 td/osd-backfill-space/datafile 2024-05-08T18:01:02.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:02.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-47 td/osd-backfill-space/datafile 2024-05-08T18:01:02.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:02.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-48 td/osd-backfill-space/datafile 2024-05-08T18:01:02.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:02.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-49 td/osd-backfill-space/datafile 2024-05-08T18:01:02.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:02.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-50 td/osd-backfill-space/datafile 2024-05-08T18:01:02.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:02.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-51 td/osd-backfill-space/datafile 2024-05-08T18:01:03.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:03.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-52 td/osd-backfill-space/datafile 2024-05-08T18:01:03.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:03.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-53 td/osd-backfill-space/datafile 2024-05-08T18:01:03.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:03.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-54 td/osd-backfill-space/datafile 2024-05-08T18:01:03.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:03.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-55 td/osd-backfill-space/datafile 2024-05-08T18:01:03.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:03.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-56 td/osd-backfill-space/datafile 2024-05-08T18:01:03.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:03.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-57 td/osd-backfill-space/datafile 2024-05-08T18:01:04.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:04.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-58 td/osd-backfill-space/datafile 2024-05-08T18:01:04.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:04.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-59 td/osd-backfill-space/datafile 2024-05-08T18:01:04.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:04.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-60 td/osd-backfill-space/datafile 2024-05-08T18:01:04.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:04.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-61 td/osd-backfill-space/datafile 2024-05-08T18:01:04.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:04.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-62 td/osd-backfill-space/datafile 2024-05-08T18:01:04.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:04.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile 2024-05-08T18:01:05.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:05.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-64 td/osd-backfill-space/datafile 2024-05-08T18:01:05.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:05.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-65 td/osd-backfill-space/datafile 2024-05-08T18:01:05.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:05.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-66 td/osd-backfill-space/datafile 2024-05-08T18:01:05.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:05.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-67 td/osd-backfill-space/datafile 2024-05-08T18:01:05.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:05.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-68 td/osd-backfill-space/datafile 2024-05-08T18:01:06.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:06.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-69 td/osd-backfill-space/datafile 2024-05-08T18:01:06.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:06.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-70 td/osd-backfill-space/datafile 2024-05-08T18:01:06.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:06.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-71 td/osd-backfill-space/datafile 2024-05-08T18:01:06.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:06.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-72 td/osd-backfill-space/datafile 2024-05-08T18:01:06.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:06.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-73 td/osd-backfill-space/datafile 2024-05-08T18:01:07.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:07.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-74 td/osd-backfill-space/datafile 2024-05-08T18:01:07.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:07.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-75 td/osd-backfill-space/datafile 2024-05-08T18:01:07.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:07.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-76 td/osd-backfill-space/datafile 2024-05-08T18:01:07.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:07.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-77 td/osd-backfill-space/datafile 2024-05-08T18:01:07.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:07.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-78 td/osd-backfill-space/datafile 2024-05-08T18:01:07.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:07.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-79 td/osd-backfill-space/datafile 2024-05-08T18:01:08.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:08.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile 2024-05-08T18:01:08.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:08.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-81 td/osd-backfill-space/datafile 2024-05-08T18:01:08.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:08.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-82 td/osd-backfill-space/datafile 2024-05-08T18:01:08.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:08.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-83 td/osd-backfill-space/datafile 2024-05-08T18:01:08.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:08.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-84 td/osd-backfill-space/datafile 2024-05-08T18:01:08.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:08.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-85 td/osd-backfill-space/datafile 2024-05-08T18:01:09.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:09.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-86 td/osd-backfill-space/datafile 2024-05-08T18:01:09.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:09.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-87 td/osd-backfill-space/datafile 2024-05-08T18:01:09.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:09.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-88 td/osd-backfill-space/datafile 2024-05-08T18:01:09.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:09.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-89 td/osd-backfill-space/datafile 2024-05-08T18:01:09.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:09.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-90 td/osd-backfill-space/datafile 2024-05-08T18:01:09.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:09.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-91 td/osd-backfill-space/datafile 2024-05-08T18:01:10.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:10.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-92 td/osd-backfill-space/datafile 2024-05-08T18:01:10.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:10.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-93 td/osd-backfill-space/datafile 2024-05-08T18:01:10.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:10.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-94 td/osd-backfill-space/datafile 2024-05-08T18:01:10.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:10.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-95 td/osd-backfill-space/datafile 2024-05-08T18:01:10.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:10.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-96 td/osd-backfill-space/datafile 2024-05-08T18:01:10.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:10.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2024-05-08T18:01:11.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:11.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-98 td/osd-backfill-space/datafile 2024-05-08T18:01:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:11.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-99 td/osd-backfill-space/datafile 2024-05-08T18:01:11.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:11.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-100 td/osd-backfill-space/datafile 2024-05-08T18:01:11.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:11.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-101 td/osd-backfill-space/datafile 2024-05-08T18:01:11.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:11.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-102 td/osd-backfill-space/datafile 2024-05-08T18:01:11.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:11.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-103 td/osd-backfill-space/datafile 2024-05-08T18:01:12.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:12.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-104 td/osd-backfill-space/datafile 2024-05-08T18:01:12.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:12.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-105 td/osd-backfill-space/datafile 2024-05-08T18:01:12.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:12.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-106 td/osd-backfill-space/datafile 2024-05-08T18:01:12.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:12.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-107 td/osd-backfill-space/datafile 2024-05-08T18:01:12.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:12.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-108 td/osd-backfill-space/datafile 2024-05-08T18:01:13.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:13.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-109 td/osd-backfill-space/datafile 2024-05-08T18:01:13.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:13.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-110 td/osd-backfill-space/datafile 2024-05-08T18:01:13.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:13.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-111 td/osd-backfill-space/datafile 2024-05-08T18:01:13.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:13.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-112 td/osd-backfill-space/datafile 2024-05-08T18:01:13.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:13.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-113 td/osd-backfill-space/datafile 2024-05-08T18:01:13.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:13.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-114 td/osd-backfill-space/datafile 2024-05-08T18:01:14.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:14.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-115 td/osd-backfill-space/datafile 2024-05-08T18:01:14.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:14.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-116 td/osd-backfill-space/datafile 2024-05-08T18:01:14.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:14.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-117 td/osd-backfill-space/datafile 2024-05-08T18:01:14.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:14.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-118 td/osd-backfill-space/datafile 2024-05-08T18:01:14.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:14.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-119 td/osd-backfill-space/datafile 2024-05-08T18:01:14.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:14.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-120 td/osd-backfill-space/datafile 2024-05-08T18:01:15.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:15.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-121 td/osd-backfill-space/datafile 2024-05-08T18:01:15.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:15.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-122 td/osd-backfill-space/datafile 2024-05-08T18:01:15.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:15.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-123 td/osd-backfill-space/datafile 2024-05-08T18:01:15.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:15.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-124 td/osd-backfill-space/datafile 2024-05-08T18:01:15.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:15.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-125 td/osd-backfill-space/datafile 2024-05-08T18:01:15.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:15.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-126 td/osd-backfill-space/datafile 2024-05-08T18:01:16.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:16.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-127 td/osd-backfill-space/datafile 2024-05-08T18:01:16.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:16.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-128 td/osd-backfill-space/datafile 2024-05-08T18:01:16.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:16.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-129 td/osd-backfill-space/datafile 2024-05-08T18:01:16.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:16.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-130 td/osd-backfill-space/datafile 2024-05-08T18:01:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-131 td/osd-backfill-space/datafile 2024-05-08T18:01:16.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:16.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-132 td/osd-backfill-space/datafile 2024-05-08T18:01:17.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:17.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-133 td/osd-backfill-space/datafile 2024-05-08T18:01:17.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:17.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-134 td/osd-backfill-space/datafile 2024-05-08T18:01:17.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:17.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-135 td/osd-backfill-space/datafile 2024-05-08T18:01:17.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:17.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-136 td/osd-backfill-space/datafile 2024-05-08T18:01:17.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:17.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-137 td/osd-backfill-space/datafile 2024-05-08T18:01:17.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:17.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-138 td/osd-backfill-space/datafile 2024-05-08T18:01:18.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:18.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-139 td/osd-backfill-space/datafile 2024-05-08T18:01:18.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:18.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-140 td/osd-backfill-space/datafile 2024-05-08T18:01:18.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:18.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-141 td/osd-backfill-space/datafile 2024-05-08T18:01:18.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:18.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-142 td/osd-backfill-space/datafile 2024-05-08T18:01:18.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:18.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-143 td/osd-backfill-space/datafile 2024-05-08T18:01:19.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:19.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-144 td/osd-backfill-space/datafile 2024-05-08T18:01:19.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:19.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-145 td/osd-backfill-space/datafile 2024-05-08T18:01:19.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:19.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-146 td/osd-backfill-space/datafile 2024-05-08T18:01:19.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:19.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-147 td/osd-backfill-space/datafile 2024-05-08T18:01:19.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:19.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-148 td/osd-backfill-space/datafile 2024-05-08T18:01:19.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:19.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-149 td/osd-backfill-space/datafile 2024-05-08T18:01:20.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:20.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-150 td/osd-backfill-space/datafile 2024-05-08T18:01:20.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:20.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-151 td/osd-backfill-space/datafile 2024-05-08T18:01:20.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:20.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-152 td/osd-backfill-space/datafile 2024-05-08T18:01:20.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:20.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-153 td/osd-backfill-space/datafile 2024-05-08T18:01:20.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:20.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-154 td/osd-backfill-space/datafile 2024-05-08T18:01:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-155 td/osd-backfill-space/datafile 2024-05-08T18:01:21.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:21.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-156 td/osd-backfill-space/datafile 2024-05-08T18:01:21.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:21.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-157 td/osd-backfill-space/datafile 2024-05-08T18:01:21.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:21.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-158 td/osd-backfill-space/datafile 2024-05-08T18:01:21.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:21.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-159 td/osd-backfill-space/datafile 2024-05-08T18:01:21.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:21.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-160 td/osd-backfill-space/datafile 2024-05-08T18:01:21.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:21.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-161 td/osd-backfill-space/datafile 2024-05-08T18:01:22.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:22.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-162 td/osd-backfill-space/datafile 2024-05-08T18:01:22.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:22.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-163 td/osd-backfill-space/datafile 2024-05-08T18:01:22.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:22.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile 2024-05-08T18:01:22.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:22.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-165 td/osd-backfill-space/datafile 2024-05-08T18:01:22.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:22.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-166 td/osd-backfill-space/datafile 2024-05-08T18:01:22.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:22.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-167 td/osd-backfill-space/datafile 2024-05-08T18:01:23.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:23.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-168 td/osd-backfill-space/datafile 2024-05-08T18:01:23.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:23.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-169 td/osd-backfill-space/datafile 2024-05-08T18:01:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-170 td/osd-backfill-space/datafile 2024-05-08T18:01:23.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:23.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-171 td/osd-backfill-space/datafile 2024-05-08T18:01:23.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:23.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-172 td/osd-backfill-space/datafile 2024-05-08T18:01:23.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:23.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-173 td/osd-backfill-space/datafile 2024-05-08T18:01:24.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:24.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-174 td/osd-backfill-space/datafile 2024-05-08T18:01:24.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:24.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-175 td/osd-backfill-space/datafile 2024-05-08T18:01:24.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:24.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-176 td/osd-backfill-space/datafile 2024-05-08T18:01:24.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:24.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-177 td/osd-backfill-space/datafile 2024-05-08T18:01:24.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:24.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-178 td/osd-backfill-space/datafile 2024-05-08T18:01:24.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:24.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-179 td/osd-backfill-space/datafile 2024-05-08T18:01:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-180 td/osd-backfill-space/datafile 2024-05-08T18:01:25.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:25.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile 2024-05-08T18:01:25.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:25.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-182 td/osd-backfill-space/datafile 2024-05-08T18:01:25.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:25.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-183 td/osd-backfill-space/datafile 2024-05-08T18:01:25.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:25.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-184 td/osd-backfill-space/datafile 2024-05-08T18:01:25.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:25.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-185 td/osd-backfill-space/datafile 2024-05-08T18:01:26.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:26.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-186 td/osd-backfill-space/datafile 2024-05-08T18:01:26.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:26.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-187 td/osd-backfill-space/datafile 2024-05-08T18:01:26.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:26.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-188 td/osd-backfill-space/datafile 2024-05-08T18:01:26.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:26.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-189 td/osd-backfill-space/datafile 2024-05-08T18:01:26.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:26.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-190 td/osd-backfill-space/datafile 2024-05-08T18:01:26.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:26.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-191 td/osd-backfill-space/datafile 2024-05-08T18:01:27.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:27.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-192 td/osd-backfill-space/datafile 2024-05-08T18:01:27.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:27.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-193 td/osd-backfill-space/datafile 2024-05-08T18:01:27.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:27.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-194 td/osd-backfill-space/datafile 2024-05-08T18:01:27.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:27.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-195 td/osd-backfill-space/datafile 2024-05-08T18:01:27.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:27.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-196 td/osd-backfill-space/datafile 2024-05-08T18:01:27.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:27.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-197 td/osd-backfill-space/datafile 2024-05-08T18:01:28.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:28.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2024-05-08T18:01:28.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:28.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-199 td/osd-backfill-space/datafile 2024-05-08T18:01:28.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:28.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-200 td/osd-backfill-space/datafile 2024-05-08T18:01:28.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:28.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-201 td/osd-backfill-space/datafile 2024-05-08T18:01:28.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:28.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-202 td/osd-backfill-space/datafile 2024-05-08T18:01:29.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:29.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-203 td/osd-backfill-space/datafile 2024-05-08T18:01:29.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:29.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-204 td/osd-backfill-space/datafile 2024-05-08T18:01:29.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:29.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-205 td/osd-backfill-space/datafile 2024-05-08T18:01:29.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:29.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-206 td/osd-backfill-space/datafile 2024-05-08T18:01:29.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:29.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-207 td/osd-backfill-space/datafile 2024-05-08T18:01:29.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:29.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-208 td/osd-backfill-space/datafile 2024-05-08T18:01:30.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:30.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-209 td/osd-backfill-space/datafile 2024-05-08T18:01:30.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:30.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-210 td/osd-backfill-space/datafile 2024-05-08T18:01:30.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:30.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-211 td/osd-backfill-space/datafile 2024-05-08T18:01:30.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:30.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-212 td/osd-backfill-space/datafile 2024-05-08T18:01:30.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:30.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-213 td/osd-backfill-space/datafile 2024-05-08T18:01:30.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:30.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-214 td/osd-backfill-space/datafile 2024-05-08T18:01:31.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:31.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-215 td/osd-backfill-space/datafile 2024-05-08T18:01:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-216 td/osd-backfill-space/datafile 2024-05-08T18:01:31.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:31.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-217 td/osd-backfill-space/datafile 2024-05-08T18:01:31.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:31.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-218 td/osd-backfill-space/datafile 2024-05-08T18:01:31.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:31.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-219 td/osd-backfill-space/datafile 2024-05-08T18:01:31.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:31.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-220 td/osd-backfill-space/datafile 2024-05-08T18:01:32.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:32.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-221 td/osd-backfill-space/datafile 2024-05-08T18:01:32.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:32.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-222 td/osd-backfill-space/datafile 2024-05-08T18:01:32.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:32.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-223 td/osd-backfill-space/datafile 2024-05-08T18:01:32.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:32.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-224 td/osd-backfill-space/datafile 2024-05-08T18:01:32.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:32.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-225 td/osd-backfill-space/datafile 2024-05-08T18:01:32.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:32.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-226 td/osd-backfill-space/datafile 2024-05-08T18:01:33.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:33.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-227 td/osd-backfill-space/datafile 2024-05-08T18:01:33.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:33.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-228 td/osd-backfill-space/datafile 2024-05-08T18:01:33.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:33.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-229 td/osd-backfill-space/datafile 2024-05-08T18:01:33.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:33.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-230 td/osd-backfill-space/datafile 2024-05-08T18:01:33.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:33.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-231 td/osd-backfill-space/datafile 2024-05-08T18:01:34.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:34.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-232 td/osd-backfill-space/datafile 2024-05-08T18:01:34.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:34.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-233 td/osd-backfill-space/datafile 2024-05-08T18:01:34.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:34.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-234 td/osd-backfill-space/datafile 2024-05-08T18:01:34.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:34.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-235 td/osd-backfill-space/datafile 2024-05-08T18:01:34.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:34.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-236 td/osd-backfill-space/datafile 2024-05-08T18:01:34.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:34.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-237 td/osd-backfill-space/datafile 2024-05-08T18:01:35.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:35.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-238 td/osd-backfill-space/datafile 2024-05-08T18:01:35.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:35.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-239 td/osd-backfill-space/datafile 2024-05-08T18:01:35.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:35.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-240 td/osd-backfill-space/datafile 2024-05-08T18:01:35.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:35.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-241 td/osd-backfill-space/datafile 2024-05-08T18:01:35.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:35.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-242 td/osd-backfill-space/datafile 2024-05-08T18:01:35.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:35.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-243 td/osd-backfill-space/datafile 2024-05-08T18:01:36.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:36.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-244 td/osd-backfill-space/datafile 2024-05-08T18:01:36.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:36.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-245 td/osd-backfill-space/datafile 2024-05-08T18:01:36.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:36.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-246 td/osd-backfill-space/datafile 2024-05-08T18:01:36.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:36.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-247 td/osd-backfill-space/datafile 2024-05-08T18:01:37.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:37.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-248 td/osd-backfill-space/datafile 2024-05-08T18:01:37.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:37.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-249 td/osd-backfill-space/datafile 2024-05-08T18:01:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-250 td/osd-backfill-space/datafile 2024-05-08T18:01:37.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:37.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-251 td/osd-backfill-space/datafile 2024-05-08T18:01:37.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:37.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-252 td/osd-backfill-space/datafile 2024-05-08T18:01:37.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:37.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-253 td/osd-backfill-space/datafile 2024-05-08T18:01:38.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:38.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-254 td/osd-backfill-space/datafile 2024-05-08T18:01:38.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:38.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-255 td/osd-backfill-space/datafile 2024-05-08T18:01:38.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:38.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-256 td/osd-backfill-space/datafile 2024-05-08T18:01:38.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:38.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-257 td/osd-backfill-space/datafile 2024-05-08T18:01:38.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:38.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-258 td/osd-backfill-space/datafile 2024-05-08T18:01:38.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:38.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-259 td/osd-backfill-space/datafile 2024-05-08T18:01:39.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:39.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-260 td/osd-backfill-space/datafile 2024-05-08T18:01:39.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:39.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-261 td/osd-backfill-space/datafile 2024-05-08T18:01:39.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:39.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-262 td/osd-backfill-space/datafile 2024-05-08T18:01:39.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:39.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-263 td/osd-backfill-space/datafile 2024-05-08T18:01:39.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:39.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-264 td/osd-backfill-space/datafile 2024-05-08T18:01:39.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:39.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile 2024-05-08T18:01:40.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:40.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-266 td/osd-backfill-space/datafile 2024-05-08T18:01:40.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:40.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-267 td/osd-backfill-space/datafile 2024-05-08T18:01:40.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:40.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-268 td/osd-backfill-space/datafile 2024-05-08T18:01:40.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:40.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-269 td/osd-backfill-space/datafile 2024-05-08T18:01:40.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:40.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-270 td/osd-backfill-space/datafile 2024-05-08T18:01:40.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:40.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-271 td/osd-backfill-space/datafile 2024-05-08T18:01:41.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:41.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-272 td/osd-backfill-space/datafile 2024-05-08T18:01:41.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:41.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-273 td/osd-backfill-space/datafile 2024-05-08T18:01:41.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:41.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-274 td/osd-backfill-space/datafile 2024-05-08T18:01:41.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:41.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-275 td/osd-backfill-space/datafile 2024-05-08T18:01:41.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:41.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-276 td/osd-backfill-space/datafile 2024-05-08T18:01:41.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:41.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-277 td/osd-backfill-space/datafile 2024-05-08T18:01:42.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:42.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-278 td/osd-backfill-space/datafile 2024-05-08T18:01:42.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:42.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-279 td/osd-backfill-space/datafile 2024-05-08T18:01:42.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:42.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-280 td/osd-backfill-space/datafile 2024-05-08T18:01:42.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:42.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-281 td/osd-backfill-space/datafile 2024-05-08T18:01:42.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:42.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile 2024-05-08T18:01:42.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:42.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-283 td/osd-backfill-space/datafile 2024-05-08T18:01:43.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:43.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-284 td/osd-backfill-space/datafile 2024-05-08T18:01:43.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:43.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-285 td/osd-backfill-space/datafile 2024-05-08T18:01:43.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:43.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-286 td/osd-backfill-space/datafile 2024-05-08T18:01:43.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:43.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-287 td/osd-backfill-space/datafile 2024-05-08T18:01:43.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:43.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-288 td/osd-backfill-space/datafile 2024-05-08T18:01:43.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:43.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-289 td/osd-backfill-space/datafile 2024-05-08T18:01:44.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:44.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-290 td/osd-backfill-space/datafile 2024-05-08T18:01:44.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:44.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-291 td/osd-backfill-space/datafile 2024-05-08T18:01:44.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:44.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-292 td/osd-backfill-space/datafile 2024-05-08T18:01:44.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:44.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-293 td/osd-backfill-space/datafile 2024-05-08T18:01:44.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:44.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-294 td/osd-backfill-space/datafile 2024-05-08T18:01:44.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:44.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-295 td/osd-backfill-space/datafile 2024-05-08T18:01:45.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:45.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-296 td/osd-backfill-space/datafile 2024-05-08T18:01:45.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:45.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-297 td/osd-backfill-space/datafile 2024-05-08T18:01:45.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:45.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-298 td/osd-backfill-space/datafile 2024-05-08T18:01:45.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:45.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2024-05-08T18:01:45.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:45.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-300 td/osd-backfill-space/datafile 2024-05-08T18:01:45.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:45.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-301 td/osd-backfill-space/datafile 2024-05-08T18:01:46.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:46.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-302 td/osd-backfill-space/datafile 2024-05-08T18:01:46.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:46.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-303 td/osd-backfill-space/datafile 2024-05-08T18:01:46.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:46.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-304 td/osd-backfill-space/datafile 2024-05-08T18:01:46.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:46.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-305 td/osd-backfill-space/datafile 2024-05-08T18:01:46.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:46.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-306 td/osd-backfill-space/datafile 2024-05-08T18:01:47.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:47.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-307 td/osd-backfill-space/datafile 2024-05-08T18:01:47.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:47.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-308 td/osd-backfill-space/datafile 2024-05-08T18:01:47.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:47.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-309 td/osd-backfill-space/datafile 2024-05-08T18:01:47.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:47.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-310 td/osd-backfill-space/datafile 2024-05-08T18:01:47.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:47.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-311 td/osd-backfill-space/datafile 2024-05-08T18:01:47.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:47.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-312 td/osd-backfill-space/datafile 2024-05-08T18:01:48.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:48.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-313 td/osd-backfill-space/datafile 2024-05-08T18:01:48.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:48.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-314 td/osd-backfill-space/datafile 2024-05-08T18:01:48.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:48.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-315 td/osd-backfill-space/datafile 2024-05-08T18:01:48.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:48.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-316 td/osd-backfill-space/datafile 2024-05-08T18:01:48.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:48.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-317 td/osd-backfill-space/datafile 2024-05-08T18:01:48.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:48.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-318 td/osd-backfill-space/datafile 2024-05-08T18:01:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:49.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-319 td/osd-backfill-space/datafile 2024-05-08T18:01:49.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:49.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-320 td/osd-backfill-space/datafile 2024-05-08T18:01:49.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:49.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-321 td/osd-backfill-space/datafile 2024-05-08T18:01:49.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:49.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-322 td/osd-backfill-space/datafile 2024-05-08T18:01:49.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:49.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-323 td/osd-backfill-space/datafile 2024-05-08T18:01:49.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:49.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-324 td/osd-backfill-space/datafile 2024-05-08T18:01:50.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:50.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-325 td/osd-backfill-space/datafile 2024-05-08T18:01:50.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:50.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-326 td/osd-backfill-space/datafile 2024-05-08T18:01:50.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:50.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-327 td/osd-backfill-space/datafile 2024-05-08T18:01:50.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:50.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-328 td/osd-backfill-space/datafile 2024-05-08T18:01:50.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:50.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-329 td/osd-backfill-space/datafile 2024-05-08T18:01:50.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:50.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-330 td/osd-backfill-space/datafile 2024-05-08T18:01:51.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:51.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-331 td/osd-backfill-space/datafile 2024-05-08T18:01:51.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:51.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-332 td/osd-backfill-space/datafile 2024-05-08T18:01:51.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:51.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-333 td/osd-backfill-space/datafile 2024-05-08T18:01:51.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:51.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-334 td/osd-backfill-space/datafile 2024-05-08T18:01:51.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:51.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-335 td/osd-backfill-space/datafile 2024-05-08T18:01:51.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:51.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-336 td/osd-backfill-space/datafile 2024-05-08T18:01:52.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:52.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-337 td/osd-backfill-space/datafile 2024-05-08T18:01:52.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:52.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-338 td/osd-backfill-space/datafile 2024-05-08T18:01:52.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:52.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-339 td/osd-backfill-space/datafile 2024-05-08T18:01:52.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:52.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-340 td/osd-backfill-space/datafile 2024-05-08T18:01:52.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:52.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-341 td/osd-backfill-space/datafile 2024-05-08T18:01:52.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:52.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-342 td/osd-backfill-space/datafile 2024-05-08T18:01:53.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:53.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-343 td/osd-backfill-space/datafile 2024-05-08T18:01:53.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:53.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-344 td/osd-backfill-space/datafile 2024-05-08T18:01:53.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:53.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-345 td/osd-backfill-space/datafile 2024-05-08T18:01:53.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:53.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-346 td/osd-backfill-space/datafile 2024-05-08T18:01:53.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:53.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-347 td/osd-backfill-space/datafile 2024-05-08T18:01:53.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:53.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-348 td/osd-backfill-space/datafile 2024-05-08T18:01:54.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:54.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-349 td/osd-backfill-space/datafile 2024-05-08T18:01:54.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:54.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-350 td/osd-backfill-space/datafile 2024-05-08T18:01:54.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:54.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-351 td/osd-backfill-space/datafile 2024-05-08T18:01:54.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:54.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-352 td/osd-backfill-space/datafile 2024-05-08T18:01:54.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:54.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-353 td/osd-backfill-space/datafile 2024-05-08T18:01:55.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:55.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-354 td/osd-backfill-space/datafile 2024-05-08T18:01:55.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:55.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-355 td/osd-backfill-space/datafile 2024-05-08T18:01:55.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:55.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-356 td/osd-backfill-space/datafile 2024-05-08T18:01:55.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:55.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-357 td/osd-backfill-space/datafile 2024-05-08T18:01:55.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:55.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-358 td/osd-backfill-space/datafile 2024-05-08T18:01:55.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:55.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-359 td/osd-backfill-space/datafile 2024-05-08T18:01:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-360 td/osd-backfill-space/datafile 2024-05-08T18:01:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-361 td/osd-backfill-space/datafile 2024-05-08T18:01:56.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:56.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-362 td/osd-backfill-space/datafile 2024-05-08T18:01:56.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:56.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-363 td/osd-backfill-space/datafile 2024-05-08T18:01:56.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:56.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-364 td/osd-backfill-space/datafile 2024-05-08T18:01:56.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:56.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-365 td/osd-backfill-space/datafile 2024-05-08T18:01:56.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:56.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile 2024-05-08T18:01:57.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:57.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-367 td/osd-backfill-space/datafile 2024-05-08T18:01:57.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:57.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-368 td/osd-backfill-space/datafile 2024-05-08T18:01:57.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:57.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-369 td/osd-backfill-space/datafile 2024-05-08T18:01:57.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:57.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-370 td/osd-backfill-space/datafile 2024-05-08T18:01:57.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:57.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-371 td/osd-backfill-space/datafile 2024-05-08T18:01:57.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:57.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-372 td/osd-backfill-space/datafile 2024-05-08T18:01:58.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:58.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-373 td/osd-backfill-space/datafile 2024-05-08T18:01:58.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:58.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-374 td/osd-backfill-space/datafile 2024-05-08T18:01:58.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:58.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-375 td/osd-backfill-space/datafile 2024-05-08T18:01:58.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:58.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-376 td/osd-backfill-space/datafile 2024-05-08T18:01:58.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:58.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-377 td/osd-backfill-space/datafile 2024-05-08T18:01:59.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:59.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-378 td/osd-backfill-space/datafile 2024-05-08T18:01:59.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:59.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-379 td/osd-backfill-space/datafile 2024-05-08T18:01:59.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:59.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-380 td/osd-backfill-space/datafile 2024-05-08T18:01:59.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:59.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-381 td/osd-backfill-space/datafile 2024-05-08T18:01:59.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:59.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-382 td/osd-backfill-space/datafile 2024-05-08T18:01:59.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:59.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile 2024-05-08T18:01:59.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:01:59.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-384 td/osd-backfill-space/datafile 2024-05-08T18:02:00.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:00.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-385 td/osd-backfill-space/datafile 2024-05-08T18:02:00.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:00.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-386 td/osd-backfill-space/datafile 2024-05-08T18:02:00.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:00.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-387 td/osd-backfill-space/datafile 2024-05-08T18:02:00.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:00.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-388 td/osd-backfill-space/datafile 2024-05-08T18:02:00.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:00.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-389 td/osd-backfill-space/datafile 2024-05-08T18:02:01.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:01.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-390 td/osd-backfill-space/datafile 2024-05-08T18:02:01.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:01.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-391 td/osd-backfill-space/datafile 2024-05-08T18:02:01.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:01.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-392 td/osd-backfill-space/datafile 2024-05-08T18:02:01.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:01.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-393 td/osd-backfill-space/datafile 2024-05-08T18:02:01.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:01.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-394 td/osd-backfill-space/datafile 2024-05-08T18:02:01.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:01.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-395 td/osd-backfill-space/datafile 2024-05-08T18:02:02.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:02.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-396 td/osd-backfill-space/datafile 2024-05-08T18:02:02.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:02.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-397 td/osd-backfill-space/datafile 2024-05-08T18:02:02.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:02.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-398 td/osd-backfill-space/datafile 2024-05-08T18:02:02.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:02.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-399 td/osd-backfill-space/datafile 2024-05-08T18:02:02.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:02.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2024-05-08T18:02:02.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:02.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-401 td/osd-backfill-space/datafile 2024-05-08T18:02:03.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:03.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-402 td/osd-backfill-space/datafile 2024-05-08T18:02:03.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:03.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-403 td/osd-backfill-space/datafile 2024-05-08T18:02:03.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:03.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-404 td/osd-backfill-space/datafile 2024-05-08T18:02:03.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:03.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-405 td/osd-backfill-space/datafile 2024-05-08T18:02:03.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:03.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-406 td/osd-backfill-space/datafile 2024-05-08T18:02:03.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:03.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-407 td/osd-backfill-space/datafile 2024-05-08T18:02:04.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:04.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-408 td/osd-backfill-space/datafile 2024-05-08T18:02:04.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:04.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-409 td/osd-backfill-space/datafile 2024-05-08T18:02:04.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:04.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-410 td/osd-backfill-space/datafile 2024-05-08T18:02:04.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:04.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-411 td/osd-backfill-space/datafile 2024-05-08T18:02:04.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:04.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-412 td/osd-backfill-space/datafile 2024-05-08T18:02:04.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:04.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-413 td/osd-backfill-space/datafile 2024-05-08T18:02:05.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:05.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-414 td/osd-backfill-space/datafile 2024-05-08T18:02:05.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:05.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-415 td/osd-backfill-space/datafile 2024-05-08T18:02:05.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:05.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-416 td/osd-backfill-space/datafile 2024-05-08T18:02:05.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:05.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-417 td/osd-backfill-space/datafile 2024-05-08T18:02:05.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:05.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-418 td/osd-backfill-space/datafile 2024-05-08T18:02:05.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:05.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-419 td/osd-backfill-space/datafile 2024-05-08T18:02:06.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:06.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-420 td/osd-backfill-space/datafile 2024-05-08T18:02:06.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:06.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-421 td/osd-backfill-space/datafile 2024-05-08T18:02:06.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:06.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-422 td/osd-backfill-space/datafile 2024-05-08T18:02:06.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:06.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-423 td/osd-backfill-space/datafile 2024-05-08T18:02:06.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:06.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-424 td/osd-backfill-space/datafile 2024-05-08T18:02:06.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:06.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-425 td/osd-backfill-space/datafile 2024-05-08T18:02:07.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:07.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-426 td/osd-backfill-space/datafile 2024-05-08T18:02:07.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:07.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-427 td/osd-backfill-space/datafile 2024-05-08T18:02:07.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:07.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-428 td/osd-backfill-space/datafile 2024-05-08T18:02:07.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:07.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-429 td/osd-backfill-space/datafile 2024-05-08T18:02:07.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:07.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-430 td/osd-backfill-space/datafile 2024-05-08T18:02:08.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:08.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-431 td/osd-backfill-space/datafile 2024-05-08T18:02:08.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:08.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-432 td/osd-backfill-space/datafile 2024-05-08T18:02:08.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:08.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-433 td/osd-backfill-space/datafile 2024-05-08T18:02:08.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:08.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-434 td/osd-backfill-space/datafile 2024-05-08T18:02:08.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:08.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-435 td/osd-backfill-space/datafile 2024-05-08T18:02:08.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:08.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-436 td/osd-backfill-space/datafile 2024-05-08T18:02:09.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:09.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-437 td/osd-backfill-space/datafile 2024-05-08T18:02:09.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:09.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-438 td/osd-backfill-space/datafile 2024-05-08T18:02:09.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:09.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-439 td/osd-backfill-space/datafile 2024-05-08T18:02:09.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:09.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-440 td/osd-backfill-space/datafile 2024-05-08T18:02:09.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:09.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-441 td/osd-backfill-space/datafile 2024-05-08T18:02:10.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:10.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-442 td/osd-backfill-space/datafile 2024-05-08T18:02:10.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:10.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-443 td/osd-backfill-space/datafile 2024-05-08T18:02:10.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:10.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-444 td/osd-backfill-space/datafile 2024-05-08T18:02:10.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:10.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-445 td/osd-backfill-space/datafile 2024-05-08T18:02:10.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:10.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-446 td/osd-backfill-space/datafile 2024-05-08T18:02:10.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:10.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-447 td/osd-backfill-space/datafile 2024-05-08T18:02:11.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:11.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-448 td/osd-backfill-space/datafile 2024-05-08T18:02:11.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:11.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-449 td/osd-backfill-space/datafile 2024-05-08T18:02:11.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:11.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-450 td/osd-backfill-space/datafile 2024-05-08T18:02:11.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:11.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-451 td/osd-backfill-space/datafile 2024-05-08T18:02:11.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:11.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-452 td/osd-backfill-space/datafile 2024-05-08T18:02:11.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:11.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-453 td/osd-backfill-space/datafile 2024-05-08T18:02:12.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:12.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-454 td/osd-backfill-space/datafile 2024-05-08T18:02:12.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:12.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-455 td/osd-backfill-space/datafile 2024-05-08T18:02:12.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:12.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-456 td/osd-backfill-space/datafile 2024-05-08T18:02:12.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:12.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-457 td/osd-backfill-space/datafile 2024-05-08T18:02:12.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:12.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-458 td/osd-backfill-space/datafile 2024-05-08T18:02:12.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:12.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-459 td/osd-backfill-space/datafile 2024-05-08T18:02:13.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:13.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-460 td/osd-backfill-space/datafile 2024-05-08T18:02:13.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:13.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-461 td/osd-backfill-space/datafile 2024-05-08T18:02:13.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:13.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-462 td/osd-backfill-space/datafile 2024-05-08T18:02:13.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:13.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-463 td/osd-backfill-space/datafile 2024-05-08T18:02:13.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:13.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-464 td/osd-backfill-space/datafile 2024-05-08T18:02:13.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:13.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-465 td/osd-backfill-space/datafile 2024-05-08T18:02:14.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:14.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-466 td/osd-backfill-space/datafile 2024-05-08T18:02:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile 2024-05-08T18:02:14.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:14.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-468 td/osd-backfill-space/datafile 2024-05-08T18:02:14.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:14.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-469 td/osd-backfill-space/datafile 2024-05-08T18:02:14.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:14.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-470 td/osd-backfill-space/datafile 2024-05-08T18:02:15.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:15.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-471 td/osd-backfill-space/datafile 2024-05-08T18:02:15.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:15.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-472 td/osd-backfill-space/datafile 2024-05-08T18:02:15.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:15.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-473 td/osd-backfill-space/datafile 2024-05-08T18:02:15.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:15.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-474 td/osd-backfill-space/datafile 2024-05-08T18:02:15.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:15.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-475 td/osd-backfill-space/datafile 2024-05-08T18:02:15.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:15.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-476 td/osd-backfill-space/datafile 2024-05-08T18:02:16.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:16.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-477 td/osd-backfill-space/datafile 2024-05-08T18:02:16.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:16.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-478 td/osd-backfill-space/datafile 2024-05-08T18:02:16.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:16.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-479 td/osd-backfill-space/datafile 2024-05-08T18:02:16.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:16.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-480 td/osd-backfill-space/datafile 2024-05-08T18:02:16.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:16.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-481 td/osd-backfill-space/datafile 2024-05-08T18:02:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-482 td/osd-backfill-space/datafile 2024-05-08T18:02:17.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:17.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-483 td/osd-backfill-space/datafile 2024-05-08T18:02:17.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:17.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile 2024-05-08T18:02:17.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:17.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-485 td/osd-backfill-space/datafile 2024-05-08T18:02:17.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:17.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-486 td/osd-backfill-space/datafile 2024-05-08T18:02:17.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:17.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-487 td/osd-backfill-space/datafile 2024-05-08T18:02:17.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:17.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-488 td/osd-backfill-space/datafile 2024-05-08T18:02:18.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:18.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-489 td/osd-backfill-space/datafile 2024-05-08T18:02:18.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:18.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-490 td/osd-backfill-space/datafile 2024-05-08T18:02:18.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:18.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-491 td/osd-backfill-space/datafile 2024-05-08T18:02:18.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:18.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-492 td/osd-backfill-space/datafile 2024-05-08T18:02:18.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:18.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-493 td/osd-backfill-space/datafile 2024-05-08T18:02:18.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:18.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-494 td/osd-backfill-space/datafile 2024-05-08T18:02:19.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:19.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-495 td/osd-backfill-space/datafile 2024-05-08T18:02:19.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:19.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-496 td/osd-backfill-space/datafile 2024-05-08T18:02:19.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:19.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-497 td/osd-backfill-space/datafile 2024-05-08T18:02:19.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:19.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-498 td/osd-backfill-space/datafile 2024-05-08T18:02:19.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:19.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-499 td/osd-backfill-space/datafile 2024-05-08T18:02:19.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:19.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-500 td/osd-backfill-space/datafile 2024-05-08T18:02:20.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:20.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2024-05-08T18:02:20.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:20.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-502 td/osd-backfill-space/datafile 2024-05-08T18:02:20.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:20.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-503 td/osd-backfill-space/datafile 2024-05-08T18:02:20.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:20.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-504 td/osd-backfill-space/datafile 2024-05-08T18:02:20.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:20.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-505 td/osd-backfill-space/datafile 2024-05-08T18:02:20.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:20.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-506 td/osd-backfill-space/datafile 2024-05-08T18:02:20.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:20.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-507 td/osd-backfill-space/datafile 2024-05-08T18:02:21.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:21.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-508 td/osd-backfill-space/datafile 2024-05-08T18:02:21.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:21.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-509 td/osd-backfill-space/datafile 2024-05-08T18:02:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-510 td/osd-backfill-space/datafile 2024-05-08T18:02:21.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:21.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-511 td/osd-backfill-space/datafile 2024-05-08T18:02:21.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:21.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-512 td/osd-backfill-space/datafile 2024-05-08T18:02:21.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:21.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-513 td/osd-backfill-space/datafile 2024-05-08T18:02:21.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:21.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-514 td/osd-backfill-space/datafile 2024-05-08T18:02:22.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-515 td/osd-backfill-space/datafile 2024-05-08T18:02:22.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-516 td/osd-backfill-space/datafile 2024-05-08T18:02:22.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-517 td/osd-backfill-space/datafile 2024-05-08T18:02:22.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-518 td/osd-backfill-space/datafile 2024-05-08T18:02:22.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-519 td/osd-backfill-space/datafile 2024-05-08T18:02:22.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-520 td/osd-backfill-space/datafile 2024-05-08T18:02:22.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-521 td/osd-backfill-space/datafile 2024-05-08T18:02:22.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-522 td/osd-backfill-space/datafile 2024-05-08T18:02:22.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:22.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-523 td/osd-backfill-space/datafile 2024-05-08T18:02:23.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:23.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-524 td/osd-backfill-space/datafile 2024-05-08T18:02:23.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:23.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-525 td/osd-backfill-space/datafile 2024-05-08T18:02:23.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:23.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-526 td/osd-backfill-space/datafile 2024-05-08T18:02:23.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:23.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-527 td/osd-backfill-space/datafile 2024-05-08T18:02:23.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:23.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-528 td/osd-backfill-space/datafile 2024-05-08T18:02:23.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:23.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-529 td/osd-backfill-space/datafile 2024-05-08T18:02:23.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:23.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-530 td/osd-backfill-space/datafile 2024-05-08T18:02:23.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:23.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-531 td/osd-backfill-space/datafile 2024-05-08T18:02:24.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:24.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-532 td/osd-backfill-space/datafile 2024-05-08T18:02:24.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:24.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-533 td/osd-backfill-space/datafile 2024-05-08T18:02:24.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:24.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-534 td/osd-backfill-space/datafile 2024-05-08T18:02:24.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:24.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-535 td/osd-backfill-space/datafile 2024-05-08T18:02:24.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:24.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-536 td/osd-backfill-space/datafile 2024-05-08T18:02:24.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:24.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-537 td/osd-backfill-space/datafile 2024-05-08T18:02:24.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:24.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-538 td/osd-backfill-space/datafile 2024-05-08T18:02:24.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:24.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-539 td/osd-backfill-space/datafile 2024-05-08T18:02:25.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:25.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-540 td/osd-backfill-space/datafile 2024-05-08T18:02:25.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:25.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-541 td/osd-backfill-space/datafile 2024-05-08T18:02:25.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:25.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-542 td/osd-backfill-space/datafile 2024-05-08T18:02:25.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:25.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-543 td/osd-backfill-space/datafile 2024-05-08T18:02:25.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:25.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-544 td/osd-backfill-space/datafile 2024-05-08T18:02:25.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:25.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-545 td/osd-backfill-space/datafile 2024-05-08T18:02:25.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:25.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-546 td/osd-backfill-space/datafile 2024-05-08T18:02:25.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:25.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-547 td/osd-backfill-space/datafile 2024-05-08T18:02:26.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:26.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-548 td/osd-backfill-space/datafile 2024-05-08T18:02:26.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:26.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-549 td/osd-backfill-space/datafile 2024-05-08T18:02:26.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:26.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-550 td/osd-backfill-space/datafile 2024-05-08T18:02:26.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:26.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-551 td/osd-backfill-space/datafile 2024-05-08T18:02:26.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:26.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-552 td/osd-backfill-space/datafile 2024-05-08T18:02:26.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:26.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-553 td/osd-backfill-space/datafile 2024-05-08T18:02:26.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:26.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-554 td/osd-backfill-space/datafile 2024-05-08T18:02:26.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:26.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-555 td/osd-backfill-space/datafile 2024-05-08T18:02:27.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-556 td/osd-backfill-space/datafile 2024-05-08T18:02:27.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-557 td/osd-backfill-space/datafile 2024-05-08T18:02:27.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-558 td/osd-backfill-space/datafile 2024-05-08T18:02:27.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-559 td/osd-backfill-space/datafile 2024-05-08T18:02:27.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-560 td/osd-backfill-space/datafile 2024-05-08T18:02:27.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-561 td/osd-backfill-space/datafile 2024-05-08T18:02:27.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-562 td/osd-backfill-space/datafile 2024-05-08T18:02:27.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-563 td/osd-backfill-space/datafile 2024-05-08T18:02:27.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:27.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-564 td/osd-backfill-space/datafile 2024-05-08T18:02:28.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:28.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-565 td/osd-backfill-space/datafile 2024-05-08T18:02:28.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:28.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-566 td/osd-backfill-space/datafile 2024-05-08T18:02:28.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:28.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-567 td/osd-backfill-space/datafile 2024-05-08T18:02:28.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:28.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile 2024-05-08T18:02:28.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:28.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-569 td/osd-backfill-space/datafile 2024-05-08T18:02:28.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:28.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-570 td/osd-backfill-space/datafile 2024-05-08T18:02:28.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:28.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-571 td/osd-backfill-space/datafile 2024-05-08T18:02:28.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:28.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-572 td/osd-backfill-space/datafile 2024-05-08T18:02:29.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-573 td/osd-backfill-space/datafile 2024-05-08T18:02:29.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-574 td/osd-backfill-space/datafile 2024-05-08T18:02:29.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-575 td/osd-backfill-space/datafile 2024-05-08T18:02:29.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-576 td/osd-backfill-space/datafile 2024-05-08T18:02:29.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-577 td/osd-backfill-space/datafile 2024-05-08T18:02:29.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-578 td/osd-backfill-space/datafile 2024-05-08T18:02:29.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-579 td/osd-backfill-space/datafile 2024-05-08T18:02:29.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-580 td/osd-backfill-space/datafile 2024-05-08T18:02:29.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:29.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-581 td/osd-backfill-space/datafile 2024-05-08T18:02:30.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:30.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-582 td/osd-backfill-space/datafile 2024-05-08T18:02:30.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:30.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-583 td/osd-backfill-space/datafile 2024-05-08T18:02:30.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:30.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-584 td/osd-backfill-space/datafile 2024-05-08T18:02:30.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:30.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile 2024-05-08T18:02:30.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:30.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-586 td/osd-backfill-space/datafile 2024-05-08T18:02:30.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:30.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-587 td/osd-backfill-space/datafile 2024-05-08T18:02:30.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:30.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-588 td/osd-backfill-space/datafile 2024-05-08T18:02:30.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:30.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-589 td/osd-backfill-space/datafile 2024-05-08T18:02:31.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:31.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-590 td/osd-backfill-space/datafile 2024-05-08T18:02:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:31.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-591 td/osd-backfill-space/datafile 2024-05-08T18:02:31.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:31.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-592 td/osd-backfill-space/datafile 2024-05-08T18:02:31.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:31.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-593 td/osd-backfill-space/datafile 2024-05-08T18:02:31.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:31.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-594 td/osd-backfill-space/datafile 2024-05-08T18:02:31.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:31.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-595 td/osd-backfill-space/datafile 2024-05-08T18:02:31.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:31.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-596 td/osd-backfill-space/datafile 2024-05-08T18:02:31.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:31.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-597 td/osd-backfill-space/datafile 2024-05-08T18:02:32.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:32.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-598 td/osd-backfill-space/datafile 2024-05-08T18:02:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:32.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-599 td/osd-backfill-space/datafile 2024-05-08T18:02:32.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:02:32.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-600 td/osd-backfill-space/datafile 2024-05-08T18:02:32.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:488: TEST_backfill_multi_partial: ceph pg dump pgs 2024-05-08T18:02:32.836 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:02:32.836 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:00:45.932885+0000 0'0 42:26 [2,0] 2 [2,0] 2 0'0 2024-05-08T17:59:29.398606+0000 0'0 2024-05-08T17:59:29.398606+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:06:15.848720+0000 0 0 2024-05-08T18:02:32.836 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 589 0 0 0 0 603136 0 0 89 500 89 active+clean 2024-05-08T18:00:45.933299+0000 42'589 42:639 [2,0] 2 [2,0] 2 0'0 2024-05-08T17:59:26.608578+0000 0'0 2024-05-08T17:59:26.608578+0000 0 0 periodic scrub scheduled @ 2024-05-10T00:31:43.635480+0000 0 0 2024-05-08T18:02:32.836 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 600 0 0 0 0 1566600 0 0 100 500 100 stale+active+clean 2024-05-08T17:59:26.468644+0000 36'600 36:641 [1] 1 [1] 1 0'0 2024-05-08T17:59:23.872011+0000 0'0 2024-05-08T17:59:23.872011+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:36:40.373032+0000 0 0 2024-05-08T18:02:32.836 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:02:32.836 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:02:32.837 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:02:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:490: TEST_backfill_multi_partial: _objectstore_tool_nowait td/osd-backfill-space 2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2024-05-08T18:02:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/osd-backfill-space 2024-05-08T18:02:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2024-05-08T18:02:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=2 2024-05-08T18:02:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2024-05-08T18:02:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/osd-backfill-space TERM osd.2 2024-05-08T18:02:32.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:02:32.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:02:32.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:02:32.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:02:32.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:02:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:02:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-backfill-space 2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2024-05-08T18:02:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-05-08T18:02:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T18:02:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=2 2024-05-08T18:02:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T18:02:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/2 2024-05-08T18:02:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2024-05-08T18:02:35.028 INFO:tasks.workunit.client.0.smithi117.stderr:Exporting 2.0 info 2.0( v 42'600 (42'500,42'600] local-lis/les=39/40 n=600 ec=26/26 lis/c=39/39 les/c/f=40/40/0 sis=39) 2024-05-08T18:02:35.042 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:00f101c6:::obj-1-121:head# 2024-05-08T18:02:35.051 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0168051e:::obj-1-571:head# 2024-05-08T18:02:35.053 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:01b67738:::obj-1-182:head# 2024-05-08T18:02:35.061 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:040dbc59:::obj-1-23:head# 2024-05-08T18:02:35.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0415ce6e:::obj-1-20:head# 2024-05-08T18:02:35.062 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:058b28d7:::obj-1-572:head# 2024-05-08T18:02:35.063 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:059d2e5c:::obj-1-87:head# 2024-05-08T18:02:35.063 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:05a823ca:::obj-1-52:head# 2024-05-08T18:02:35.064 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:05b8b7fe:::obj-1-119:head# 2024-05-08T18:02:35.064 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:05c9492b:::obj-1-78:head# 2024-05-08T18:02:35.065 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:05e91e96:::obj-1-393:head# 2024-05-08T18:02:35.066 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:07bdb780:::obj-1-204:head# 2024-05-08T18:02:35.066 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:07cfbd49:::obj-1-318:head# 2024-05-08T18:02:35.067 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:084a829f:::obj-1-112:head# 2024-05-08T18:02:35.068 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:08cedd34:::obj-1-438:head# 2024-05-08T18:02:35.068 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0941af69:::obj-1-117:head# 2024-05-08T18:02:35.069 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:09607265:::obj-1-429:head# 2024-05-08T18:02:35.070 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0be86f7e:::obj-1-568:head# 2024-05-08T18:02:35.070 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0ca5819d:::obj-1-327:head# 2024-05-08T18:02:35.071 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0cd02051:::obj-1-208:head# 2024-05-08T18:02:35.078 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0d0264b5:::obj-1-171:head# 2024-05-08T18:02:35.079 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0d195060:::obj-1-420:head# 2024-05-08T18:02:35.081 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0d362b19:::obj-1-219:head# 2024-05-08T18:02:35.081 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0dea6f4d:::obj-1-61:head# 2024-05-08T18:02:35.082 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0ecd8390:::obj-1-132:head# 2024-05-08T18:02:35.082 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0f49e2fa:::obj-1-200:head# 2024-05-08T18:02:35.083 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0f7bb95f:::obj-1-268:head# 2024-05-08T18:02:35.083 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0fabf252:::obj-1-441:head# 2024-05-08T18:02:35.084 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:0fb1697a:::obj-1-443:head# 2024-05-08T18:02:35.084 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:105d3efe:::obj-1-490:head# 2024-05-08T18:02:35.085 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:10f52c01:::obj-1-449:head# 2024-05-08T18:02:35.086 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:11965425:::obj-1-335:head# 2024-05-08T18:02:35.087 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:11c9f5f8:::obj-1-565:head# 2024-05-08T18:02:35.087 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:11cfcfb6:::obj-1-588:head# 2024-05-08T18:02:35.088 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:11d46f0a:::obj-1-387:head# 2024-05-08T18:02:35.089 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:11ebb0d6:::obj-1-214:head# 2024-05-08T18:02:35.089 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1295e402:::obj-1-178:head# 2024-05-08T18:02:35.090 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:12c996c1:::obj-1-517:head# 2024-05-08T18:02:35.092 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:133dec15:::obj-1-475:head# 2024-05-08T18:02:35.092 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1475c981:::obj-1-505:head# 2024-05-08T18:02:35.092 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:148e92a4:::obj-1-509:head# 2024-05-08T18:02:35.092 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1490b121:::obj-1-172:head# 2024-05-08T18:02:35.094 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:14ce082c:::obj-1-99:head# 2024-05-08T18:02:35.094 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1552ad99:::obj-1-41:head# 2024-05-08T18:02:35.094 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:15544270:::obj-1-271:head# 2024-05-08T18:02:35.095 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1589d957:::obj-1-86:head# 2024-05-08T18:02:35.095 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:16db3947:::obj-1-477:head# 2024-05-08T18:02:35.096 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:16dc98bd:::obj-1-375:head# 2024-05-08T18:02:35.097 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:17e54db3:::obj-1-196:head# 2024-05-08T18:02:35.097 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:17f2ad3f:::obj-1-10:head# 2024-05-08T18:02:35.098 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:18075e41:::obj-1-55:head# 2024-05-08T18:02:35.098 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:18086253:::obj-1-71:head# 2024-05-08T18:02:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:191cf8d8:::obj-1-372:head# 2024-05-08T18:02:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:19311f70:::obj-1-454:head# 2024-05-08T18:02:35.100 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:198318e4:::obj-1-464:head# 2024-05-08T18:02:35.100 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1999d806:::obj-1-163:head# 2024-05-08T18:02:35.101 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1a92cab7:::obj-1-412:head# 2024-05-08T18:02:35.101 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1b16c0f6:::obj-1-210:head# 2024-05-08T18:02:35.102 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1b53ed46:::obj-1-577:head# 2024-05-08T18:02:35.103 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1b5c5a8d:::obj-1-556:head# 2024-05-08T18:02:35.104 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1c12c05e:::obj-1-79:head# 2024-05-08T18:02:35.104 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1c571ba5:::obj-1-262:head# 2024-05-08T18:02:35.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1c5f42b7:::obj-1-92:head# 2024-05-08T18:02:35.105 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1c6ad881:::obj-1-312:head# 2024-05-08T18:02:35.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1c89877b:::obj-1-142:head# 2024-05-08T18:02:35.106 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1e4168ca:::obj-1-282:head# 2024-05-08T18:02:35.107 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1e424445:::obj-1-484:head# 2024-05-08T18:02:35.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1e467959:::obj-1-22:head# 2024-05-08T18:02:35.108 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1eaf7e7c:::obj-1-392:head# 2024-05-08T18:02:35.109 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1f06c86d:::obj-1-307:head# 2024-05-08T18:02:35.109 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1f2ee1f8:::obj-1-306:head# 2024-05-08T18:02:35.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:1f4ef040:::obj-1-349:head# 2024-05-08T18:02:35.110 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2039481f:::obj-1-545:head# 2024-05-08T18:02:35.111 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:22233df0:::obj-1-543:head# 2024-05-08T18:02:35.112 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2225184e:::obj-1-266:head# 2024-05-08T18:02:35.113 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:234766bb:::obj-1-281:head# 2024-05-08T18:02:35.113 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2372e022:::obj-1-205:head# 2024-05-08T18:02:35.114 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2379547b:::obj-1-113:head# 2024-05-08T18:02:35.114 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:23ae14bf:::obj-1-531:head# 2024-05-08T18:02:35.115 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:23bc5f90:::obj-1-452:head# 2024-05-08T18:02:35.116 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:23fbef3d:::obj-1-82:head# 2024-05-08T18:02:35.117 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:24106c2b:::obj-1-232:head# 2024-05-08T18:02:35.117 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2529b4e4:::obj-1-75:head# 2024-05-08T18:02:35.118 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:25a24ae7:::obj-1-459:head# 2024-05-08T18:02:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:26627aa9:::obj-1-7:head# 2024-05-08T18:02:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:26b77221:::obj-1-227:head# 2024-05-08T18:02:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:27450826:::obj-1-344:head# 2024-05-08T18:02:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:278905af:::obj-1-592:head# 2024-05-08T18:02:35.121 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:27ad0d2d:::obj-1-136:head# 2024-05-08T18:02:35.121 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:28a8c213:::obj-1-118:head# 2024-05-08T18:02:35.122 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:28c0c009:::obj-1-74:head# 2024-05-08T18:02:35.122 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2a214708:::obj-1-260:head# 2024-05-08T18:02:35.123 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2a67e195:::obj-1-474:head# 2024-05-08T18:02:35.123 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2aa852ff:::obj-1-5:head# 2024-05-08T18:02:35.124 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2ba1fb52:::obj-1-563:head# 2024-05-08T18:02:35.125 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2bae8cb9:::obj-1-320:head# 2024-05-08T18:02:35.125 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2c569d02:::obj-1-139:head# 2024-05-08T18:02:35.125 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2c71d691:::obj-1-201:head# 2024-05-08T18:02:35.126 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2c88e92c:::obj-1-389:head# 2024-05-08T18:02:35.127 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2d659109:::obj-1-580:head# 2024-05-08T18:02:35.127 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2d74ea60:::obj-1-230:head# 2024-05-08T18:02:35.128 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2de96edf:::obj-1-233:head# 2024-05-08T18:02:35.128 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2e43da40:::obj-1-382:head# 2024-05-08T18:02:35.129 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2e530c9f:::obj-1-358:head# 2024-05-08T18:02:35.129 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:2ed02239:::obj-1-81:head# 2024-05-08T18:02:35.130 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:30264a0c:::obj-1-373:head# 2024-05-08T18:02:35.133 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:302ca5e7:::obj-1-206:head# 2024-05-08T18:02:35.133 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:309878e8:::obj-1-508:head# 2024-05-08T18:02:35.133 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:309a0ac3:::obj-1-188:head# 2024-05-08T18:02:35.133 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:30f030e9:::obj-1-53:head# 2024-05-08T18:02:35.133 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:31242a73:::obj-1-528:head# 2024-05-08T18:02:35.134 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:31463825:::obj-1-34:head# 2024-05-08T18:02:35.134 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3166dc86:::obj-1-355:head# 2024-05-08T18:02:35.134 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:31baa2fa:::obj-1-252:head# 2024-05-08T18:02:35.135 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:31d8935e:::obj-1-193:head# 2024-05-08T18:02:35.135 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:32670b14:::obj-1-305:head# 2024-05-08T18:02:35.136 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:33da02fa:::obj-1-114:head# 2024-05-08T18:02:35.136 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:34373133:::obj-1-446:head# 2024-05-08T18:02:35.137 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:347b7083:::obj-1-89:head# 2024-05-08T18:02:35.137 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:349125c1:::obj-1-148:head# 2024-05-08T18:02:35.138 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:34b80eee:::obj-1-138:head# 2024-05-08T18:02:35.138 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:34db48f8:::obj-1-49:head# 2024-05-08T18:02:35.139 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3669ff0c:::obj-1-313:head# 2024-05-08T18:02:35.139 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:36c1b610:::obj-1-249:head# 2024-05-08T18:02:35.140 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:374c250b:::obj-1-324:head# 2024-05-08T18:02:35.140 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3761a149:::obj-1-342:head# 2024-05-08T18:02:35.141 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:379ff95a:::obj-1-341:head# 2024-05-08T18:02:35.141 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:37dc15a6:::obj-1-26:head# 2024-05-08T18:02:35.142 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:38130e33:::obj-1-552:head# 2024-05-08T18:02:35.143 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:39c44880:::obj-1-538:head# 2024-05-08T18:02:35.144 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3a08dec9:::obj-1-368:head# 2024-05-08T18:02:35.144 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3a2b46a6:::obj-1-407:head# 2024-05-08T18:02:35.145 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3a7dfe0a:::obj-1-285:head# 2024-05-08T18:02:35.145 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3aebb144:::obj-1-248:head# 2024-05-08T18:02:35.147 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3b08b36f:::obj-1-310:head# 2024-05-08T18:02:35.147 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3b28ffa3:::obj-1-295:head# 2024-05-08T18:02:35.147 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3ba79bd1:::obj-1-444:head# 2024-05-08T18:02:35.147 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3c05df8d:::obj-1-319:head# 2024-05-08T18:02:35.148 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3c57e6a9:::obj-1-436:head# 2024-05-08T18:02:35.148 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3c73d8ee:::obj-1-298:head# 2024-05-08T18:02:35.149 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3cb6ae2a:::obj-1-400:head# 2024-05-08T18:02:35.149 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3cb71491:::obj-1-328:head# 2024-05-08T18:02:35.150 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3cb842fe:::obj-1-541:head# 2024-05-08T18:02:35.151 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3cf6835e:::obj-1-496:head# 2024-05-08T18:02:35.152 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3cf78507:::obj-1-573:head# 2024-05-08T18:02:35.152 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3d0dab84:::obj-1-554:head# 2024-05-08T18:02:35.153 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3d1a5f9d:::obj-1-323:head# 2024-05-08T18:02:35.154 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3da5f3a2:::obj-1-414:head# 2024-05-08T18:02:35.155 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3dbb65f0:::obj-1-440:head# 2024-05-08T18:02:35.155 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3dc94618:::obj-1-223:head# 2024-05-08T18:02:35.156 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3df3d5ab:::obj-1-25:head# 2024-05-08T18:02:35.156 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3e167988:::obj-1-336:head# 2024-05-08T18:02:35.157 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3e4ef3bd:::obj-1-104:head# 2024-05-08T18:02:35.157 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3e9e1efd:::obj-1-357:head# 2024-05-08T18:02:35.158 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3ebbe3a7:::obj-1-42:head# 2024-05-08T18:02:35.158 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3ec80373:::obj-1-403:head# 2024-05-08T18:02:35.159 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3ed086e4:::obj-1-13:head# 2024-05-08T18:02:35.159 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:3fe8e157:::obj-1-164:head# 2024-05-08T18:02:35.160 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:401ddfd4:::obj-1-379:head# 2024-05-08T18:02:35.161 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4092f6cd:::obj-1-430:head# 2024-05-08T18:02:35.161 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:414bd7cc:::obj-1-562:head# 2024-05-08T18:02:35.162 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:422bd9d0:::obj-1-287:head# 2024-05-08T18:02:35.163 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4255002d:::obj-1-578:head# 2024-05-08T18:02:35.163 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4270725c:::obj-1-109:head# 2024-05-08T18:02:35.164 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:42836669:::obj-1-31:head# 2024-05-08T18:02:35.165 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:428d93ef:::obj-1-32:head# 2024-05-08T18:02:35.165 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4327ef5b:::obj-1-453:head# 2024-05-08T18:02:35.166 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:440eb07b:::obj-1-236:head# 2024-05-08T18:02:35.166 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:442a028a:::obj-1-365:head# 2024-05-08T18:02:35.168 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:449ca54a:::obj-1-161:head# 2024-05-08T18:02:35.168 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:45128c3b:::obj-1-343:head# 2024-05-08T18:02:35.168 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:45801bf6:::obj-1-264:head# 2024-05-08T18:02:35.169 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:45896f61:::obj-1-48:head# 2024-05-08T18:02:35.169 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:459b7f1c:::obj-1-190:head# 2024-05-08T18:02:35.170 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:466af96a:::obj-1-486:head# 2024-05-08T18:02:35.171 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:47387ce4:::obj-1-575:head# 2024-05-08T18:02:35.171 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:47c94cc8:::obj-1-564:head# 2024-05-08T18:02:35.172 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:47d7f8ed:::obj-1-544:head# 2024-05-08T18:02:35.173 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:47fc0ec3:::obj-1-558:head# 2024-05-08T18:02:35.174 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:48ba42d8:::obj-1-156:head# 2024-05-08T18:02:35.175 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:494e269e:::obj-1-600:head# 2024-05-08T18:02:35.176 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:49646095:::obj-1-73:head# 2024-05-08T18:02:35.176 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:49eb65ab:::obj-1-374:head# 2024-05-08T18:02:35.178 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4a0075a4:::obj-1-432:head# 2024-05-08T18:02:35.178 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4af1ffc2:::obj-1-72:head# 2024-05-08T18:02:35.178 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4bc1c46f:::obj-1-346:head# 2024-05-08T18:02:35.178 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4bd55e68:::obj-1-93:head# 2024-05-08T18:02:35.178 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4c6d2760:::obj-1-198:head# 2024-05-08T18:02:35.179 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4cb9be3b:::obj-1-451:head# 2024-05-08T18:02:35.179 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4d260a64:::obj-1-514:head# 2024-05-08T18:02:35.180 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4d7d6284:::obj-1-583:head# 2024-05-08T18:02:35.180 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4e79ac02:::obj-1-437:head# 2024-05-08T18:02:35.181 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4e980099:::obj-1-507:head# 2024-05-08T18:02:35.181 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4ea8f99c:::obj-1-211:head# 2024-05-08T18:02:35.182 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4eabdc2a:::obj-1-590:head# 2024-05-08T18:02:35.182 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4f97fd73:::obj-1-243:head# 2024-05-08T18:02:35.183 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4fe00224:::obj-1-229:head# 2024-05-08T18:02:35.183 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4fead9ab:::obj-1-476:head# 2024-05-08T18:02:35.184 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:4ffddfd7:::obj-1-462:head# 2024-05-08T18:02:35.185 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5085c04d:::obj-1-100:head# 2024-05-08T18:02:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:50a8b465:::obj-1-574:head# 2024-05-08T18:02:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:518a151f:::obj-1-189:head# 2024-05-08T18:02:35.187 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:519afc95:::obj-1-314:head# 2024-05-08T18:02:35.187 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:52199781:::obj-1-202:head# 2024-05-08T18:02:35.188 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:52313062:::obj-1-337:head# 2024-05-08T18:02:35.188 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:526a5196:::obj-1-225:head# 2024-05-08T18:02:35.189 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:53128d32:::obj-1-483:head# 2024-05-08T18:02:35.189 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:53c2bb21:::obj-1-532:head# 2024-05-08T18:02:35.190 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:53fa4f3c:::obj-1-423:head# 2024-05-08T18:02:35.191 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:541c1d30:::obj-1-143:head# 2024-05-08T18:02:35.191 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:548d20c3:::obj-1-352:head# 2024-05-08T18:02:35.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:54e4c6f9:::obj-1-101:head# 2024-05-08T18:02:35.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:55016e06:::obj-1-276:head# 2024-05-08T18:02:35.193 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5510c784:::obj-1-491:head# 2024-05-08T18:02:35.194 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:551275ef:::obj-1-239:head# 2024-05-08T18:02:35.194 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:556df001:::obj-1-46:head# 2024-05-08T18:02:35.195 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:558fb5b1:::obj-1-536:head# 2024-05-08T18:02:35.196 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:56390d98:::obj-1-64:head# 2024-05-08T18:02:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:564f962a:::obj-1-125:head# 2024-05-08T18:02:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:56936e94:::obj-1-251:head# 2024-05-08T18:02:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:57585d3d:::obj-1-294:head# 2024-05-08T18:02:35.198 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5764cf7b:::obj-1-479:head# 2024-05-08T18:02:35.198 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5782341a:::obj-1-218:head# 2024-05-08T18:02:35.199 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:57d07a1a:::obj-1-317:head# 2024-05-08T18:02:35.200 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:58700205:::obj-1-176:head# 2024-05-08T18:02:35.200 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:58aee718:::obj-1-434:head# 2024-05-08T18:02:35.202 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:594c9d52:::obj-1-458:head# 2024-05-08T18:02:35.202 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5a70b555:::obj-1-279:head# 2024-05-08T18:02:35.202 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5b02568b:::obj-1-586:head# 2024-05-08T18:02:35.203 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5b69cdcf:::obj-1-391:head# 2024-05-08T18:02:35.203 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5cf151b5:::obj-1-510:head# 2024-05-08T18:02:35.203 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5d7fd07f:::obj-1-152:head# 2024-05-08T18:02:35.204 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5de288d7:::obj-1-235:head# 2024-05-08T18:02:35.204 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5ec497cd:::obj-1-44:head# 2024-05-08T18:02:35.205 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5fb3a09f:::obj-1-518:head# 2024-05-08T18:02:35.206 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:5ff3c2ef:::obj-1-470:head# 2024-05-08T18:02:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:601efcb1:::obj-1-549:head# 2024-05-08T18:02:35.208 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:60831338:::obj-1-263:head# 2024-05-08T18:02:35.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6092777b:::obj-1-145:head# 2024-05-08T18:02:35.209 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:60b17206:::obj-1-411:head# 2024-05-08T18:02:35.210 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:610c957c:::obj-1-278:head# 2024-05-08T18:02:35.210 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:613b5ef4:::obj-1-504:head# 2024-05-08T18:02:35.211 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:61ed7d60:::obj-1-274:head# 2024-05-08T18:02:35.211 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:621b6751:::obj-1-212:head# 2024-05-08T18:02:35.212 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:62b0aba9:::obj-1-253:head# 2024-05-08T18:02:35.213 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:64017240:::obj-1-102:head# 2024-05-08T18:02:35.213 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:645f4f49:::obj-1-332:head# 2024-05-08T18:02:35.214 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:65db82b9:::obj-1-334:head# 2024-05-08T18:02:35.214 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:667422e5:::obj-1-465:head# 2024-05-08T18:02:35.215 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:66c50bc2:::obj-1-322:head# 2024-05-08T18:02:35.216 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:681a4577:::obj-1-511:head# 2024-05-08T18:02:35.216 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6874e007:::obj-1-398:head# 2024-05-08T18:02:35.217 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:693746c1:::obj-1-582:head# 2024-05-08T18:02:35.218 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:69638b0c:::obj-1-8:head# 2024-05-08T18:02:35.218 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6967de6e:::obj-1-331:head# 2024-05-08T18:02:35.219 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:69da97aa:::obj-1-340:head# 2024-05-08T18:02:35.220 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6b3a50a6:::obj-1-144:head# 2024-05-08T18:02:35.220 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6be4ef26:::obj-1-579:head# 2024-05-08T18:02:35.221 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6d735549:::obj-1-599:head# 2024-05-08T18:02:35.221 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6e22c25e:::obj-1-9:head# 2024-05-08T18:02:35.222 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6e2ced4e:::obj-1-370:head# 2024-05-08T18:02:35.223 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6e961169:::obj-1-428:head# 2024-05-08T18:02:35.224 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6efcbbee:::obj-1-168:head# 2024-05-08T18:02:35.224 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6f20741c:::obj-1-33:head# 2024-05-08T18:02:35.224 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6fe4c885:::obj-1-273:head# 2024-05-08T18:02:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:6fffdea2:::obj-1-425:head# 2024-05-08T18:02:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:70716852:::obj-1-593:head# 2024-05-08T18:02:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:70919606:::obj-1-515:head# 2024-05-08T18:02:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:70c39d76:::obj-1-467:head# 2024-05-08T18:02:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:70f57ad3:::obj-1-361:head# 2024-05-08T18:02:35.228 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7177c7b5:::obj-1-503:head# 2024-05-08T18:02:35.229 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:719b69bd:::obj-1-497:head# 2024-05-08T18:02:35.230 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:724f9347:::obj-1-6:head# 2024-05-08T18:02:35.230 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:726d9f6b:::obj-1-111:head# 2024-05-08T18:02:35.231 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:72a91baf:::obj-1-439:head# 2024-05-08T18:02:35.232 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:72aa43ee:::obj-1-534:head# 2024-05-08T18:02:35.233 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:72c40e11:::obj-1-288:head# 2024-05-08T18:02:35.233 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:74196d45:::obj-1-246:head# 2024-05-08T18:02:35.234 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:743f42b1:::obj-1-326:head# 2024-05-08T18:02:35.234 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7523b538:::obj-1-494:head# 2024-05-08T18:02:35.236 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:75310ed6:::obj-1-364:head# 2024-05-08T18:02:35.236 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7568e0bc:::obj-1-585:head# 2024-05-08T18:02:35.236 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:760219a3:::obj-1-353:head# 2024-05-08T18:02:35.237 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:763338c9:::obj-1-555:head# 2024-05-08T18:02:35.238 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:77bc2d65:::obj-1-386:head# 2024-05-08T18:02:35.239 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:77ed0c7a:::obj-1-492:head# 2024-05-08T18:02:35.240 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:785a4052:::obj-1-456:head# 2024-05-08T18:02:35.240 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:796799c3:::obj-1-195:head# 2024-05-08T18:02:35.241 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:79caf0c1:::obj-1-445:head# 2024-05-08T18:02:35.242 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7af5b3e4:::obj-1-217:head# 2024-05-08T18:02:35.242 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7b3a9063:::obj-1-169:head# 2024-05-08T18:02:35.243 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7b509a92:::obj-1-561:head# 2024-05-08T18:02:35.243 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7bc646b1:::obj-1-415:head# 2024-05-08T18:02:35.244 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7c2f9188:::obj-1-482:head# 2024-05-08T18:02:35.245 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7d0da936:::obj-1-11:head# 2024-05-08T18:02:35.246 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7d25ca2d:::obj-1-242:head# 2024-05-08T18:02:35.246 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7d64f81e:::obj-1-473:head# 2024-05-08T18:02:35.247 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7ef2ea1b:::obj-1-417:head# 2024-05-08T18:02:35.247 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7f52b238:::obj-1-308:head# 2024-05-08T18:02:35.249 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:7f7a313c:::obj-1-551:head# 2024-05-08T18:02:35.250 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:806827a7:::obj-1-472:head# 2024-05-08T18:02:35.251 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8112c3ab:::obj-1-45:head# 2024-05-08T18:02:35.251 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:81365b55:::obj-1-315:head# 2024-05-08T18:02:35.252 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:818ffdc3:::obj-1-345:head# 2024-05-08T18:02:35.253 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:81babab8:::obj-1-535:head# 2024-05-08T18:02:35.253 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8288f652:::obj-1-347:head# 2024-05-08T18:02:35.254 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8312eadd:::obj-1-14:head# 2024-05-08T18:02:35.254 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:83b89bc7:::obj-1-137:head# 2024-05-08T18:02:35.255 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:84a12321:::obj-1-134:head# 2024-05-08T18:02:35.255 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:84b26d62:::obj-1-408:head# 2024-05-08T18:02:35.256 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:84bbb26e:::obj-1-43:head# 2024-05-08T18:02:35.257 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:86fc0014:::obj-1-222:head# 2024-05-08T18:02:35.257 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:87488bf4:::obj-1-174:head# 2024-05-08T18:02:35.258 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8754389a:::obj-1-65:head# 2024-05-08T18:02:35.258 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:87a6ad67:::obj-1-366:head# 2024-05-08T18:02:35.259 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:87d32b83:::obj-1-513:head# 2024-05-08T18:02:35.260 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8813a346:::obj-1-540:head# 2024-05-08T18:02:35.260 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:88146951:::obj-1-216:head# 2024-05-08T18:02:35.261 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8820800d:::obj-1-83:head# 2024-05-08T18:02:35.261 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:88319745:::obj-1-98:head# 2024-05-08T18:02:35.262 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:88c969b8:::obj-1-54:head# 2024-05-08T18:02:35.262 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:895a2d53:::obj-1-150:head# 2024-05-08T18:02:35.263 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8ae006a0:::obj-1-241:head# 2024-05-08T18:02:35.263 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8bd44e64:::obj-1-300:head# 2024-05-08T18:02:35.264 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8beb257f:::obj-1-3:head# 2024-05-08T18:02:35.264 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8cd8c743:::obj-1-527:head# 2024-05-08T18:02:35.265 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8daa99c7:::obj-1-237:head# 2024-05-08T18:02:35.266 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8f5bccbf:::obj-1-59:head# 2024-05-08T18:02:35.266 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8f6d9945:::obj-1-151:head# 2024-05-08T18:02:35.267 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8f7c568c:::obj-1-261:head# 2024-05-08T18:02:35.268 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:8fbc59a9:::obj-1-589:head# 2024-05-08T18:02:35.268 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:90225d94:::obj-1-194:head# 2024-05-08T18:02:35.268 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:904c50d3:::obj-1-63:head# 2024-05-08T18:02:35.269 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:90e1bd79:::obj-1-450:head# 2024-05-08T18:02:35.269 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9274b06d:::obj-1-460:head# 2024-05-08T18:02:35.270 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:92af41f5:::obj-1-409:head# 2024-05-08T18:02:35.270 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:935a08d6:::obj-1-192:head# 2024-05-08T18:02:35.271 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:935f8a13:::obj-1-24:head# 2024-05-08T18:02:35.271 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:95230148:::obj-1-280:head# 2024-05-08T18:02:35.272 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:95342eb0:::obj-1-390:head# 2024-05-08T18:02:35.272 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9659d09c:::obj-1-292:head# 2024-05-08T18:02:35.273 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:970e8cb4:::obj-1-18:head# 2024-05-08T18:02:35.273 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:97d21cf1:::obj-1-80:head# 2024-05-08T18:02:35.274 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:982bdb12:::obj-1-302:head# 2024-05-08T18:02:35.275 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:985dfd75:::obj-1-91:head# 2024-05-08T18:02:35.275 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:986d245a:::obj-1-154:head# 2024-05-08T18:02:35.275 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:98a03e99:::obj-1-529:head# 2024-05-08T18:02:35.276 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:98b7103e:::obj-1-275:head# 2024-05-08T18:02:35.277 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:990f0ecf:::obj-1-427:head# 2024-05-08T18:02:35.278 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:996c1f26:::obj-1-96:head# 2024-05-08T18:02:35.278 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:99bd2018:::obj-1-17:head# 2024-05-08T18:02:35.279 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9a7434c9:::obj-1-469:head# 2024-05-08T18:02:35.279 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9a8e36cc:::obj-1-598:head# 2024-05-08T18:02:35.280 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9abcc369:::obj-1-442:head# 2024-05-08T18:02:35.281 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9b0ea06e:::obj-1-231:head# 2024-05-08T18:02:35.281 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9b34e80d:::obj-1-378:head# 2024-05-08T18:02:35.282 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9b55a2a9:::obj-1-60:head# 2024-05-08T18:02:35.282 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9be3f2da:::obj-1-597:head# 2024-05-08T18:02:35.283 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9bf62c88:::obj-1-447:head# 2024-05-08T18:02:35.284 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9c31857b:::obj-1-272:head# 2024-05-08T18:02:35.284 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9c533e91:::obj-1-19:head# 2024-05-08T18:02:35.285 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9ca70688:::obj-1-570:head# 2024-05-08T18:02:35.286 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9ccce337:::obj-1-147:head# 2024-05-08T18:02:35.286 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9d4b2dfc:::obj-1-267:head# 2024-05-08T18:02:35.287 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9d4df969:::obj-1-286:head# 2024-05-08T18:02:35.287 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9d714651:::obj-1-495:head# 2024-05-08T18:02:35.288 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9da65518:::obj-1-498:head# 2024-05-08T18:02:35.289 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9e94f27b:::obj-1-209:head# 2024-05-08T18:02:35.289 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9f39e910:::obj-1-354:head# 2024-05-08T18:02:35.290 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9f8f9ef4:::obj-1-226:head# 2024-05-08T18:02:35.290 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:9fcd3f36:::obj-1-47:head# 2024-05-08T18:02:35.291 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a0326d7d:::obj-1-338:head# 2024-05-08T18:02:35.291 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a05e7475:::obj-1-62:head# 2024-05-08T18:02:35.292 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a0955052:::obj-1-533:head# 2024-05-08T18:02:35.293 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a0aa6848:::obj-1-38:head# 2024-05-08T18:02:35.293 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a0fdc285:::obj-1-133:head# 2024-05-08T18:02:35.294 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a10290b8:::obj-1-245:head# 2024-05-08T18:02:35.295 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a118a8a8:::obj-1-500:head# 2024-05-08T18:02:35.295 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a11a4079:::obj-1-199:head# 2024-05-08T18:02:35.296 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a1b3ec36:::obj-1-15:head# 2024-05-08T18:02:35.297 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a1f5079b:::obj-1-468:head# 2024-05-08T18:02:35.298 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a1ff04b5:::obj-1-167:head# 2024-05-08T18:02:35.298 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a21cc437:::obj-1-128:head# 2024-05-08T18:02:35.299 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a2966c77:::obj-1-140:head# 2024-05-08T18:02:35.299 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a321e537:::obj-1-184:head# 2024-05-08T18:02:35.300 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a33418d8:::obj-1-488:head# 2024-05-08T18:02:35.300 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a38b1c1a:::obj-1-584:head# 2024-05-08T18:02:35.300 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a3f83221:::obj-1-158:head# 2024-05-08T18:02:35.301 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a46e33eb:::obj-1-106:head# 2024-05-08T18:02:35.301 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a491460d:::obj-1-421:head# 2024-05-08T18:02:35.302 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a4dd813b:::obj-1-530:head# 2024-05-08T18:02:35.303 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a4e0d96d:::obj-1-351:head# 2024-05-08T18:02:35.304 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a52657b4:::obj-1-557:head# 2024-05-08T18:02:35.304 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a5b3bca6:::obj-1-277:head# 2024-05-08T18:02:35.305 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a5f5a9fb:::obj-1-170:head# 2024-05-08T18:02:35.305 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a6aeed57:::obj-1-141:head# 2024-05-08T18:02:35.307 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a6dda70f:::obj-1-471:head# 2024-05-08T18:02:35.307 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a71186c0:::obj-1-406:head# 2024-05-08T18:02:35.307 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a764ad8c:::obj-1-221:head# 2024-05-08T18:02:35.308 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a7b63473:::obj-1-131:head# 2024-05-08T18:02:35.309 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a88042fa:::obj-1-296:head# 2024-05-08T18:02:35.309 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:a8805fe0:::obj-1-213:head# 2024-05-08T18:02:35.310 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:aa4f12b1:::obj-1-270:head# 2024-05-08T18:02:35.310 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ab27f701:::obj-1-399:head# 2024-05-08T18:02:35.311 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ab8027c1:::obj-1-360:head# 2024-05-08T18:02:35.312 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ac3ef8ab:::obj-1-371:head# 2024-05-08T18:02:35.312 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ac4db76d:::obj-1-405:head# 2024-05-08T18:02:35.313 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ad53cb29:::obj-1-256:head# 2024-05-08T18:02:35.313 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ad704c16:::obj-1-485:head# 2024-05-08T18:02:35.314 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:adec4920:::obj-1-107:head# 2024-05-08T18:02:35.320 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ae3a94b3:::obj-1-95:head# 2024-05-08T18:02:35.320 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ae92616e:::obj-1-448:head# 2024-05-08T18:02:35.320 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ae975168:::obj-1-426:head# 2024-05-08T18:02:35.321 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:aee8fd62:::obj-1-27:head# 2024-05-08T18:02:35.321 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:af38aa87:::obj-1-50:head# 2024-05-08T18:02:35.321 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b0327eb3:::obj-1-380:head# 2024-05-08T18:02:35.321 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b03cd166:::obj-1-203:head# 2024-05-08T18:02:35.321 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b06f06e0:::obj-1-126:head# 2024-05-08T18:02:35.321 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b0972538:::obj-1-506:head# 2024-05-08T18:02:35.321 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b0cfb86a:::obj-1-359:head# 2024-05-08T18:02:35.322 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b10adb1c:::obj-1-333:head# 2024-05-08T18:02:35.322 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b20b9004:::obj-1-401:head# 2024-05-08T18:02:35.323 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b2113757:::obj-1-4:head# 2024-05-08T18:02:35.324 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b22441e9:::obj-1-29:head# 2024-05-08T18:02:35.324 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b2472384:::obj-1-207:head# 2024-05-08T18:02:35.325 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b2604227:::obj-1-502:head# 2024-05-08T18:02:35.326 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b3277f89:::obj-1-175:head# 2024-05-08T18:02:35.326 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b3d09e0d:::obj-1-258:head# 2024-05-08T18:02:35.327 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b3e9969a:::obj-1-499:head# 2024-05-08T18:02:35.327 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b4892e7d:::obj-1-155:head# 2024-05-08T18:02:35.328 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b4b76084:::obj-1-581:head# 2024-05-08T18:02:35.329 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b6e47ae5:::obj-1-215:head# 2024-05-08T18:02:35.329 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b75af5ff:::obj-1-228:head# 2024-05-08T18:02:35.330 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b8e2e20f:::obj-1-220:head# 2024-05-08T18:02:35.330 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:b8e80c4e:::obj-1-576:head# 2024-05-08T18:02:35.331 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ba502aee:::obj-1-255:head# 2024-05-08T18:02:35.332 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ba9c3e6e:::obj-1-57:head# 2024-05-08T18:02:35.332 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bb068062:::obj-1-461:head# 2024-05-08T18:02:35.333 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bb16c115:::obj-1-157:head# 2024-05-08T18:02:35.333 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bb447914:::obj-1-481:head# 2024-05-08T18:02:35.334 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bb6c8e0f:::obj-1-348:head# 2024-05-08T18:02:35.335 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bb77d6d0:::obj-1-301:head# 2024-05-08T18:02:35.335 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bc51c5f6:::obj-1-422:head# 2024-05-08T18:02:35.336 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bc838d5c:::obj-1-35:head# 2024-05-08T18:02:35.336 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bceae5eb:::obj-1-56:head# 2024-05-08T18:02:35.337 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bea17ef6:::obj-1-84:head# 2024-05-08T18:02:35.337 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:beb88be5:::obj-1-396:head# 2024-05-08T18:02:35.338 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:beed7b18:::obj-1-569:head# 2024-05-08T18:02:35.338 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bf0bff49:::obj-1-385:head# 2024-05-08T18:02:35.339 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bf545d5a:::obj-1-69:head# 2024-05-08T18:02:35.340 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bf560a7f:::obj-1-40:head# 2024-05-08T18:02:35.340 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:bff6999c:::obj-1-240:head# 2024-05-08T18:02:35.341 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c0a33d38:::obj-1-321:head# 2024-05-08T18:02:35.341 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c1e4c9b4:::obj-1-299:head# 2024-05-08T18:02:35.342 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c1ec515a:::obj-1-16:head# 2024-05-08T18:02:35.342 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c22de3c8:::obj-1-110:head# 2024-05-08T18:02:35.343 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c231cd7c:::obj-1-58:head# 2024-05-08T18:02:35.343 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c2ee6ace:::obj-1-186:head# 2024-05-08T18:02:35.344 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c32bfef2:::obj-1-181:head# 2024-05-08T18:02:35.344 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c575a298:::obj-1-466:head# 2024-05-08T18:02:35.345 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c58c3f80:::obj-1-493:head# 2024-05-08T18:02:35.345 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c6442cf2:::obj-1-455:head# 2024-05-08T18:02:35.346 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c6619413:::obj-1-37:head# 2024-05-08T18:02:35.346 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c6c2f8e5:::obj-1-519:head# 2024-05-08T18:02:35.347 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c6f811a2:::obj-1-180:head# 2024-05-08T18:02:35.348 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c72af975:::obj-1-21:head# 2024-05-08T18:02:35.348 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c73eb350:::obj-1-356:head# 2024-05-08T18:02:35.349 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c7a683da:::obj-1-410:head# 2024-05-08T18:02:35.350 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c7eb9bcc:::obj-1-553:head# 2024-05-08T18:02:35.350 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c886df99:::obj-1-269:head# 2024-05-08T18:02:35.351 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c932e3ec:::obj-1-135:head# 2024-05-08T18:02:35.351 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c9b6507a:::obj-1-520:head# 2024-05-08T18:02:35.352 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:c9e3b064:::obj-1-244:head# 2024-05-08T18:02:35.352 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cb705d66:::obj-1-377:head# 2024-05-08T18:02:35.353 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cc80e25c:::obj-1-115:head# 2024-05-08T18:02:35.354 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cd1ec88e:::obj-1-297:head# 2024-05-08T18:02:35.354 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cd7e6936:::obj-1-234:head# 2024-05-08T18:02:35.355 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ce32b69c:::obj-1-30:head# 2024-05-08T18:02:35.356 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cf2b123c:::obj-1-293:head# 2024-05-08T18:02:35.356 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cf2e80a9:::obj-1-542:head# 2024-05-08T18:02:35.357 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cf51da6a:::obj-1-284:head# 2024-05-08T18:02:35.358 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cf590f42:::obj-1-381:head# 2024-05-08T18:02:35.358 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cf68a2b1:::obj-1-68:head# 2024-05-08T18:02:35.359 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cf6aefb6:::obj-1-28:head# 2024-05-08T18:02:35.359 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:cfd8e6af:::obj-1-105:head# 2024-05-08T18:02:35.360 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d0640bad:::obj-1-254:head# 2024-05-08T18:02:35.361 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d101cda5:::obj-1-259:head# 2024-05-08T18:02:35.361 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d1be9386:::obj-1-416:head# 2024-05-08T18:02:35.362 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d243f036:::obj-1-265:head# 2024-05-08T18:02:35.362 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d2808c34:::obj-1-159:head# 2024-05-08T18:02:35.363 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d3415824:::obj-1-39:head# 2024-05-08T18:02:35.363 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d424f07a:::obj-1-547:head# 2024-05-08T18:02:35.364 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d44139f2:::obj-1-289:head# 2024-05-08T18:02:35.365 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d46015ab:::obj-1-546:head# 2024-05-08T18:02:35.366 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d4e503db:::obj-1-525:head# 2024-05-08T18:02:35.367 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d4e97d18:::obj-1-85:head# 2024-05-08T18:02:35.367 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d511492e:::obj-1-388:head# 2024-05-08T18:02:35.368 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d526a7fa:::obj-1-12:head# 2024-05-08T18:02:35.368 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d5667b59:::obj-1-369:head# 2024-05-08T18:02:35.369 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d57f2261:::obj-1-419:head# 2024-05-08T18:02:35.370 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d57f281b:::obj-1-250:head# 2024-05-08T18:02:35.371 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d6e05894:::obj-1-166:head# 2024-05-08T18:02:35.371 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d7689481:::obj-1-424:head# 2024-05-08T18:02:35.372 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d7d27743:::obj-1-129:head# 2024-05-08T18:02:35.372 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d7e4d3e9:::obj-1-127:head# 2024-05-08T18:02:35.373 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d7f1422a:::obj-1-594:head# 2024-05-08T18:02:35.373 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d8469fd2:::obj-1-153:head# 2024-05-08T18:02:35.373 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d84efd9e:::obj-1-435:head# 2024-05-08T18:02:35.374 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d883004b:::obj-1-162:head# 2024-05-08T18:02:35.374 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d8b60854:::obj-1-257:head# 2024-05-08T18:02:35.375 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d91aaae6:::obj-1-1:head# 2024-05-08T18:02:35.375 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d98695ca:::obj-1-524:head# 2024-05-08T18:02:35.376 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:d9ae97c8:::obj-1-177:head# 2024-05-08T18:02:35.377 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:da1713bd:::obj-1-309:head# 2024-05-08T18:02:35.378 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:da37824c:::obj-1-2:head# 2024-05-08T18:02:35.378 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:dab221b0:::obj-1-526:head# 2024-05-08T18:02:35.379 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:db27d885:::obj-1-363:head# 2024-05-08T18:02:35.380 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:dc001d76:::obj-1-329:head# 2024-05-08T18:02:35.381 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:dc4f4119:::obj-1-122:head# 2024-05-08T18:02:35.381 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:dcc36eb7:::obj-1-283:head# 2024-05-08T18:02:35.382 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:df7da06c:::obj-1-124:head# 2024-05-08T18:02:35.382 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:df7fcacb:::obj-1-330:head# 2024-05-08T18:02:35.383 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e05cbe31:::obj-1-413:head# 2024-05-08T18:02:35.384 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e1060a54:::obj-1-384:head# 2024-05-08T18:02:35.384 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e15b839b:::obj-1-316:head# 2024-05-08T18:02:35.385 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e161b6e5:::obj-1-103:head# 2024-05-08T18:02:35.386 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e1d1d79c:::obj-1-512:head# 2024-05-08T18:02:35.387 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e224b482:::obj-1-501:head# 2024-05-08T18:02:35.388 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e22d6f76:::obj-1-70:head# 2024-05-08T18:02:35.388 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e2bd801c:::obj-1-523:head# 2024-05-08T18:02:35.389 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e3d9f395:::obj-1-397:head# 2024-05-08T18:02:35.390 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e474ea25:::obj-1-457:head# 2024-05-08T18:02:35.390 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e49e1ff3:::obj-1-130:head# 2024-05-08T18:02:35.391 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e56c67a0:::obj-1-191:head# 2024-05-08T18:02:35.391 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e576e921:::obj-1-376:head# 2024-05-08T18:02:35.392 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e619fd26:::obj-1-395:head# 2024-05-08T18:02:35.393 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e625bdc5:::obj-1-522:head# 2024-05-08T18:02:35.393 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e68a0fa6:::obj-1-394:head# 2024-05-08T18:02:35.394 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e6cf260f:::obj-1-77:head# 2024-05-08T18:02:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e6d6255a:::obj-1-108:head# 2024-05-08T18:02:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e7a35d2f:::obj-1-116:head# 2024-05-08T18:02:35.396 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e7b07de5:::obj-1-238:head# 2024-05-08T18:02:35.396 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e8037aba:::obj-1-404:head# 2024-05-08T18:02:35.397 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e8e8b34f:::obj-1-291:head# 2024-05-08T18:02:35.398 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:e987cd7a:::obj-1-123:head# 2024-05-08T18:02:35.398 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ea534db1:::obj-1-311:head# 2024-05-08T18:02:35.399 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:eabcc188:::obj-1-325:head# 2024-05-08T18:02:35.400 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:eb086660:::obj-1-595:head# 2024-05-08T18:02:35.400 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:eb2235d3:::obj-1-596:head# 2024-05-08T18:02:35.400 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:eb35ae40:::obj-1-516:head# 2024-05-08T18:02:35.401 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:eb360a13:::obj-1-224:head# 2024-05-08T18:02:35.401 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:eb3a3ea1:::obj-1-120:head# 2024-05-08T18:02:35.402 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ebca9f6e:::obj-1-290:head# 2024-05-08T18:02:35.403 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ec81db71:::obj-1-478:head# 2024-05-08T18:02:35.403 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:edeafa4c:::obj-1-362:head# 2024-05-08T18:02:35.404 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:eeb5261b:::obj-1-539:head# 2024-05-08T18:02:35.405 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:eec00eee:::obj-1-567:head# 2024-05-08T18:02:35.405 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ef075e10:::obj-1-463:head# 2024-05-08T18:02:35.406 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ef8e37d9:::obj-1-94:head# 2024-05-08T18:02:35.407 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:efad7f67:::obj-1-197:head# 2024-05-08T18:02:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:efe09ea7:::obj-1-537:head# 2024-05-08T18:02:35.409 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f0445019:::obj-1-480:head# 2024-05-08T18:02:35.410 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f08a432c:::obj-1-489:head# 2024-05-08T18:02:35.410 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f0bd9006:::obj-1-487:head# 2024-05-08T18:02:35.411 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f11a115d:::obj-1-591:head# 2024-05-08T18:02:35.412 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f232e0af:::obj-1-146:head# 2024-05-08T18:02:35.412 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f258db54:::obj-1-521:head# 2024-05-08T18:02:35.413 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f29cc204:::obj-1-566:head# 2024-05-08T18:02:35.413 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f2ae2451:::obj-1-66:head# 2024-05-08T18:02:35.414 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f318810a:::obj-1-160:head# 2024-05-08T18:02:35.415 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f3c35a0d:::obj-1-67:head# 2024-05-08T18:02:35.415 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f3ce9c90:::obj-1-88:head# 2024-05-08T18:02:35.416 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f3e3e81f:::obj-1-304:head# 2024-05-08T18:02:35.416 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f3f65b0a:::obj-1-367:head# 2024-05-08T18:02:35.417 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f4ea014b:::obj-1-149:head# 2024-05-08T18:02:35.417 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f52d115b:::obj-1-383:head# 2024-05-08T18:02:35.418 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f590311e:::obj-1-76:head# 2024-05-08T18:02:35.418 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f5a37734:::obj-1-51:head# 2024-05-08T18:02:35.419 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f5e2e77c:::obj-1-179:head# 2024-05-08T18:02:35.420 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f5e381bc:::obj-1-173:head# 2024-05-08T18:02:35.420 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f6c0ae0b:::obj-1-247:head# 2024-05-08T18:02:35.421 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f6db8a82:::obj-1-548:head# 2024-05-08T18:02:35.422 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f6e2dc46:::obj-1-36:head# 2024-05-08T18:02:35.422 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f76ee569:::obj-1-587:head# 2024-05-08T18:02:35.423 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f773b9ed:::obj-1-550:head# 2024-05-08T18:02:35.423 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f7e1adad:::obj-1-350:head# 2024-05-08T18:02:35.424 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f7eebf7a:::obj-1-559:head# 2024-05-08T18:02:35.425 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f877f025:::obj-1-187:head# 2024-05-08T18:02:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f992f9e9:::obj-1-402:head# 2024-05-08T18:02:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:f9fe960a:::obj-1-418:head# 2024-05-08T18:02:35.427 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:fa9b882f:::obj-1-165:head# 2024-05-08T18:02:35.427 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:fbd6461c:::obj-1-339:head# 2024-05-08T18:02:35.428 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:fbeab28d:::obj-1-431:head# 2024-05-08T18:02:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:fdea4138:::obj-1-185:head# 2024-05-08T18:02:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:fdfa7c9b:::obj-1-183:head# 2024-05-08T18:02:35.430 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:fe1ba57e:::obj-1-90:head# 2024-05-08T18:02:35.430 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:feb7adea:::obj-1-560:head# 2024-05-08T18:02:35.431 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ffab306e:::obj-1-97:head# 2024-05-08T18:02:35.432 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ffdfd397:::obj-1-433:head# 2024-05-08T18:02:35.433 INFO:tasks.workunit.client.0.smithi117.stderr:Read #2:ffe8cf04:::obj-1-303:head# 2024-05-08T18:02:35.434 INFO:tasks.workunit.client.0.smithi117.stderr:Export successful 2024-05-08T18:02:35.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/osd-backfill-space 2 2024-05-08T18:02:35.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/osd-backfill-space 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2024-05-08T18:02:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2024-05-08T18:02:35.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:02:35.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2024-05-08T18:02:35.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:02:35.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:02:35.726 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:02:35.726 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:02:35.726 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:02:35.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:start osd.2 2024-05-08T18:02:35.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:02:35.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/osd-backfill-space/2/whoami 2024-05-08T18:02:35.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2024-05-08T18:02:35.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2024-05-08T18:02:35.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2024-05-08T18:02:35.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2024-05-08T18:02:35.766 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:02:35.769+0000 7f47761797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:02:35.768 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:02:35.769+0000 7f47761797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:02:35.770 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:02:35.773+0000 7f47761797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:02:36.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2024-05-08T18:02:36.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:02:36.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T18:02:36.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:02:36.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:02:36.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:02:36.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:02:36.199 INFO:tasks.workunit.client.0.smithi117.stderr:0 2024-05-08T18:02:36.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:02:36.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:02:36.335 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:02:36.337+0000 7f47761797c0 -1 Falling back to public interface 2024-05-08T18:02:36.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:02:37.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:02:37.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:02:37.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:02:37.653 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:02:37.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:02:37.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:02:38.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:02:39.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:02:39.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:02:39.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:02:39.089 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:02:39.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:02:39.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:02:39.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:02:39.225+0000 7f47761797c0 -1 osd.2 42 log_to_monitors true 2024-05-08T18:02:39.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:02:40.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:02:40.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:02:40.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:02:40.628 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:02:40.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:02:40.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:02:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:osd.2 up in weight 1 up_from 46 up_thru 46 down_at 43 last_clean_interval [15,42) [v2:127.0.0.1:6818/1148285337,v1:127.0.0.1:6819/1148285337] [v2:127.0.0.1:6820/1148285337,v1:127.0.0.1:6821/1148285337] exists,up 4205a16a-8ecb-4a91-9a81-75815dc07592 2024-05-08T18:02:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:02:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:02:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:02:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:491: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2024-05-08T18:02:41.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2024-05-08T18:02:41.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=160678 2024-05-08T18:02:41.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2024-05-08T18:02:41.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-05-08T18:02:41.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2024-05-08T18:02:41.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:02:41.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 160678 2024-05-08T18:02:41.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T18:02:41.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T18:02:41.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2024-05-08T18:02:41.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:02:41.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 160678 2024-05-08T18:02:41.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T18:02:41.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T18:02:41.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.2 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 160678 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:492: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --force --op remove --pgid 2.0 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T18:02:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2024-05-08T18:02:41.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T18:02:41.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2024-05-08T18:02:41.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --force --op remove --pgid 2.0 2024-05-08T18:02:42.564 INFO:tasks.workunit.client.0.smithi117.stderr:PG '2.0' not found 2024-05-08T18:02:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nodown: return 1 2024-05-08T18:02:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:493: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op import --pgid 2.0 --file td/osd-backfill-space/export.out 2024-05-08T18:02:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-05-08T18:02:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T18:02:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2024-05-08T18:02:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T18:02:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2024-05-08T18:02:43.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op import --pgid 2.0 --file td/osd-backfill-space/export.out 2024-05-08T18:02:43.882 INFO:tasks.workunit.client.0.smithi117.stdout:get_pg_num_history pg_num_history pg_num_history(e46 pg_nums {1={21=1},2={26=1},3={31=1}} deleted_pools ) 2024-05-08T18:02:43.883 INFO:tasks.workunit.client.0.smithi117.stdout:Importing pgid 2.0 2024-05-08T18:02:43.884 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:00f101c6:::obj-1-121:head# 2024-05-08T18:02:43.884 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.015 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0168051e:::obj-1-571:head# 2024-05-08T18:02:44.016 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.066 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:01b67738:::obj-1-182:head# 2024-05-08T18:02:44.066 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.099 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:040dbc59:::obj-1-23:head# 2024-05-08T18:02:44.100 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.133 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0415ce6e:::obj-1-20:head# 2024-05-08T18:02:44.133 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.166 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:058b28d7:::obj-1-572:head# 2024-05-08T18:02:44.166 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.208 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:059d2e5c:::obj-1-87:head# 2024-05-08T18:02:44.208 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.260 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:05a823ca:::obj-1-52:head# 2024-05-08T18:02:44.260 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.346 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:05b8b7fe:::obj-1-119:head# 2024-05-08T18:02:44.346 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.417 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:05c9492b:::obj-1-78:head# 2024-05-08T18:02:44.417 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.451 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:05e91e96:::obj-1-393:head# 2024-05-08T18:02:44.451 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.484 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:07bdb780:::obj-1-204:head# 2024-05-08T18:02:44.484 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.518 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:07cfbd49:::obj-1-318:head# 2024-05-08T18:02:44.518 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.551 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:084a829f:::obj-1-112:head# 2024-05-08T18:02:44.551 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.585 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:08cedd34:::obj-1-438:head# 2024-05-08T18:02:44.585 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.626 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0941af69:::obj-1-117:head# 2024-05-08T18:02:44.627 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.668 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:09607265:::obj-1-429:head# 2024-05-08T18:02:44.668 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.710 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0be86f7e:::obj-1-568:head# 2024-05-08T18:02:44.710 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.752 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0ca5819d:::obj-1-327:head# 2024-05-08T18:02:44.752 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.794 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0cd02051:::obj-1-208:head# 2024-05-08T18:02:44.794 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.852 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0d0264b5:::obj-1-171:head# 2024-05-08T18:02:44.852 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.894 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0d195060:::obj-1-420:head# 2024-05-08T18:02:44.894 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.935 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0d362b19:::obj-1-219:head# 2024-05-08T18:02:44.936 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:44.977 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0dea6f4d:::obj-1-61:head# 2024-05-08T18:02:44.977 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.019 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0ecd8390:::obj-1-132:head# 2024-05-08T18:02:45.019 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.061 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0f49e2fa:::obj-1-200:head# 2024-05-08T18:02:45.061 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.103 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0f7bb95f:::obj-1-268:head# 2024-05-08T18:02:45.103 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.144 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0fabf252:::obj-1-441:head# 2024-05-08T18:02:45.145 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.186 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:0fb1697a:::obj-1-443:head# 2024-05-08T18:02:45.186 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.237 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:105d3efe:::obj-1-490:head# 2024-05-08T18:02:45.237 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.278 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:10f52c01:::obj-1-449:head# 2024-05-08T18:02:45.279 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.320 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:11965425:::obj-1-335:head# 2024-05-08T18:02:45.320 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.362 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:11c9f5f8:::obj-1-565:head# 2024-05-08T18:02:45.362 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.404 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:11cfcfb6:::obj-1-588:head# 2024-05-08T18:02:45.404 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.445 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:11d46f0a:::obj-1-387:head# 2024-05-08T18:02:45.446 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.487 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:11ebb0d6:::obj-1-214:head# 2024-05-08T18:02:45.487 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.529 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1295e402:::obj-1-178:head# 2024-05-08T18:02:45.529 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.571 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:12c996c1:::obj-1-517:head# 2024-05-08T18:02:45.571 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.605 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:133dec15:::obj-1-475:head# 2024-05-08T18:02:45.605 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.638 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1475c981:::obj-1-505:head# 2024-05-08T18:02:45.638 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.671 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:148e92a4:::obj-1-509:head# 2024-05-08T18:02:45.672 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.705 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1490b121:::obj-1-172:head# 2024-05-08T18:02:45.705 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.738 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:14ce082c:::obj-1-99:head# 2024-05-08T18:02:45.738 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.772 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1552ad99:::obj-1-41:head# 2024-05-08T18:02:45.772 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.847 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:15544270:::obj-1-271:head# 2024-05-08T18:02:45.847 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.910 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1589d957:::obj-1-86:head# 2024-05-08T18:02:45.910 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:45.998 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:16db3947:::obj-1-477:head# 2024-05-08T18:02:45.998 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.073 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:16dc98bd:::obj-1-375:head# 2024-05-08T18:02:46.073 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.107 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:17e54db3:::obj-1-196:head# 2024-05-08T18:02:46.107 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.140 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:17f2ad3f:::obj-1-10:head# 2024-05-08T18:02:46.140 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.190 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:18075e41:::obj-1-55:head# 2024-05-08T18:02:46.190 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.224 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:18086253:::obj-1-71:head# 2024-05-08T18:02:46.224 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.299 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:191cf8d8:::obj-1-372:head# 2024-05-08T18:02:46.299 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.358 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:19311f70:::obj-1-454:head# 2024-05-08T18:02:46.358 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.425 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:198318e4:::obj-1-464:head# 2024-05-08T18:02:46.425 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.458 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1999d806:::obj-1-163:head# 2024-05-08T18:02:46.458 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.491 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1a92cab7:::obj-1-412:head# 2024-05-08T18:02:46.492 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.525 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1b16c0f6:::obj-1-210:head# 2024-05-08T18:02:46.525 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.558 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1b53ed46:::obj-1-577:head# 2024-05-08T18:02:46.559 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.592 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1b5c5a8d:::obj-1-556:head# 2024-05-08T18:02:46.592 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.626 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1c12c05e:::obj-1-79:head# 2024-05-08T18:02:46.626 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.659 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1c571ba5:::obj-1-262:head# 2024-05-08T18:02:46.659 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.692 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1c5f42b7:::obj-1-92:head# 2024-05-08T18:02:46.692 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.726 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1c6ad881:::obj-1-312:head# 2024-05-08T18:02:46.726 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.782 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1c89877b:::obj-1-142:head# 2024-05-08T18:02:46.782 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.834 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1e4168ca:::obj-1-282:head# 2024-05-08T18:02:46.834 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.868 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1e424445:::obj-1-484:head# 2024-05-08T18:02:46.868 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.901 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1e467959:::obj-1-22:head# 2024-05-08T18:02:46.902 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.935 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1eaf7e7c:::obj-1-392:head# 2024-05-08T18:02:46.935 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.952 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1f06c86d:::obj-1-307:head# 2024-05-08T18:02:46.952 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:46.994 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1f2ee1f8:::obj-1-306:head# 2024-05-08T18:02:46.994 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.010 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:1f4ef040:::obj-1-349:head# 2024-05-08T18:02:47.010 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.027 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2039481f:::obj-1-545:head# 2024-05-08T18:02:47.027 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.044 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:22233df0:::obj-1-543:head# 2024-05-08T18:02:47.044 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.060 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2225184e:::obj-1-266:head# 2024-05-08T18:02:47.060 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.077 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:234766bb:::obj-1-281:head# 2024-05-08T18:02:47.077 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.094 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2372e022:::obj-1-205:head# 2024-05-08T18:02:47.094 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.110 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2379547b:::obj-1-113:head# 2024-05-08T18:02:47.111 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.127 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:23ae14bf:::obj-1-531:head# 2024-05-08T18:02:47.127 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.144 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:23bc5f90:::obj-1-452:head# 2024-05-08T18:02:47.144 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.160 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:23fbef3d:::obj-1-82:head# 2024-05-08T18:02:47.161 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.177 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:24106c2b:::obj-1-232:head# 2024-05-08T18:02:47.177 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.194 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2529b4e4:::obj-1-75:head# 2024-05-08T18:02:47.194 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.210 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:25a24ae7:::obj-1-459:head# 2024-05-08T18:02:47.211 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.227 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:26627aa9:::obj-1-7:head# 2024-05-08T18:02:47.227 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.244 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:26b77221:::obj-1-227:head# 2024-05-08T18:02:47.244 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.261 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:27450826:::obj-1-344:head# 2024-05-08T18:02:47.261 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.277 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:278905af:::obj-1-592:head# 2024-05-08T18:02:47.277 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.294 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:27ad0d2d:::obj-1-136:head# 2024-05-08T18:02:47.294 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.310 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:28a8c213:::obj-1-118:head# 2024-05-08T18:02:47.311 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.327 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:28c0c009:::obj-1-74:head# 2024-05-08T18:02:47.328 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.344 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2a214708:::obj-1-260:head# 2024-05-08T18:02:47.344 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.361 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2a67e195:::obj-1-474:head# 2024-05-08T18:02:47.361 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.377 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2aa852ff:::obj-1-5:head# 2024-05-08T18:02:47.377 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.394 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2ba1fb52:::obj-1-563:head# 2024-05-08T18:02:47.394 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.411 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2bae8cb9:::obj-1-320:head# 2024-05-08T18:02:47.411 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.427 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2c569d02:::obj-1-139:head# 2024-05-08T18:02:47.428 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.444 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2c71d691:::obj-1-201:head# 2024-05-08T18:02:47.444 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.461 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2c88e92c:::obj-1-389:head# 2024-05-08T18:02:47.461 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.477 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2d659109:::obj-1-580:head# 2024-05-08T18:02:47.478 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.494 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2d74ea60:::obj-1-230:head# 2024-05-08T18:02:47.494 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.511 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2de96edf:::obj-1-233:head# 2024-05-08T18:02:47.511 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.528 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2e43da40:::obj-1-382:head# 2024-05-08T18:02:47.528 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.544 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2e530c9f:::obj-1-358:head# 2024-05-08T18:02:47.544 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.561 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:2ed02239:::obj-1-81:head# 2024-05-08T18:02:47.561 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.578 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:30264a0c:::obj-1-373:head# 2024-05-08T18:02:47.578 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.594 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:302ca5e7:::obj-1-206:head# 2024-05-08T18:02:47.594 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.611 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:309878e8:::obj-1-508:head# 2024-05-08T18:02:47.611 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.628 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:309a0ac3:::obj-1-188:head# 2024-05-08T18:02:47.628 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.644 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:30f030e9:::obj-1-53:head# 2024-05-08T18:02:47.645 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.661 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:31242a73:::obj-1-528:head# 2024-05-08T18:02:47.661 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.678 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:31463825:::obj-1-34:head# 2024-05-08T18:02:47.678 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.694 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3166dc86:::obj-1-355:head# 2024-05-08T18:02:47.694 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.711 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:31baa2fa:::obj-1-252:head# 2024-05-08T18:02:47.711 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.728 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:31d8935e:::obj-1-193:head# 2024-05-08T18:02:47.728 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.744 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:32670b14:::obj-1-305:head# 2024-05-08T18:02:47.745 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.761 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:33da02fa:::obj-1-114:head# 2024-05-08T18:02:47.761 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.778 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:34373133:::obj-1-446:head# 2024-05-08T18:02:47.778 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.826 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:347b7083:::obj-1-89:head# 2024-05-08T18:02:47.826 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.861 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:349125c1:::obj-1-148:head# 2024-05-08T18:02:47.861 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.878 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:34b80eee:::obj-1-138:head# 2024-05-08T18:02:47.878 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.895 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:34db48f8:::obj-1-49:head# 2024-05-08T18:02:47.895 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.911 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3669ff0c:::obj-1-313:head# 2024-05-08T18:02:47.911 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.928 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:36c1b610:::obj-1-249:head# 2024-05-08T18:02:47.928 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.945 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:374c250b:::obj-1-324:head# 2024-05-08T18:02:47.945 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.961 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3761a149:::obj-1-342:head# 2024-05-08T18:02:47.961 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.978 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:379ff95a:::obj-1-341:head# 2024-05-08T18:02:47.978 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:47.995 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:37dc15a6:::obj-1-26:head# 2024-05-08T18:02:47.995 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.011 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:38130e33:::obj-1-552:head# 2024-05-08T18:02:48.012 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.028 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:39c44880:::obj-1-538:head# 2024-05-08T18:02:48.028 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.045 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3a08dec9:::obj-1-368:head# 2024-05-08T18:02:48.045 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.062 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3a2b46a6:::obj-1-407:head# 2024-05-08T18:02:48.062 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.078 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3a7dfe0a:::obj-1-285:head# 2024-05-08T18:02:48.078 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.095 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3aebb144:::obj-1-248:head# 2024-05-08T18:02:48.095 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.111 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3b08b36f:::obj-1-310:head# 2024-05-08T18:02:48.112 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.128 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3b28ffa3:::obj-1-295:head# 2024-05-08T18:02:48.128 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.145 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3ba79bd1:::obj-1-444:head# 2024-05-08T18:02:48.145 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.161 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3c05df8d:::obj-1-319:head# 2024-05-08T18:02:48.162 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.178 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3c57e6a9:::obj-1-436:head# 2024-05-08T18:02:48.178 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.195 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3c73d8ee:::obj-1-298:head# 2024-05-08T18:02:48.195 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.212 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3cb6ae2a:::obj-1-400:head# 2024-05-08T18:02:48.212 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.228 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3cb71491:::obj-1-328:head# 2024-05-08T18:02:48.228 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.260 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3cb842fe:::obj-1-541:head# 2024-05-08T18:02:48.260 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.318 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3cf6835e:::obj-1-496:head# 2024-05-08T18:02:48.318 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.368 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3cf78507:::obj-1-573:head# 2024-05-08T18:02:48.368 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.412 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3d0dab84:::obj-1-554:head# 2024-05-08T18:02:48.412 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.428 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3d1a5f9d:::obj-1-323:head# 2024-05-08T18:02:48.428 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.445 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3da5f3a2:::obj-1-414:head# 2024-05-08T18:02:48.445 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.462 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3dbb65f0:::obj-1-440:head# 2024-05-08T18:02:48.462 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.478 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3dc94618:::obj-1-223:head# 2024-05-08T18:02:48.478 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.495 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3df3d5ab:::obj-1-25:head# 2024-05-08T18:02:48.495 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.512 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3e167988:::obj-1-336:head# 2024-05-08T18:02:48.512 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.528 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3e4ef3bd:::obj-1-104:head# 2024-05-08T18:02:48.528 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.545 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3e9e1efd:::obj-1-357:head# 2024-05-08T18:02:48.545 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.562 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3ebbe3a7:::obj-1-42:head# 2024-05-08T18:02:48.562 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.579 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3ec80373:::obj-1-403:head# 2024-05-08T18:02:48.579 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.595 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3ed086e4:::obj-1-13:head# 2024-05-08T18:02:48.595 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.612 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:3fe8e157:::obj-1-164:head# 2024-05-08T18:02:48.612 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.629 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:401ddfd4:::obj-1-379:head# 2024-05-08T18:02:48.629 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.646 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4092f6cd:::obj-1-430:head# 2024-05-08T18:02:48.646 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.662 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:414bd7cc:::obj-1-562:head# 2024-05-08T18:02:48.662 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.678 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:422bd9d0:::obj-1-287:head# 2024-05-08T18:02:48.679 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.695 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4255002d:::obj-1-578:head# 2024-05-08T18:02:48.695 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.712 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4270725c:::obj-1-109:head# 2024-05-08T18:02:48.712 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.728 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:42836669:::obj-1-31:head# 2024-05-08T18:02:48.729 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.745 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:428d93ef:::obj-1-32:head# 2024-05-08T18:02:48.745 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.762 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4327ef5b:::obj-1-453:head# 2024-05-08T18:02:48.762 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.779 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:440eb07b:::obj-1-236:head# 2024-05-08T18:02:48.779 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.795 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:442a028a:::obj-1-365:head# 2024-05-08T18:02:48.795 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.812 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:449ca54a:::obj-1-161:head# 2024-05-08T18:02:48.812 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.829 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:45128c3b:::obj-1-343:head# 2024-05-08T18:02:48.829 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.845 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:45801bf6:::obj-1-264:head# 2024-05-08T18:02:48.845 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.862 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:45896f61:::obj-1-48:head# 2024-05-08T18:02:48.862 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.879 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:459b7f1c:::obj-1-190:head# 2024-05-08T18:02:48.879 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.896 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:466af96a:::obj-1-486:head# 2024-05-08T18:02:48.896 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.914 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:47387ce4:::obj-1-575:head# 2024-05-08T18:02:48.914 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.931 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:47c94cc8:::obj-1-564:head# 2024-05-08T18:02:48.931 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.948 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:47d7f8ed:::obj-1-544:head# 2024-05-08T18:02:48.948 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.964 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:47fc0ec3:::obj-1-558:head# 2024-05-08T18:02:48.965 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.981 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:48ba42d8:::obj-1-156:head# 2024-05-08T18:02:48.981 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:48.998 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:494e269e:::obj-1-600:head# 2024-05-08T18:02:48.998 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.014 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:49646095:::obj-1-73:head# 2024-05-08T18:02:49.015 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.031 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:49eb65ab:::obj-1-374:head# 2024-05-08T18:02:49.031 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.048 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4a0075a4:::obj-1-432:head# 2024-05-08T18:02:49.048 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.073 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4af1ffc2:::obj-1-72:head# 2024-05-08T18:02:49.073 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.089 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4bc1c46f:::obj-1-346:head# 2024-05-08T18:02:49.089 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.106 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4bd55e68:::obj-1-93:head# 2024-05-08T18:02:49.106 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.123 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4c6d2760:::obj-1-198:head# 2024-05-08T18:02:49.123 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.140 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4cb9be3b:::obj-1-451:head# 2024-05-08T18:02:49.140 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.156 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4d260a64:::obj-1-514:head# 2024-05-08T18:02:49.156 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.173 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4d7d6284:::obj-1-583:head# 2024-05-08T18:02:49.173 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.189 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4e79ac02:::obj-1-437:head# 2024-05-08T18:02:49.190 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.206 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4e980099:::obj-1-507:head# 2024-05-08T18:02:49.206 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.224 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4ea8f99c:::obj-1-211:head# 2024-05-08T18:02:49.224 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.239 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2024-05-08T18:02:49.240 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.256 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4f97fd73:::obj-1-243:head# 2024-05-08T18:02:49.256 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.273 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4fe00224:::obj-1-229:head# 2024-05-08T18:02:49.273 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.290 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4fead9ab:::obj-1-476:head# 2024-05-08T18:02:49.290 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.307 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:4ffddfd7:::obj-1-462:head# 2024-05-08T18:02:49.307 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.323 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5085c04d:::obj-1-100:head# 2024-05-08T18:02:49.323 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.340 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:50a8b465:::obj-1-574:head# 2024-05-08T18:02:49.340 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.356 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:518a151f:::obj-1-189:head# 2024-05-08T18:02:49.357 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.373 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:519afc95:::obj-1-314:head# 2024-05-08T18:02:49.374 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.390 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:52199781:::obj-1-202:head# 2024-05-08T18:02:49.390 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.406 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:52313062:::obj-1-337:head# 2024-05-08T18:02:49.407 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.423 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:526a5196:::obj-1-225:head# 2024-05-08T18:02:49.424 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.440 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:53128d32:::obj-1-483:head# 2024-05-08T18:02:49.440 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.456 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:53c2bb21:::obj-1-532:head# 2024-05-08T18:02:49.456 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.473 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:53fa4f3c:::obj-1-423:head# 2024-05-08T18:02:49.473 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.490 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:541c1d30:::obj-1-143:head# 2024-05-08T18:02:49.490 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.507 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:548d20c3:::obj-1-352:head# 2024-05-08T18:02:49.507 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.523 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:54e4c6f9:::obj-1-101:head# 2024-05-08T18:02:49.565 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.566 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:55016e06:::obj-1-276:head# 2024-05-08T18:02:49.566 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.566 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5510c784:::obj-1-491:head# 2024-05-08T18:02:49.566 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.573 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:551275ef:::obj-1-239:head# 2024-05-08T18:02:49.573 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.590 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:556df001:::obj-1-46:head# 2024-05-08T18:02:49.590 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.607 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:558fb5b1:::obj-1-536:head# 2024-05-08T18:02:49.607 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.623 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:56390d98:::obj-1-64:head# 2024-05-08T18:02:49.624 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.640 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:564f962a:::obj-1-125:head# 2024-05-08T18:02:49.640 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.657 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:56936e94:::obj-1-251:head# 2024-05-08T18:02:49.657 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.674 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:57585d3d:::obj-1-294:head# 2024-05-08T18:02:49.674 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.690 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5764cf7b:::obj-1-479:head# 2024-05-08T18:02:49.690 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.707 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5782341a:::obj-1-218:head# 2024-05-08T18:02:49.707 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.724 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:57d07a1a:::obj-1-317:head# 2024-05-08T18:02:49.724 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.740 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:58700205:::obj-1-176:head# 2024-05-08T18:02:49.740 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.757 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:58aee718:::obj-1-434:head# 2024-05-08T18:02:49.757 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.773 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:594c9d52:::obj-1-458:head# 2024-05-08T18:02:49.774 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.802 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5a70b555:::obj-1-279:head# 2024-05-08T18:02:49.802 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.852 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5b02568b:::obj-1-586:head# 2024-05-08T18:02:49.852 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.874 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5b69cdcf:::obj-1-391:head# 2024-05-08T18:02:49.874 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.890 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5cf151b5:::obj-1-510:head# 2024-05-08T18:02:49.890 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.907 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5d7fd07f:::obj-1-152:head# 2024-05-08T18:02:49.907 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.924 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5de288d7:::obj-1-235:head# 2024-05-08T18:02:49.924 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.940 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5ec497cd:::obj-1-44:head# 2024-05-08T18:02:49.940 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.957 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5fb3a09f:::obj-1-518:head# 2024-05-08T18:02:49.957 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.974 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:5ff3c2ef:::obj-1-470:head# 2024-05-08T18:02:49.974 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:49.990 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:601efcb1:::obj-1-549:head# 2024-05-08T18:02:49.991 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.007 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:60831338:::obj-1-263:head# 2024-05-08T18:02:50.007 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.024 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6092777b:::obj-1-145:head# 2024-05-08T18:02:50.024 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.040 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:60b17206:::obj-1-411:head# 2024-05-08T18:02:50.040 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.057 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:610c957c:::obj-1-278:head# 2024-05-08T18:02:50.057 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.074 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:613b5ef4:::obj-1-504:head# 2024-05-08T18:02:50.074 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.090 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:61ed7d60:::obj-1-274:head# 2024-05-08T18:02:50.091 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.107 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:621b6751:::obj-1-212:head# 2024-05-08T18:02:50.107 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.124 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:62b0aba9:::obj-1-253:head# 2024-05-08T18:02:50.124 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.141 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:64017240:::obj-1-102:head# 2024-05-08T18:02:50.141 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.157 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:645f4f49:::obj-1-332:head# 2024-05-08T18:02:50.157 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.174 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:65db82b9:::obj-1-334:head# 2024-05-08T18:02:50.174 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.190 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:667422e5:::obj-1-465:head# 2024-05-08T18:02:50.191 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.207 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:66c50bc2:::obj-1-322:head# 2024-05-08T18:02:50.207 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.224 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:681a4577:::obj-1-511:head# 2024-05-08T18:02:50.224 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.241 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6874e007:::obj-1-398:head# 2024-05-08T18:02:50.241 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.301 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:693746c1:::obj-1-582:head# 2024-05-08T18:02:50.301 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.341 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:69638b0c:::obj-1-8:head# 2024-05-08T18:02:50.341 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.411 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6967de6e:::obj-1-331:head# 2024-05-08T18:02:50.411 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.441 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:69da97aa:::obj-1-340:head# 2024-05-08T18:02:50.441 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.457 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6b3a50a6:::obj-1-144:head# 2024-05-08T18:02:50.457 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.474 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6be4ef26:::obj-1-579:head# 2024-05-08T18:02:50.474 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.491 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6d735549:::obj-1-599:head# 2024-05-08T18:02:50.491 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.508 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6e22c25e:::obj-1-9:head# 2024-05-08T18:02:50.508 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.524 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6e2ced4e:::obj-1-370:head# 2024-05-08T18:02:50.524 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.541 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6e961169:::obj-1-428:head# 2024-05-08T18:02:50.541 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.558 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6efcbbee:::obj-1-168:head# 2024-05-08T18:02:50.558 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.574 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6f20741c:::obj-1-33:head# 2024-05-08T18:02:50.574 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.591 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6fe4c885:::obj-1-273:head# 2024-05-08T18:02:50.591 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.608 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:6fffdea2:::obj-1-425:head# 2024-05-08T18:02:50.608 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.624 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:70716852:::obj-1-593:head# 2024-05-08T18:02:50.624 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.641 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:70919606:::obj-1-515:head# 2024-05-08T18:02:50.641 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.657 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:70c39d76:::obj-1-467:head# 2024-05-08T18:02:50.657 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.674 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:70f57ad3:::obj-1-361:head# 2024-05-08T18:02:50.674 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.691 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7177c7b5:::obj-1-503:head# 2024-05-08T18:02:50.691 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.708 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:719b69bd:::obj-1-497:head# 2024-05-08T18:02:50.708 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.724 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:724f9347:::obj-1-6:head# 2024-05-08T18:02:50.724 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.741 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:726d9f6b:::obj-1-111:head# 2024-05-08T18:02:50.741 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.758 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:72a91baf:::obj-1-439:head# 2024-05-08T18:02:50.758 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.774 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:72aa43ee:::obj-1-534:head# 2024-05-08T18:02:50.774 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.791 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:72c40e11:::obj-1-288:head# 2024-05-08T18:02:50.791 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.808 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:74196d45:::obj-1-246:head# 2024-05-08T18:02:50.808 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.825 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:743f42b1:::obj-1-326:head# 2024-05-08T18:02:50.825 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.841 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7523b538:::obj-1-494:head# 2024-05-08T18:02:50.842 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.858 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:75310ed6:::obj-1-364:head# 2024-05-08T18:02:50.858 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.875 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7568e0bc:::obj-1-585:head# 2024-05-08T18:02:50.875 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.892 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:760219a3:::obj-1-353:head# 2024-05-08T18:02:50.892 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.909 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:763338c9:::obj-1-555:head# 2024-05-08T18:02:50.909 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.925 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:77bc2d65:::obj-1-386:head# 2024-05-08T18:02:50.925 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.941 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:77ed0c7a:::obj-1-492:head# 2024-05-08T18:02:50.941 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.958 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:785a4052:::obj-1-456:head# 2024-05-08T18:02:50.958 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.975 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:796799c3:::obj-1-195:head# 2024-05-08T18:02:50.975 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:50.991 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:79caf0c1:::obj-1-445:head# 2024-05-08T18:02:50.991 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.008 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7af5b3e4:::obj-1-217:head# 2024-05-08T18:02:51.008 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.025 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7b3a9063:::obj-1-169:head# 2024-05-08T18:02:51.025 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.041 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7b509a92:::obj-1-561:head# 2024-05-08T18:02:51.041 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.058 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7bc646b1:::obj-1-415:head# 2024-05-08T18:02:51.058 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.075 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7c2f9188:::obj-1-482:head# 2024-05-08T18:02:51.075 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.091 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7d0da936:::obj-1-11:head# 2024-05-08T18:02:51.092 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.133 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2024-05-08T18:02:51.133 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.150 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7d64f81e:::obj-1-473:head# 2024-05-08T18:02:51.150 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.167 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7ef2ea1b:::obj-1-417:head# 2024-05-08T18:02:51.167 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.183 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7f52b238:::obj-1-308:head# 2024-05-08T18:02:51.183 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.200 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:7f7a313c:::obj-1-551:head# 2024-05-08T18:02:51.200 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.217 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:806827a7:::obj-1-472:head# 2024-05-08T18:02:51.217 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.233 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8112c3ab:::obj-1-45:head# 2024-05-08T18:02:51.233 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.250 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:81365b55:::obj-1-315:head# 2024-05-08T18:02:51.250 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.267 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:818ffdc3:::obj-1-345:head# 2024-05-08T18:02:51.267 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.283 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:81babab8:::obj-1-535:head# 2024-05-08T18:02:51.283 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.300 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8288f652:::obj-1-347:head# 2024-05-08T18:02:51.300 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.317 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8312eadd:::obj-1-14:head# 2024-05-08T18:02:51.317 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.333 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:83b89bc7:::obj-1-137:head# 2024-05-08T18:02:51.334 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.350 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:84a12321:::obj-1-134:head# 2024-05-08T18:02:51.350 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.367 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:84b26d62:::obj-1-408:head# 2024-05-08T18:02:51.367 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.383 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:84bbb26e:::obj-1-43:head# 2024-05-08T18:02:51.384 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.400 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:86fc0014:::obj-1-222:head# 2024-05-08T18:02:51.400 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.417 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:87488bf4:::obj-1-174:head# 2024-05-08T18:02:51.417 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.434 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8754389a:::obj-1-65:head# 2024-05-08T18:02:51.434 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.450 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:87a6ad67:::obj-1-366:head# 2024-05-08T18:02:51.450 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.467 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:87d32b83:::obj-1-513:head# 2024-05-08T18:02:51.467 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.483 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8813a346:::obj-1-540:head# 2024-05-08T18:02:51.484 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.500 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:88146951:::obj-1-216:head# 2024-05-08T18:02:51.500 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.517 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8820800d:::obj-1-83:head# 2024-05-08T18:02:51.517 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.534 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:88319745:::obj-1-98:head# 2024-05-08T18:02:51.534 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.550 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:88c969b8:::obj-1-54:head# 2024-05-08T18:02:51.550 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.600 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:895a2d53:::obj-1-150:head# 2024-05-08T18:02:51.600 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.617 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8ae006a0:::obj-1-241:head# 2024-05-08T18:02:51.617 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.634 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8bd44e64:::obj-1-300:head# 2024-05-08T18:02:51.634 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.650 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8beb257f:::obj-1-3:head# 2024-05-08T18:02:51.651 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.667 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8cd8c743:::obj-1-527:head# 2024-05-08T18:02:51.667 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.684 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8daa99c7:::obj-1-237:head# 2024-05-08T18:02:51.684 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.700 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8f5bccbf:::obj-1-59:head# 2024-05-08T18:02:51.700 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.717 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8f6d9945:::obj-1-151:head# 2024-05-08T18:02:51.717 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.734 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8f7c568c:::obj-1-261:head# 2024-05-08T18:02:51.734 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.759 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:8fbc59a9:::obj-1-589:head# 2024-05-08T18:02:51.759 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.785 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:90225d94:::obj-1-194:head# 2024-05-08T18:02:51.785 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.842 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:904c50d3:::obj-1-63:head# 2024-05-08T18:02:51.843 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.884 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:90e1bd79:::obj-1-450:head# 2024-05-08T18:02:51.884 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.900 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9274b06d:::obj-1-460:head# 2024-05-08T18:02:51.900 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.917 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:92af41f5:::obj-1-409:head# 2024-05-08T18:02:51.917 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.934 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:935a08d6:::obj-1-192:head# 2024-05-08T18:02:51.934 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.950 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:935f8a13:::obj-1-24:head# 2024-05-08T18:02:51.951 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.967 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:95230148:::obj-1-280:head# 2024-05-08T18:02:51.967 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:51.984 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:95342eb0:::obj-1-390:head# 2024-05-08T18:02:51.984 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.000 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9659d09c:::obj-1-292:head# 2024-05-08T18:02:52.001 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.017 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:970e8cb4:::obj-1-18:head# 2024-05-08T18:02:52.017 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.034 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:97d21cf1:::obj-1-80:head# 2024-05-08T18:02:52.034 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.051 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:982bdb12:::obj-1-302:head# 2024-05-08T18:02:52.051 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.068 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:985dfd75:::obj-1-91:head# 2024-05-08T18:02:52.068 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.084 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:986d245a:::obj-1-154:head# 2024-05-08T18:02:52.085 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.101 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:98a03e99:::obj-1-529:head# 2024-05-08T18:02:52.101 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.118 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:98b7103e:::obj-1-275:head# 2024-05-08T18:02:52.118 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.134 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:990f0ecf:::obj-1-427:head# 2024-05-08T18:02:52.135 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.151 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:996c1f26:::obj-1-96:head# 2024-05-08T18:02:52.151 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.167 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:99bd2018:::obj-1-17:head# 2024-05-08T18:02:52.168 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.184 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9a7434c9:::obj-1-469:head# 2024-05-08T18:02:52.184 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.201 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9a8e36cc:::obj-1-598:head# 2024-05-08T18:02:52.201 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.217 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9abcc369:::obj-1-442:head# 2024-05-08T18:02:52.218 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.234 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9b0ea06e:::obj-1-231:head# 2024-05-08T18:02:52.234 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.292 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9b34e80d:::obj-1-378:head# 2024-05-08T18:02:52.292 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.345 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9b55a2a9:::obj-1-60:head# 2024-05-08T18:02:52.346 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.404 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9be3f2da:::obj-1-597:head# 2024-05-08T18:02:52.404 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.426 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9bf62c88:::obj-1-447:head# 2024-05-08T18:02:52.426 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.442 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9c31857b:::obj-1-272:head# 2024-05-08T18:02:52.443 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.459 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9c533e91:::obj-1-19:head# 2024-05-08T18:02:52.459 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.477 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9ca70688:::obj-1-570:head# 2024-05-08T18:02:52.477 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.493 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9ccce337:::obj-1-147:head# 2024-05-08T18:02:52.493 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.509 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9d4b2dfc:::obj-1-267:head# 2024-05-08T18:02:52.509 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.526 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9d4df969:::obj-1-286:head# 2024-05-08T18:02:52.526 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.544 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9d714651:::obj-1-495:head# 2024-05-08T18:02:52.544 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.559 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9da65518:::obj-1-498:head# 2024-05-08T18:02:52.560 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.576 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9e94f27b:::obj-1-209:head# 2024-05-08T18:02:52.576 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.593 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9f39e910:::obj-1-354:head# 2024-05-08T18:02:52.593 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.609 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9f8f9ef4:::obj-1-226:head# 2024-05-08T18:02:52.609 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.626 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:9fcd3f36:::obj-1-47:head# 2024-05-08T18:02:52.626 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.643 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a0326d7d:::obj-1-338:head# 2024-05-08T18:02:52.643 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.659 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a05e7475:::obj-1-62:head# 2024-05-08T18:02:52.660 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.676 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a0955052:::obj-1-533:head# 2024-05-08T18:02:52.676 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.693 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a0aa6848:::obj-1-38:head# 2024-05-08T18:02:52.693 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.710 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a0fdc285:::obj-1-133:head# 2024-05-08T18:02:52.710 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.726 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a10290b8:::obj-1-245:head# 2024-05-08T18:02:52.726 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.743 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a118a8a8:::obj-1-500:head# 2024-05-08T18:02:52.743 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.760 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a11a4079:::obj-1-199:head# 2024-05-08T18:02:52.760 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.776 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a1b3ec36:::obj-1-15:head# 2024-05-08T18:02:52.776 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.793 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a1f5079b:::obj-1-468:head# 2024-05-08T18:02:52.793 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.810 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a1ff04b5:::obj-1-167:head# 2024-05-08T18:02:52.810 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.826 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a21cc437:::obj-1-128:head# 2024-05-08T18:02:52.826 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.843 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a2966c77:::obj-1-140:head# 2024-05-08T18:02:52.843 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.860 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a321e537:::obj-1-184:head# 2024-05-08T18:02:52.860 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.918 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a33418d8:::obj-1-488:head# 2024-05-08T18:02:52.918 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.935 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a38b1c1a:::obj-1-584:head# 2024-05-08T18:02:52.935 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.952 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a3f83221:::obj-1-158:head# 2024-05-08T18:02:52.952 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.968 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a46e33eb:::obj-1-106:head# 2024-05-08T18:02:52.968 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:52.985 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a491460d:::obj-1-421:head# 2024-05-08T18:02:52.985 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.001 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a4dd813b:::obj-1-530:head# 2024-05-08T18:02:53.001 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.018 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a4e0d96d:::obj-1-351:head# 2024-05-08T18:02:53.018 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.035 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a52657b4:::obj-1-557:head# 2024-05-08T18:02:53.035 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.051 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a5b3bca6:::obj-1-277:head# 2024-05-08T18:02:53.052 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.068 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a5f5a9fb:::obj-1-170:head# 2024-05-08T18:02:53.068 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.085 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a6aeed57:::obj-1-141:head# 2024-05-08T18:02:53.085 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.101 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a6dda70f:::obj-1-471:head# 2024-05-08T18:02:53.102 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.118 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a71186c0:::obj-1-406:head# 2024-05-08T18:02:53.118 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.135 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a764ad8c:::obj-1-221:head# 2024-05-08T18:02:53.135 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.152 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a7b63473:::obj-1-131:head# 2024-05-08T18:02:53.152 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.168 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a88042fa:::obj-1-296:head# 2024-05-08T18:02:53.168 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.185 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:a8805fe0:::obj-1-213:head# 2024-05-08T18:02:53.185 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.202 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:aa4f12b1:::obj-1-270:head# 2024-05-08T18:02:53.202 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.218 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ab27f701:::obj-1-399:head# 2024-05-08T18:02:53.219 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.235 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ab8027c1:::obj-1-360:head# 2024-05-08T18:02:53.235 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.252 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ac3ef8ab:::obj-1-371:head# 2024-05-08T18:02:53.252 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.268 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ac4db76d:::obj-1-405:head# 2024-05-08T18:02:53.269 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.285 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ad53cb29:::obj-1-256:head# 2024-05-08T18:02:53.285 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.302 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ad704c16:::obj-1-485:head# 2024-05-08T18:02:53.302 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.318 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:adec4920:::obj-1-107:head# 2024-05-08T18:02:53.319 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.335 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ae3a94b3:::obj-1-95:head# 2024-05-08T18:02:53.335 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.352 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ae92616e:::obj-1-448:head# 2024-05-08T18:02:53.352 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.369 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ae975168:::obj-1-426:head# 2024-05-08T18:02:53.369 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.385 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:aee8fd62:::obj-1-27:head# 2024-05-08T18:02:53.385 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.402 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:af38aa87:::obj-1-50:head# 2024-05-08T18:02:53.402 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.419 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b0327eb3:::obj-1-380:head# 2024-05-08T18:02:53.419 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.435 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b03cd166:::obj-1-203:head# 2024-05-08T18:02:53.436 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.452 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b06f06e0:::obj-1-126:head# 2024-05-08T18:02:53.452 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.469 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b0972538:::obj-1-506:head# 2024-05-08T18:02:53.469 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.485 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b0cfb86a:::obj-1-359:head# 2024-05-08T18:02:53.485 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.502 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b10adb1c:::obj-1-333:head# 2024-05-08T18:02:53.502 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.519 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b20b9004:::obj-1-401:head# 2024-05-08T18:02:53.519 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.535 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b2113757:::obj-1-4:head# 2024-05-08T18:02:53.535 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.552 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b22441e9:::obj-1-29:head# 2024-05-08T18:02:53.552 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.569 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b2472384:::obj-1-207:head# 2024-05-08T18:02:53.569 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.585 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b2604227:::obj-1-502:head# 2024-05-08T18:02:53.586 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.602 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b3277f89:::obj-1-175:head# 2024-05-08T18:02:53.602 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.619 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b3d09e0d:::obj-1-258:head# 2024-05-08T18:02:53.619 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.635 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b3e9969a:::obj-1-499:head# 2024-05-08T18:02:53.636 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.652 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b4892e7d:::obj-1-155:head# 2024-05-08T18:02:53.653 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.669 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b4b76084:::obj-1-581:head# 2024-05-08T18:02:53.669 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.685 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b6e47ae5:::obj-1-215:head# 2024-05-08T18:02:53.686 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.702 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b75af5ff:::obj-1-228:head# 2024-05-08T18:02:53.702 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.719 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b8e2e20f:::obj-1-220:head# 2024-05-08T18:02:53.719 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.736 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:b8e80c4e:::obj-1-576:head# 2024-05-08T18:02:53.736 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.752 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ba502aee:::obj-1-255:head# 2024-05-08T18:02:53.752 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.769 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ba9c3e6e:::obj-1-57:head# 2024-05-08T18:02:53.769 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.786 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bb068062:::obj-1-461:head# 2024-05-08T18:02:53.786 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.836 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bb16c115:::obj-1-157:head# 2024-05-08T18:02:53.836 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.877 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bb447914:::obj-1-481:head# 2024-05-08T18:02:53.878 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.894 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bb6c8e0f:::obj-1-348:head# 2024-05-08T18:02:53.894 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.911 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bb77d6d0:::obj-1-301:head# 2024-05-08T18:02:53.911 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.952 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bc51c5f6:::obj-1-422:head# 2024-05-08T18:02:53.952 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.969 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bc838d5c:::obj-1-35:head# 2024-05-08T18:02:53.969 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:53.986 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bceae5eb:::obj-1-56:head# 2024-05-08T18:02:53.986 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.002 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bea17ef6:::obj-1-84:head# 2024-05-08T18:02:54.003 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.019 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:beb88be5:::obj-1-396:head# 2024-05-08T18:02:54.019 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.036 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:beed7b18:::obj-1-569:head# 2024-05-08T18:02:54.036 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.053 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bf0bff49:::obj-1-385:head# 2024-05-08T18:02:54.053 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.103 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bf545d5a:::obj-1-69:head# 2024-05-08T18:02:54.103 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.119 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bf560a7f:::obj-1-40:head# 2024-05-08T18:02:54.119 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.136 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:bff6999c:::obj-1-240:head# 2024-05-08T18:02:54.136 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.153 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c0a33d38:::obj-1-321:head# 2024-05-08T18:02:54.153 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.169 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c1e4c9b4:::obj-1-299:head# 2024-05-08T18:02:54.169 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.219 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c1ec515a:::obj-1-16:head# 2024-05-08T18:02:54.219 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.236 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c22de3c8:::obj-1-110:head# 2024-05-08T18:02:54.236 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.283 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c231cd7c:::obj-1-58:head# 2024-05-08T18:02:54.283 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.327 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c2ee6ace:::obj-1-186:head# 2024-05-08T18:02:54.328 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.397 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c32bfef2:::obj-1-181:head# 2024-05-08T18:02:54.397 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.428 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c575a298:::obj-1-466:head# 2024-05-08T18:02:54.428 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.444 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c58c3f80:::obj-1-493:head# 2024-05-08T18:02:54.444 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.461 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c6442cf2:::obj-1-455:head# 2024-05-08T18:02:54.461 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.478 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c6619413:::obj-1-37:head# 2024-05-08T18:02:54.478 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.494 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c6c2f8e5:::obj-1-519:head# 2024-05-08T18:02:54.494 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.511 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c6f811a2:::obj-1-180:head# 2024-05-08T18:02:54.511 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.528 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c72af975:::obj-1-21:head# 2024-05-08T18:02:54.528 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.544 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c73eb350:::obj-1-356:head# 2024-05-08T18:02:54.544 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.561 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c7a683da:::obj-1-410:head# 2024-05-08T18:02:54.561 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.578 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c7eb9bcc:::obj-1-553:head# 2024-05-08T18:02:54.578 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.594 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c886df99:::obj-1-269:head# 2024-05-08T18:02:54.594 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.611 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c932e3ec:::obj-1-135:head# 2024-05-08T18:02:54.611 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.628 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c9b6507a:::obj-1-520:head# 2024-05-08T18:02:54.628 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.644 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:c9e3b064:::obj-1-244:head# 2024-05-08T18:02:54.645 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.661 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cb705d66:::obj-1-377:head# 2024-05-08T18:02:54.661 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.678 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cc80e25c:::obj-1-115:head# 2024-05-08T18:02:54.678 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.695 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cd1ec88e:::obj-1-297:head# 2024-05-08T18:02:54.695 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.711 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cd7e6936:::obj-1-234:head# 2024-05-08T18:02:54.711 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.728 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ce32b69c:::obj-1-30:head# 2024-05-08T18:02:54.728 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.745 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cf2b123c:::obj-1-293:head# 2024-05-08T18:02:54.745 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.761 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cf2e80a9:::obj-1-542:head# 2024-05-08T18:02:54.761 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.778 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cf51da6a:::obj-1-284:head# 2024-05-08T18:02:54.778 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.795 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cf590f42:::obj-1-381:head# 2024-05-08T18:02:54.795 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.811 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cf68a2b1:::obj-1-68:head# 2024-05-08T18:02:54.812 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.828 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cf6aefb6:::obj-1-28:head# 2024-05-08T18:02:54.828 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.845 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:cfd8e6af:::obj-1-105:head# 2024-05-08T18:02:54.845 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.861 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d0640bad:::obj-1-254:head# 2024-05-08T18:02:54.862 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.878 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d101cda5:::obj-1-259:head# 2024-05-08T18:02:54.878 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.895 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d1be9386:::obj-1-416:head# 2024-05-08T18:02:54.895 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.911 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d243f036:::obj-1-265:head# 2024-05-08T18:02:54.912 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.928 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d2808c34:::obj-1-159:head# 2024-05-08T18:02:54.928 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.945 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d3415824:::obj-1-39:head# 2024-05-08T18:02:54.945 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.962 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d424f07a:::obj-1-547:head# 2024-05-08T18:02:54.962 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.978 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d44139f2:::obj-1-289:head# 2024-05-08T18:02:54.978 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:54.995 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d46015ab:::obj-1-546:head# 2024-05-08T18:02:54.995 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.012 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d4e503db:::obj-1-525:head# 2024-05-08T18:02:55.012 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.028 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d4e97d18:::obj-1-85:head# 2024-05-08T18:02:55.028 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.045 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d511492e:::obj-1-388:head# 2024-05-08T18:02:55.045 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.062 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d526a7fa:::obj-1-12:head# 2024-05-08T18:02:55.062 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.079 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d5667b59:::obj-1-369:head# 2024-05-08T18:02:55.079 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.095 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d57f2261:::obj-1-419:head# 2024-05-08T18:02:55.095 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.112 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d57f281b:::obj-1-250:head# 2024-05-08T18:02:55.112 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.129 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d6e05894:::obj-1-166:head# 2024-05-08T18:02:55.129 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.145 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d7689481:::obj-1-424:head# 2024-05-08T18:02:55.145 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.162 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d7d27743:::obj-1-129:head# 2024-05-08T18:02:55.162 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.179 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d7e4d3e9:::obj-1-127:head# 2024-05-08T18:02:55.179 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.195 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d7f1422a:::obj-1-594:head# 2024-05-08T18:02:55.195 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.220 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d8469fd2:::obj-1-153:head# 2024-05-08T18:02:55.220 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.237 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d84efd9e:::obj-1-435:head# 2024-05-08T18:02:55.237 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.253 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d883004b:::obj-1-162:head# 2024-05-08T18:02:55.254 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.270 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d8b60854:::obj-1-257:head# 2024-05-08T18:02:55.270 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.287 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d91aaae6:::obj-1-1:head# 2024-05-08T18:02:55.287 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.304 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d98695ca:::obj-1-524:head# 2024-05-08T18:02:55.304 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.320 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:d9ae97c8:::obj-1-177:head# 2024-05-08T18:02:55.321 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.370 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:da1713bd:::obj-1-309:head# 2024-05-08T18:02:55.371 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.387 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:da37824c:::obj-1-2:head# 2024-05-08T18:02:55.387 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.404 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:dab221b0:::obj-1-526:head# 2024-05-08T18:02:55.404 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.420 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:db27d885:::obj-1-363:head# 2024-05-08T18:02:55.420 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.437 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:dc001d76:::obj-1-329:head# 2024-05-08T18:02:55.437 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.454 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:dc4f4119:::obj-1-122:head# 2024-05-08T18:02:55.454 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.495 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:dcc36eb7:::obj-1-283:head# 2024-05-08T18:02:55.496 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.512 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:df7da06c:::obj-1-124:head# 2024-05-08T18:02:55.512 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.529 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:df7fcacb:::obj-1-330:head# 2024-05-08T18:02:55.529 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.545 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e05cbe31:::obj-1-413:head# 2024-05-08T18:02:55.546 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.562 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e1060a54:::obj-1-384:head# 2024-05-08T18:02:55.562 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.579 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e15b839b:::obj-1-316:head# 2024-05-08T18:02:55.579 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.596 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e161b6e5:::obj-1-103:head# 2024-05-08T18:02:55.596 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.612 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e1d1d79c:::obj-1-512:head# 2024-05-08T18:02:55.612 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.629 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e224b482:::obj-1-501:head# 2024-05-08T18:02:55.629 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.645 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e22d6f76:::obj-1-70:head# 2024-05-08T18:02:55.646 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.662 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e2bd801c:::obj-1-523:head# 2024-05-08T18:02:55.662 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.679 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e3d9f395:::obj-1-397:head# 2024-05-08T18:02:55.679 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.696 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e474ea25:::obj-1-457:head# 2024-05-08T18:02:55.696 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.712 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e49e1ff3:::obj-1-130:head# 2024-05-08T18:02:55.712 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.729 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e56c67a0:::obj-1-191:head# 2024-05-08T18:02:55.729 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.746 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e576e921:::obj-1-376:head# 2024-05-08T18:02:55.746 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.763 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e619fd26:::obj-1-395:head# 2024-05-08T18:02:55.763 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.779 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e625bdc5:::obj-1-522:head# 2024-05-08T18:02:55.779 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.833 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e68a0fa6:::obj-1-394:head# 2024-05-08T18:02:55.833 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.871 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e6cf260f:::obj-1-77:head# 2024-05-08T18:02:55.871 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.887 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e6d6255a:::obj-1-108:head# 2024-05-08T18:02:55.887 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.904 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e7a35d2f:::obj-1-116:head# 2024-05-08T18:02:55.904 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.921 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e7b07de5:::obj-1-238:head# 2024-05-08T18:02:55.921 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.937 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e8037aba:::obj-1-404:head# 2024-05-08T18:02:55.938 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.954 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e8e8b34f:::obj-1-291:head# 2024-05-08T18:02:55.954 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.971 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:e987cd7a:::obj-1-123:head# 2024-05-08T18:02:55.971 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:55.987 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ea534db1:::obj-1-311:head# 2024-05-08T18:02:55.988 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.004 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:eabcc188:::obj-1-325:head# 2024-05-08T18:02:56.004 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.021 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:eb086660:::obj-1-595:head# 2024-05-08T18:02:56.021 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.038 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:eb2235d3:::obj-1-596:head# 2024-05-08T18:02:56.038 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.054 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:eb35ae40:::obj-1-516:head# 2024-05-08T18:02:56.054 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.071 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:eb360a13:::obj-1-224:head# 2024-05-08T18:02:56.071 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.096 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:eb3a3ea1:::obj-1-120:head# 2024-05-08T18:02:56.096 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.113 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ebca9f6e:::obj-1-290:head# 2024-05-08T18:02:56.113 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.129 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ec81db71:::obj-1-478:head# 2024-05-08T18:02:56.129 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.146 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:edeafa4c:::obj-1-362:head# 2024-05-08T18:02:56.146 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.163 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:eeb5261b:::obj-1-539:head# 2024-05-08T18:02:56.163 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.180 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:eec00eee:::obj-1-567:head# 2024-05-08T18:02:56.180 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.196 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ef075e10:::obj-1-463:head# 2024-05-08T18:02:56.196 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.213 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ef8e37d9:::obj-1-94:head# 2024-05-08T18:02:56.213 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.230 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:efad7f67:::obj-1-197:head# 2024-05-08T18:02:56.230 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.263 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:efe09ea7:::obj-1-537:head# 2024-05-08T18:02:56.263 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.305 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f0445019:::obj-1-480:head# 2024-05-08T18:02:56.305 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.347 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f08a432c:::obj-1-489:head# 2024-05-08T18:02:56.347 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.388 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f0bd9006:::obj-1-487:head# 2024-05-08T18:02:56.388 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.405 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f11a115d:::obj-1-591:head# 2024-05-08T18:02:56.405 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.422 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f232e0af:::obj-1-146:head# 2024-05-08T18:02:56.422 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.438 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f258db54:::obj-1-521:head# 2024-05-08T18:02:56.438 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.455 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f29cc204:::obj-1-566:head# 2024-05-08T18:02:56.455 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.472 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f2ae2451:::obj-1-66:head# 2024-05-08T18:02:56.472 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.488 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f318810a:::obj-1-160:head# 2024-05-08T18:02:56.488 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.505 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f3c35a0d:::obj-1-67:head# 2024-05-08T18:02:56.505 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.521 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f3ce9c90:::obj-1-88:head# 2024-05-08T18:02:56.522 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.538 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f3e3e81f:::obj-1-304:head# 2024-05-08T18:02:56.538 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.555 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f3f65b0a:::obj-1-367:head# 2024-05-08T18:02:56.555 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.572 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f4ea014b:::obj-1-149:head# 2024-05-08T18:02:56.572 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.588 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f52d115b:::obj-1-383:head# 2024-05-08T18:02:56.589 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.605 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f590311e:::obj-1-76:head# 2024-05-08T18:02:56.605 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.655 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f5a37734:::obj-1-51:head# 2024-05-08T18:02:56.656 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.672 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f5e2e77c:::obj-1-179:head# 2024-05-08T18:02:56.672 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.689 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f5e381bc:::obj-1-173:head# 2024-05-08T18:02:56.689 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f6c0ae0b:::obj-1-247:head# 2024-05-08T18:02:56.705 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f6db8a82:::obj-1-548:head# 2024-05-08T18:02:56.722 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f6e2dc46:::obj-1-36:head# 2024-05-08T18:02:56.739 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.755 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f76ee569:::obj-1-587:head# 2024-05-08T18:02:56.755 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.772 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f773b9ed:::obj-1-550:head# 2024-05-08T18:02:56.772 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.789 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f7e1adad:::obj-1-350:head# 2024-05-08T18:02:56.789 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.805 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f7eebf7a:::obj-1-559:head# 2024-05-08T18:02:56.805 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.822 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f877f025:::obj-1-187:head# 2024-05-08T18:02:56.822 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.839 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f992f9e9:::obj-1-402:head# 2024-05-08T18:02:56.839 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.855 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:f9fe960a:::obj-1-418:head# 2024-05-08T18:02:56.855 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.872 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:fa9b882f:::obj-1-165:head# 2024-05-08T18:02:56.872 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.889 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:fbd6461c:::obj-1-339:head# 2024-05-08T18:02:56.889 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.905 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:fbeab28d:::obj-1-431:head# 2024-05-08T18:02:56.905 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.922 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:fdea4138:::obj-1-185:head# 2024-05-08T18:02:56.922 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.939 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:fdfa7c9b:::obj-1-183:head# 2024-05-08T18:02:56.939 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.955 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:fe1ba57e:::obj-1-90:head# 2024-05-08T18:02:56.955 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.972 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:feb7adea:::obj-1-560:head# 2024-05-08T18:02:56.972 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:56.989 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ffab306e:::obj-1-97:head# 2024-05-08T18:02:56.989 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:57.005 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ffdfd397:::obj-1-433:head# 2024-05-08T18:02:57.006 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:57.022 INFO:tasks.workunit.client.0.smithi117.stdout:Write #2:ffe8cf04:::obj-1-303:head# 2024-05-08T18:02:57.022 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:57.039 INFO:tasks.workunit.client.0.smithi117.stdout:write_pg epoch 42 info 2.0( v 42'600 (42'500,42'600] local-lis/les=39/40 n=600 ec=26/26 lis/c=39/39 les/c/f=40/40/0 sis=39) 2024-05-08T18:02:57.055 INFO:tasks.workunit.client.0.smithi117.stdout:Import successful 2024-05-08T18:02:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:494: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op import --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2024-05-08T18:02:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-05-08T18:02:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2024-05-08T18:02:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2024-05-08T18:02:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2024-05-08T18:02:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2024-05-08T18:02:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op import --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2024-05-08T18:02:58.546 INFO:tasks.workunit.client.0.smithi117.stdout:get_pg_num_history pg_num_history pg_num_history(e46 pg_nums {1={21=1},2={26=1},3={31=1}} deleted_pools ) 2024-05-08T18:02:58.546 INFO:tasks.workunit.client.0.smithi117.stdout:Importing pgid 1.0 2024-05-08T18:02:58.546 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0002d87b:::obj-fill-318:head# 2024-05-08T18:02:58.546 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.580 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:00676868:::obj-fill-583:head# 2024-05-08T18:02:58.581 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.597 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:00f4514e:::obj-fill-547:head# 2024-05-08T18:02:58.597 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.614 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:01596a3c:::obj-fill-533:head# 2024-05-08T18:02:58.614 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.630 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0285e89c:::obj-fill-190:head# 2024-05-08T18:02:58.631 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.647 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:02bd591e:::obj-fill-463:head# 2024-05-08T18:02:58.647 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.672 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:02c01ffe:::obj-fill-28:head# 2024-05-08T18:02:58.672 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.689 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:03ada31e:::obj-fill-285:head# 2024-05-08T18:02:58.689 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.706 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:03b07c3f:::obj-fill-568:head# 2024-05-08T18:02:58.706 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.722 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:03b85770:::obj-fill-573:head# 2024-05-08T18:02:58.723 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.739 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:03dcbe89:::obj-fill-375:head# 2024-05-08T18:02:58.739 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.756 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:04231826:::obj-fill-594:head# 2024-05-08T18:02:58.756 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.772 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:04d48684:::obj-fill-421:head# 2024-05-08T18:02:58.773 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.789 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:05385fcc:::obj-fill-299:head# 2024-05-08T18:02:58.789 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.806 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:05785d38:::obj-fill-159:head# 2024-05-08T18:02:58.806 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.822 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:057ec231:::obj-fill-138:head# 2024-05-08T18:02:58.823 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.839 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:06058b5e:::obj-fill-569:head# 2024-05-08T18:02:58.839 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.856 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:06d2a3d9:::obj-fill-284:head# 2024-05-08T18:02:58.856 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.873 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:07597b63:::obj-fill-459:head# 2024-05-08T18:02:58.873 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.889 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:075f4069:::obj-fill-550:head# 2024-05-08T18:02:58.889 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.906 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:08234052:::obj-fill-17:head# 2024-05-08T18:02:58.906 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.923 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:091ce2ec:::obj-fill-472:head# 2024-05-08T18:02:58.923 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.939 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:095fd509:::obj-fill-210:head# 2024-05-08T18:02:58.939 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.956 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0a52a594:::obj-fill-116:head# 2024-05-08T18:02:58.956 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.973 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0a63716b:::obj-fill-225:head# 2024-05-08T18:02:58.973 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:58.989 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0b0fa6fb:::obj-fill-541:head# 2024-05-08T18:02:58.989 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.006 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0b673f72:::obj-fill-232:head# 2024-05-08T18:02:59.006 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.023 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0bbcd1b2:::obj-fill-582:head# 2024-05-08T18:02:59.023 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.039 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0caf8ce3:::obj-fill-214:head# 2024-05-08T18:02:59.040 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.056 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0d94b9fb:::obj-fill-415:head# 2024-05-08T18:02:59.056 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.073 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0de4e6f7:::obj-fill-94:head# 2024-05-08T18:02:59.073 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.089 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0ef75768:::obj-fill-489:head# 2024-05-08T18:02:59.090 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.106 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0f67284f:::obj-fill-213:head# 2024-05-08T18:02:59.106 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.123 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:0f823df2:::obj-fill-234:head# 2024-05-08T18:02:59.123 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.140 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1005c08d:::obj-fill-490:head# 2024-05-08T18:02:59.140 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.156 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1039525f:::obj-fill-369:head# 2024-05-08T18:02:59.156 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.173 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:105fb36c:::obj-fill-226:head# 2024-05-08T18:02:59.173 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.190 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:111abdeb:::obj-fill-554:head# 2024-05-08T18:02:59.190 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.206 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:11392f3d:::obj-fill-453:head# 2024-05-08T18:02:59.206 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.223 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1169976c:::obj-fill-417:head# 2024-05-08T18:02:59.223 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.240 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:11840a2a:::obj-fill-477:head# 2024-05-08T18:02:59.240 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.256 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:11a4832e:::obj-fill-279:head# 2024-05-08T18:02:59.257 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.273 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:11a4d2f6:::obj-fill-256:head# 2024-05-08T18:02:59.273 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.290 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:12d52a31:::obj-fill-22:head# 2024-05-08T18:02:59.290 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.307 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:133c45db:::obj-fill-257:head# 2024-05-08T18:02:59.307 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.323 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:13563256:::obj-fill-150:head# 2024-05-08T18:02:59.323 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.340 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:13c09e00:::obj-fill-71:head# 2024-05-08T18:02:59.340 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.356 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:13e9fbed:::obj-fill-242:head# 2024-05-08T18:02:59.356 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.373 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:13fae6c2:::obj-fill-163:head# 2024-05-08T18:02:59.373 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.390 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:145025e0:::obj-fill-543:head# 2024-05-08T18:02:59.390 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.407 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:14517c84:::obj-fill-13:head# 2024-05-08T18:02:59.407 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.423 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:14802e9c:::obj-fill-127:head# 2024-05-08T18:02:59.423 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.440 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:150f1c96:::obj-fill-62:head# 2024-05-08T18:02:59.440 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.456 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:155e90a2:::obj-fill-537:head# 2024-05-08T18:02:59.456 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.473 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1632c776:::obj-fill-262:head# 2024-05-08T18:02:59.473 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.490 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:163bde28:::obj-fill-523:head# 2024-05-08T18:02:59.490 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.507 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:169c4ad0:::obj-fill-85:head# 2024-05-08T18:02:59.507 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.523 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:16c4da1d:::obj-fill-436:head# 2024-05-08T18:02:59.523 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.540 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:17b28c32:::obj-fill-345:head# 2024-05-08T18:02:59.540 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.557 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:17b34255:::obj-fill-577:head# 2024-05-08T18:02:59.557 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.574 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:17d2541f:::obj-fill-426:head# 2024-05-08T18:02:59.574 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.590 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:17ea19f2:::obj-fill-542:head# 2024-05-08T18:02:59.590 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.607 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:189155ea:::obj-fill-496:head# 2024-05-08T18:02:59.607 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.623 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:191a6d81:::obj-fill-548:head# 2024-05-08T18:02:59.624 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.640 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1a964993:::obj-fill-576:head# 2024-05-08T18:02:59.640 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.690 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1aa623dc:::obj-fill-356:head# 2024-05-08T18:02:59.690 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.707 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1abe5c38:::obj-fill-561:head# 2024-05-08T18:02:59.707 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.724 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1bddc06b:::obj-fill-7:head# 2024-05-08T18:02:59.724 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.740 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1be86b71:::obj-fill-295:head# 2024-05-08T18:02:59.740 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.757 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1c499bca:::obj-fill-240:head# 2024-05-08T18:02:59.757 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.773 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1c545e27:::obj-fill-509:head# 2024-05-08T18:02:59.774 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.808 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1c63c8f4:::obj-fill-4:head# 2024-05-08T18:02:59.808 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.899 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1d5a8f59:::obj-fill-377:head# 2024-05-08T18:02:59.899 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.915 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1d85b5df:::obj-fill-201:head# 2024-05-08T18:02:59.915 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.932 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1d9a0d5b:::obj-fill-581:head# 2024-05-08T18:02:59.932 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.949 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1dcf5667:::obj-fill-488:head# 2024-05-08T18:02:59.949 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.965 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1fa3090d:::obj-fill-458:head# 2024-05-08T18:02:59.965 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.982 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1fe937f6:::obj-fill-337:head# 2024-05-08T18:02:59.982 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:02:59.999 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:1ff54542:::obj-fill-349:head# 2024-05-08T18:02:59.999 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.016 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:20d9e0ca:::obj-fill-367:head# 2024-05-08T18:03:00.016 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.032 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:21b8e3bb:::obj-fill-538:head# 2024-05-08T18:03:00.032 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.049 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:227183d4:::obj-fill-235:head# 2024-05-08T18:03:00.049 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.065 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:229e5e5d:::obj-fill-522:head# 2024-05-08T18:03:00.066 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.082 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:234f8861:::obj-fill-476:head# 2024-05-08T18:03:00.082 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.099 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:23ac2c9d:::obj-fill-471:head# 2024-05-08T18:03:00.099 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.115 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:25db1742:::obj-fill-200:head# 2024-05-08T18:03:00.115 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.132 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:264f8545:::obj-fill-230:head# 2024-05-08T18:03:00.132 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.149 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:267ba97f:::obj-fill-493:head# 2024-05-08T18:03:00.149 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.165 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:26b067e8:::obj-fill-208:head# 2024-05-08T18:03:00.166 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.182 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:26f521cb:::obj-fill-300:head# 2024-05-08T18:03:00.183 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.199 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:27e70a11:::obj-fill-368:head# 2024-05-08T18:03:00.199 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.216 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:29357d4a:::obj-fill-456:head# 2024-05-08T18:03:00.216 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.232 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:29f2567e:::obj-fill-414:head# 2024-05-08T18:03:00.232 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.266 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2a10cbb6:::obj-fill-228:head# 2024-05-08T18:03:00.266 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.324 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2a1519a6:::obj-fill-148:head# 2024-05-08T18:03:00.324 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.374 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2a686ca6:::obj-fill-411:head# 2024-05-08T18:03:00.374 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.416 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2ab3f384:::obj-fill-77:head# 2024-05-08T18:03:00.416 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.432 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2ae6a1d0:::obj-fill-187:head# 2024-05-08T18:03:00.432 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.449 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2b890959:::obj-fill-222:head# 2024-05-08T18:03:00.449 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.466 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2bcc26c4:::obj-fill-114:head# 2024-05-08T18:03:00.466 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.482 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2bd3a3a2:::obj-fill-281:head# 2024-05-08T18:03:00.482 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.499 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2c1a21d7:::obj-fill-505:head# 2024-05-08T18:03:00.499 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.516 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2c255347:::obj-fill-95:head# 2024-05-08T18:03:00.516 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.532 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2c2a3f62:::obj-fill-131:head# 2024-05-08T18:03:00.533 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.549 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2c7d92ce:::obj-fill-442:head# 2024-05-08T18:03:00.549 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.566 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2d1ad117:::obj-fill-443:head# 2024-05-08T18:03:00.566 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.582 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2d57b2f7:::obj-fill-192:head# 2024-05-08T18:03:00.583 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.599 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2d7b53ea:::obj-fill-79:head# 2024-05-08T18:03:00.599 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.616 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2db25266:::obj-fill-121:head# 2024-05-08T18:03:00.616 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.633 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2e27853e:::obj-fill-473:head# 2024-05-08T18:03:00.633 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.650 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2f12cb21:::obj-fill-386:head# 2024-05-08T18:03:00.650 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.666 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2f957332:::obj-fill-422:head# 2024-05-08T18:03:00.666 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.682 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:2feae493:::obj-fill-301:head# 2024-05-08T18:03:00.683 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.699 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:302c95d2:::obj-fill-110:head# 2024-05-08T18:03:00.699 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.716 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:302d6b76:::obj-fill-374:head# 2024-05-08T18:03:00.716 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.733 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:30581f34:::obj-fill-313:head# 2024-05-08T18:03:00.733 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.749 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:307e86ac:::obj-fill-381:head# 2024-05-08T18:03:00.750 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.791 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:30ab77bf:::obj-fill-275:head# 2024-05-08T18:03:00.791 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.808 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:31127e6d:::obj-fill-250:head# 2024-05-08T18:03:00.808 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.824 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:32c93500:::obj-fill-155:head# 2024-05-08T18:03:00.825 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.841 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:339880b7:::obj-fill-227:head# 2024-05-08T18:03:00.841 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.858 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:34069e1e:::obj-fill-292:head# 2024-05-08T18:03:00.858 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.874 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:346dff31:::obj-fill-157:head# 2024-05-08T18:03:00.875 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.891 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:34ade0f1:::obj-fill-575:head# 2024-05-08T18:03:00.891 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.908 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:34bbae43:::obj-fill-90:head# 2024-05-08T18:03:00.908 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.924 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:34e97cf8:::obj-fill-334:head# 2024-05-08T18:03:00.925 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.941 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:35d7ccc2:::obj-fill-510:head# 2024-05-08T18:03:00.941 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.958 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:35f519b6:::obj-fill-513:head# 2024-05-08T18:03:00.958 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:00.975 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:364727e8:::obj-fill-130:head# 2024-05-08T18:03:00.975 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.016 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:364c0361:::obj-fill-586:head# 2024-05-08T18:03:01.016 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.033 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:368e7baf:::obj-fill-546:head# 2024-05-08T18:03:01.033 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.050 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:36ffb224:::obj-fill-82:head# 2024-05-08T18:03:01.050 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.066 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:371cb800:::obj-fill-330:head# 2024-05-08T18:03:01.066 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.083 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:37d5378d:::obj-fill-175:head# 2024-05-08T18:03:01.083 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.100 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:385593f3:::obj-fill-325:head# 2024-05-08T18:03:01.100 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.116 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:388d5073:::obj-fill-317:head# 2024-05-08T18:03:01.117 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.133 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:394af079:::obj-fill-59:head# 2024-05-08T18:03:01.133 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.150 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3a41ad37:::obj-fill-409:head# 2024-05-08T18:03:01.150 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.166 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3b3c63d2:::obj-fill-136:head# 2024-05-08T18:03:01.167 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.183 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3bb50131:::obj-fill-512:head# 2024-05-08T18:03:01.183 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.200 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3bb52bb5:::obj-fill-188:head# 2024-05-08T18:03:01.200 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.216 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3c0683d1:::obj-fill-372:head# 2024-05-08T18:03:01.217 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.233 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3c67d3f4:::obj-fill-249:head# 2024-05-08T18:03:01.233 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.250 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# 2024-05-08T18:03:01.250 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.266 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2024-05-08T18:03:01.266 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.292 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3d940c50:::obj-fill-591:head# 2024-05-08T18:03:01.292 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.308 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3ed5508e:::obj-fill-558:head# 2024-05-08T18:03:01.309 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.325 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:3f598316:::obj-fill-389:head# 2024-05-08T18:03:01.325 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.342 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:401cd0ce:::obj-fill-251:head# 2024-05-08T18:03:01.342 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.358 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:40fae006:::obj-fill-14:head# 2024-05-08T18:03:01.359 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.375 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4120b10f:::obj-fill-165:head# 2024-05-08T18:03:01.375 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.392 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:41b382c2:::obj-fill-289:head# 2024-05-08T18:03:01.392 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.408 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4277cdea:::obj-fill-319:head# 2024-05-08T18:03:01.409 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.425 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:42978c3c:::obj-fill-174:head# 2024-05-08T18:03:01.425 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.442 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:42b08dc2:::obj-fill-553:head# 2024-05-08T18:03:01.442 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.458 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:42ec4bf6:::obj-fill-209:head# 2024-05-08T18:03:01.458 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.475 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:430c129d:::obj-fill-448:head# 2024-05-08T18:03:01.475 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.492 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4335d553:::obj-fill-600:head# 2024-05-08T18:03:01.492 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.508 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:44804f62:::obj-fill-532:head# 2024-05-08T18:03:01.509 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.525 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:44954d54:::obj-fill-2:head# 2024-05-08T18:03:01.525 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.542 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4502f904:::obj-fill-429:head# 2024-05-08T18:03:01.542 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.558 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4568ddcb:::obj-fill-382:head# 2024-05-08T18:03:01.559 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.575 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:45939974:::obj-fill-563:head# 2024-05-08T18:03:01.575 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.592 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:462a5bbd:::obj-fill-567:head# 2024-05-08T18:03:01.592 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.608 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:47773ae4:::obj-fill-307:head# 2024-05-08T18:03:01.609 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.625 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4802b263:::obj-fill-387:head# 2024-05-08T18:03:01.625 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.642 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:483d938e:::obj-fill-128:head# 2024-05-08T18:03:01.642 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.658 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:48a7ad29:::obj-fill-147:head# 2024-05-08T18:03:01.659 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.675 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:493b61ce:::obj-fill-454:head# 2024-05-08T18:03:01.675 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.692 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4afb70fe:::obj-fill-186:head# 2024-05-08T18:03:01.692 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.709 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4bff08e3:::obj-fill-352:head# 2024-05-08T18:03:01.709 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.726 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4c01eabe:::obj-fill-370:head# 2024-05-08T18:03:01.726 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.742 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4c131560:::obj-fill-6:head# 2024-05-08T18:03:01.742 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.759 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4c4c5e14:::obj-fill-350:head# 2024-05-08T18:03:01.759 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.775 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4c80dc2c:::obj-fill-357:head# 2024-05-08T18:03:01.776 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.809 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4c9dee9b:::obj-fill-540:head# 2024-05-08T18:03:01.809 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.867 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4ce40c18:::obj-fill-280:head# 2024-05-08T18:03:01.868 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.884 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4d854fc3:::obj-fill-585:head# 2024-05-08T18:03:01.884 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.900 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:4f615b53:::obj-fill-101:head# 2024-05-08T18:03:01.900 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.917 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5042b30f:::obj-fill-84:head# 2024-05-08T18:03:01.917 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.934 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:507dc08b:::obj-fill-336:head# 2024-05-08T18:03:01.934 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.950 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:512fcf5a:::obj-fill-169:head# 2024-05-08T18:03:01.950 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.967 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:51a0c8f8:::obj-fill-578:head# 2024-05-08T18:03:01.967 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:01.984 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:51fd05a2:::obj-fill-425:head# 2024-05-08T18:03:01.984 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.001 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:52400ebc:::obj-fill-81:head# 2024-05-08T18:03:02.001 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.017 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5288d40c:::obj-fill-16:head# 2024-05-08T18:03:02.017 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.034 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5295b0ee:::obj-fill-224:head# 2024-05-08T18:03:02.034 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.051 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:531e4c60:::obj-fill-103:head# 2024-05-08T18:03:02.051 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.067 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:54259f28:::obj-fill-584:head# 2024-05-08T18:03:02.068 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.084 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:542d619c:::obj-fill-528:head# 2024-05-08T18:03:02.084 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.101 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5503ca3e:::obj-fill-494:head# 2024-05-08T18:03:02.101 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.117 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5555c48b:::obj-fill-403:head# 2024-05-08T18:03:02.117 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.134 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:558d1ec7:::obj-fill-447:head# 2024-05-08T18:03:02.134 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.178 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:55aa2233:::obj-fill-21:head# 2024-05-08T18:03:02.178 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.192 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:55aaf8c4:::obj-fill-29:head# 2024-05-08T18:03:02.192 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.209 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:55e246e1:::obj-fill-65:head# 2024-05-08T18:03:02.209 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.226 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:563b14a8:::obj-fill-120:head# 2024-05-08T18:03:02.226 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.258 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:56e1df25:::obj-fill-305:head# 2024-05-08T18:03:02.258 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.301 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5702979c:::obj-fill-73:head# 2024-05-08T18:03:02.301 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.367 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:570722ba:::obj-fill-219:head# 2024-05-08T18:03:02.367 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.393 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:57f7a09b:::obj-fill-571:head# 2024-05-08T18:03:02.393 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.409 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:585309ba:::obj-fill-144:head# 2024-05-08T18:03:02.410 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.426 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:585c7c9c:::obj-fill-437:head# 2024-05-08T18:03:02.426 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.443 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:587c63db:::obj-fill-182:head# 2024-05-08T18:03:02.443 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.459 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:58f34d6b:::obj-fill-598:head# 2024-05-08T18:03:02.459 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.476 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:58f40088:::obj-fill-298:head# 2024-05-08T18:03:02.476 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.493 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:591e150c:::obj-fill-32:head# 2024-05-08T18:03:02.493 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.509 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:59971ddb:::obj-fill-559:head# 2024-05-08T18:03:02.509 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.526 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5adafca4:::obj-fill-56:head# 2024-05-08T18:03:02.526 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.543 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5b32b04f:::obj-fill-484:head# 2024-05-08T18:03:02.543 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.559 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5bdaeb16:::obj-fill-99:head# 2024-05-08T18:03:02.559 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.576 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5c1d6f4b:::obj-fill-133:head# 2024-05-08T18:03:02.576 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.601 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5c92b8f1:::obj-fill-255:head# 2024-05-08T18:03:02.601 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.618 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5ca4850f:::obj-fill-238:head# 2024-05-08T18:03:02.618 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.634 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5d928a5b:::obj-fill-395:head# 2024-05-08T18:03:02.635 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.651 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5dd49320:::obj-fill-423:head# 2024-05-08T18:03:02.651 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.668 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5e7bc368:::obj-fill-506:head# 2024-05-08T18:03:02.668 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.684 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5ebd5ee3:::obj-fill-322:head# 2024-05-08T18:03:02.685 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.701 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5edeedf1:::obj-fill-557:head# 2024-05-08T18:03:02.701 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.718 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:5facf8e2:::obj-fill-15:head# 2024-05-08T18:03:02.718 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.734 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:603a2c76:::obj-fill-439:head# 2024-05-08T18:03:02.735 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.751 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:60b30714:::obj-fill-53:head# 2024-05-08T18:03:02.751 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.768 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:612b4a8a:::obj-fill-412:head# 2024-05-08T18:03:02.768 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.784 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:61a111b6:::obj-fill-87:head# 2024-05-08T18:03:02.784 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.801 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:63a0e8a2:::obj-fill-266:head# 2024-05-08T18:03:02.801 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.818 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:63aa4d60:::obj-fill-68:head# 2024-05-08T18:03:02.818 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.835 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:63ac5b95:::obj-fill-405:head# 2024-05-08T18:03:02.835 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.851 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6415a9e3:::obj-fill-400:head# 2024-05-08T18:03:02.851 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.868 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:64ba03ae:::obj-fill-20:head# 2024-05-08T18:03:02.868 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.885 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6512f015:::obj-fill-597:head# 2024-05-08T18:03:02.885 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.901 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:65433104:::obj-fill-504:head# 2024-05-08T18:03:02.901 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.918 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:65950c58:::obj-fill-86:head# 2024-05-08T18:03:02.918 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.935 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:65b6b2d7:::obj-fill-39:head# 2024-05-08T18:03:02.935 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.951 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:661c8afd:::obj-fill-267:head# 2024-05-08T18:03:02.951 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.968 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:66f87c94:::obj-fill-229:head# 2024-05-08T18:03:02.968 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:02.985 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:67292cef:::obj-fill-93:head# 2024-05-08T18:03:02.985 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.001 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:67f0e12c:::obj-fill-363:head# 2024-05-08T18:03:03.002 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.018 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:696eb83b:::obj-fill-185:head# 2024-05-08T18:03:03.018 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.035 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6b33981c:::obj-fill-259:head# 2024-05-08T18:03:03.035 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.051 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6b5a527c:::obj-fill-485:head# 2024-05-08T18:03:03.052 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.068 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6b6f1852:::obj-fill-390:head# 2024-05-08T18:03:03.068 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.085 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6ba5c5f8:::obj-fill-304:head# 2024-05-08T18:03:03.085 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.102 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6bce929d:::obj-fill-518:head# 2024-05-08T18:03:03.102 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.118 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6c8ffc04:::obj-fill-61:head# 2024-05-08T18:03:03.118 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.135 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6ca7e551:::obj-fill-40:head# 2024-05-08T18:03:03.135 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.152 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2024-05-08T18:03:03.152 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.168 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6ce4adc7:::obj-fill-574:head# 2024-05-08T18:03:03.169 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.185 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6d09d770:::obj-fill-74:head# 2024-05-08T18:03:03.185 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.202 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6e039822:::obj-fill-278:head# 2024-05-08T18:03:03.202 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.219 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6f2cd109:::obj-fill-297:head# 2024-05-08T18:03:03.219 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.235 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6f3754c4:::obj-fill-88:head# 2024-05-08T18:03:03.235 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.252 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6f86cfd2:::obj-fill-511:head# 2024-05-08T18:03:03.252 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.268 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:6fe3f3f7:::obj-fill-193:head# 2024-05-08T18:03:03.268 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.285 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7002c57d:::obj-fill-50:head# 2024-05-08T18:03:03.285 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.302 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7030b2a3:::obj-fill-217:head# 2024-05-08T18:03:03.302 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.318 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:70665087:::obj-fill-51:head# 2024-05-08T18:03:03.319 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.335 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:70a0f5e0:::obj-fill-11:head# 2024-05-08T18:03:03.335 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.377 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:71f4643d:::obj-fill-236:head# 2024-05-08T18:03:03.377 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.393 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:722fbd0f:::obj-fill-302:head# 2024-05-08T18:03:03.394 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.410 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:72584da9:::obj-fill-445:head# 2024-05-08T18:03:03.411 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.427 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:72d91d24:::obj-fill-218:head# 2024-05-08T18:03:03.427 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.443 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:72f7268b:::obj-fill-106:head# 2024-05-08T18:03:03.444 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.460 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:74077abf:::obj-fill-435:head# 2024-05-08T18:03:03.460 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.477 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:740ca050:::obj-fill-112:head# 2024-05-08T18:03:03.477 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.494 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7435e881:::obj-fill-78:head# 2024-05-08T18:03:03.494 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.510 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:74ba0bb7:::obj-fill-478:head# 2024-05-08T18:03:03.510 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.527 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:74d82091:::obj-fill-96:head# 2024-05-08T18:03:03.527 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.544 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7515f56c:::obj-fill-483:head# 2024-05-08T18:03:03.544 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.560 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7550d6fe:::obj-fill-286:head# 2024-05-08T18:03:03.561 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.577 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:75807edc:::obj-fill-223:head# 2024-05-08T18:03:03.577 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.594 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:762ba324:::obj-fill-172:head# 2024-05-08T18:03:03.594 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.610 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:76369bda:::obj-fill-570:head# 2024-05-08T18:03:03.611 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.627 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7667a5b0:::obj-fill-196:head# 2024-05-08T18:03:03.627 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.644 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:77736c0c:::obj-fill-566:head# 2024-05-08T18:03:03.644 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.660 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:77fb47a4:::obj-fill-314:head# 2024-05-08T18:03:03.661 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.677 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:785ad894:::obj-fill-80:head# 2024-05-08T18:03:03.677 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.694 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:785e3d14:::obj-fill-530:head# 2024-05-08T18:03:03.694 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.711 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:788efef4:::obj-fill-595:head# 2024-05-08T18:03:03.711 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.727 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:789ec5ab:::obj-fill-44:head# 2024-05-08T18:03:03.727 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.744 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:798a3fa8:::obj-fill-517:head# 2024-05-08T18:03:03.744 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.761 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:79a105ef:::obj-fill-315:head# 2024-05-08T18:03:03.761 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.777 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:79d02f04:::obj-fill-243:head# 2024-05-08T18:03:03.778 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.809 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7a00dfcb:::obj-fill-402:head# 2024-05-08T18:03:03.809 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.861 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7b982684:::obj-fill-168:head# 2024-05-08T18:03:03.861 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.877 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7bb36851:::obj-fill-440:head# 2024-05-08T18:03:03.877 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.894 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7bb49d8c:::obj-fill-55:head# 2024-05-08T18:03:03.894 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.911 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7c77b783:::obj-fill-580:head# 2024-05-08T18:03:03.911 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.927 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7c89d75b:::obj-fill-555:head# 2024-05-08T18:03:03.928 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.944 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7d12fb67:::obj-fill-399:head# 2024-05-08T18:03:03.944 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.961 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7d139961:::obj-fill-92:head# 2024-05-08T18:03:03.961 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.977 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7d39ffd0:::obj-fill-135:head# 2024-05-08T18:03:03.978 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:03.994 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7e534cc4:::obj-fill-282:head# 2024-05-08T18:03:03.994 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.011 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7e7a08e0:::obj-fill-108:head# 2024-05-08T18:03:04.011 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.028 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7e8e2b67:::obj-fill-244:head# 2024-05-08T18:03:04.028 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.044 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7eea215e:::obj-fill-139:head# 2024-05-08T18:03:04.044 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.061 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7efa3c6e:::obj-fill-408:head# 2024-05-08T18:03:04.061 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.078 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7f03a24b:::obj-fill-45:head# 2024-05-08T18:03:04.078 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.094 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7f6a2e2b:::obj-fill-427:head# 2024-05-08T18:03:04.095 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.111 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7fb0abd6:::obj-fill-479:head# 2024-05-08T18:03:04.111 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.128 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:7fb77de1:::obj-fill-167:head# 2024-05-08T18:03:04.128 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.144 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:80012a03:::obj-fill-105:head# 2024-05-08T18:03:04.144 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.186 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:80075ae5:::obj-fill-376:head# 2024-05-08T18:03:04.186 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.202 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8089baa5:::obj-fill-97:head# 2024-05-08T18:03:04.203 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.219 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:80d0b4c5:::obj-fill-123:head# 2024-05-08T18:03:04.219 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.237 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:810f319f:::obj-fill-552:head# 2024-05-08T18:03:04.237 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.290 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:81427ef2:::obj-fill-474:head# 2024-05-08T18:03:04.290 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.353 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:818d780c:::obj-fill-33:head# 2024-05-08T18:03:04.353 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.430 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:819f31b9:::obj-fill-366:head# 2024-05-08T18:03:04.431 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.453 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8205549d:::obj-fill-125:head# 2024-05-08T18:03:04.453 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.470 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:821f56e5:::obj-fill-339:head# 2024-05-08T18:03:04.470 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.486 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:822807c6:::obj-fill-69:head# 2024-05-08T18:03:04.486 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.503 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:822fcf61:::obj-fill-560:head# 2024-05-08T18:03:04.503 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.520 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:82ad696b:::obj-fill-149:head# 2024-05-08T18:03:04.520 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.536 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:835cc771:::obj-fill-446:head# 2024-05-08T18:03:04.536 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.553 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8386bee1:::obj-fill-137:head# 2024-05-08T18:03:04.553 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.570 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:83c1303a:::obj-fill-311:head# 2024-05-08T18:03:04.570 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.586 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:83cf1c2a:::obj-fill-360:head# 2024-05-08T18:03:04.587 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.603 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:83d70321:::obj-fill-351:head# 2024-05-08T18:03:04.603 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.620 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:83ef162d:::obj-fill-331:head# 2024-05-08T18:03:04.620 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.636 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:840f8f20:::obj-fill-398:head# 2024-05-08T18:03:04.637 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.653 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:84d2e456:::obj-fill-207:head# 2024-05-08T18:03:04.653 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.695 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:856697ff:::obj-fill-333:head# 2024-05-08T18:03:04.695 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.711 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:858be937:::obj-fill-418:head# 2024-05-08T18:03:04.712 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.728 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:85a0b302:::obj-fill-438:head# 2024-05-08T18:03:04.728 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.745 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:85fa942e:::obj-fill-272:head# 2024-05-08T18:03:04.745 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.761 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:863eb6f8:::obj-fill-320:head# 2024-05-08T18:03:04.762 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.778 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:868d4588:::obj-fill-19:head# 2024-05-08T18:03:04.778 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.795 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8759d023:::obj-fill-466:head# 2024-05-08T18:03:04.795 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.812 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:88072111:::obj-fill-312:head# 2024-05-08T18:03:04.812 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.837 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:886edcef:::obj-fill-380:head# 2024-05-08T18:03:04.837 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.862 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:88ce753e:::obj-fill-43:head# 2024-05-08T18:03:04.862 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.878 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:890e1d83:::obj-fill-590:head# 2024-05-08T18:03:04.878 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.895 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:891566a3:::obj-fill-341:head# 2024-05-08T18:03:04.895 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.912 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:891ca235:::obj-fill-177:head# 2024-05-08T18:03:04.912 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.928 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:897fa9d0:::obj-fill-283:head# 2024-05-08T18:03:04.928 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.945 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:89cd304b:::obj-fill-592:head# 2024-05-08T18:03:04.945 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.962 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:89d04c4a:::obj-fill-388:head# 2024-05-08T18:03:04.962 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.979 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:89db45d9:::obj-fill-247:head# 2024-05-08T18:03:04.979 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:04.995 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8ad879c5:::obj-fill-492:head# 2024-05-08T18:03:04.995 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.012 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8af4b5de:::obj-fill-37:head# 2024-05-08T18:03:05.012 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.028 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8b132e86:::obj-fill-35:head# 2024-05-08T18:03:05.028 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.045 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8b80a60a:::obj-fill-100:head# 2024-05-08T18:03:05.045 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.062 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8bb64fa6:::obj-fill-599:head# 2024-05-08T18:03:05.062 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.078 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8bed03f5:::obj-fill-5:head# 2024-05-08T18:03:05.079 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.095 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8c60e135:::obj-fill-470:head# 2024-05-08T18:03:05.095 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.112 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8c774623:::obj-fill-38:head# 2024-05-08T18:03:05.112 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.129 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2024-05-08T18:03:05.129 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.145 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8cf73826:::obj-fill-460:head# 2024-05-08T18:03:05.145 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.162 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8d3564b3:::obj-fill-452:head# 2024-05-08T18:03:05.162 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.179 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8dfe1ca2:::obj-fill-469:head# 2024-05-08T18:03:05.179 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.195 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8e527672:::obj-fill-246:head# 2024-05-08T18:03:05.195 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.212 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8e96103f:::obj-fill-444:head# 2024-05-08T18:03:05.212 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.229 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8ed6417f:::obj-fill-146:head# 2024-05-08T18:03:05.229 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.245 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8eda2ffc:::obj-fill-539:head# 2024-05-08T18:03:05.246 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.262 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8f08dd48:::obj-fill-26:head# 2024-05-08T18:03:05.262 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.279 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8f111b25:::obj-fill-18:head# 2024-05-08T18:03:05.279 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.296 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:8fde63f8:::obj-fill-338:head# 2024-05-08T18:03:05.296 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.312 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9030746d:::obj-fill-468:head# 2024-05-08T18:03:05.312 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.329 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9115d8a1:::obj-fill-260:head# 2024-05-08T18:03:05.329 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.346 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:91649909:::obj-fill-140:head# 2024-05-08T18:03:05.346 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.362 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:91c1081d:::obj-fill-404:head# 2024-05-08T18:03:05.363 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.379 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:91f42503:::obj-fill-216:head# 2024-05-08T18:03:05.379 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.396 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:927b34a0:::obj-fill-63:head# 2024-05-08T18:03:05.396 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.413 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:92a00a91:::obj-fill-467:head# 2024-05-08T18:03:05.413 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.429 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:930a7268:::obj-fill-450:head# 2024-05-08T18:03:05.429 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.446 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:93c3d0bf:::obj-fill-118:head# 2024-05-08T18:03:05.446 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.462 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:93ca7c9e:::obj-fill-132:head# 2024-05-08T18:03:05.463 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.479 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:942435d5:::obj-fill-378:head# 2024-05-08T18:03:05.479 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.504 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9445f8c5:::obj-fill-245:head# 2024-05-08T18:03:05.504 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.521 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9457c8d9:::obj-fill-535:head# 2024-05-08T18:03:05.521 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.538 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:950dc56e:::obj-fill-348:head# 2024-05-08T18:03:05.538 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.554 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9559ee1d:::obj-fill-545:head# 2024-05-08T18:03:05.554 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.571 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:957c5cc4:::obj-fill-212:head# 2024-05-08T18:03:05.572 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.588 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:95bdac02:::obj-fill-588:head# 2024-05-08T18:03:05.588 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.605 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:95f202af:::obj-fill-126:head# 2024-05-08T18:03:05.605 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.621 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:96789003:::obj-fill-83:head# 2024-05-08T18:03:05.621 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.637 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:96d494a8:::obj-fill-316:head# 2024-05-08T18:03:05.638 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.654 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:97adb85b:::obj-fill-233:head# 2024-05-08T18:03:05.654 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.671 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:980d998c:::obj-fill-197:head# 2024-05-08T18:03:05.671 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.688 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:98235c44:::obj-fill-396:head# 2024-05-08T18:03:05.688 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.704 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:987d3b87:::obj-fill-327:head# 2024-05-08T18:03:05.704 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.721 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:990a5e24:::obj-fill-515:head# 2024-05-08T18:03:05.721 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.738 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:995fec05:::obj-fill-191:head# 2024-05-08T18:03:05.738 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.754 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9a769b75:::obj-fill-587:head# 2024-05-08T18:03:05.755 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.771 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9b141990:::obj-fill-394:head# 2024-05-08T18:03:05.771 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.843 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9bb108fb:::obj-fill-579:head# 2024-05-08T18:03:05.843 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.893 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9ce19d92:::obj-fill-361:head# 2024-05-08T18:03:05.893 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.913 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9d8c3f95:::obj-fill-572:head# 2024-05-08T18:03:05.913 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.929 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9e283e00:::obj-fill-254:head# 2024-05-08T18:03:05.929 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.946 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9e3a1a61:::obj-fill-58:head# 2024-05-08T18:03:05.946 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.963 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9e8f6029:::obj-fill-41:head# 2024-05-08T18:03:05.963 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.979 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9ef117aa:::obj-fill-520:head# 2024-05-08T18:03:05.980 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:05.996 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9f3bdfc2:::obj-fill-184:head# 2024-05-08T18:03:05.996 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.013 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9fd89320:::obj-fill-364:head# 2024-05-08T18:03:06.013 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.030 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:9feb7062:::obj-fill-419:head# 2024-05-08T18:03:06.030 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.046 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a07504c4:::obj-fill-516:head# 2024-05-08T18:03:06.046 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.063 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a1897e34:::obj-fill-153:head# 2024-05-08T18:03:06.063 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.079 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a19a9d76:::obj-fill-30:head# 2024-05-08T18:03:06.080 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.097 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a1a49c98:::obj-fill-98:head# 2024-05-08T18:03:06.097 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.113 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a1ea911a:::obj-fill-36:head# 2024-05-08T18:03:06.113 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.130 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a24bad98:::obj-fill-335:head# 2024-05-08T18:03:06.130 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.146 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a263b16f:::obj-fill-326:head# 2024-05-08T18:03:06.146 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.163 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a27d661e:::obj-fill-152:head# 2024-05-08T18:03:06.163 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.180 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a282a129:::obj-fill-451:head# 2024-05-08T18:03:06.180 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.196 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a28f05ba:::obj-fill-241:head# 2024-05-08T18:03:06.196 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.213 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a2cdc5cc:::obj-fill-180:head# 2024-05-08T18:03:06.213 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.230 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a30777ea:::obj-fill-486:head# 2024-05-08T18:03:06.230 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.273 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a3a65661:::obj-fill-151:head# 2024-05-08T18:03:06.273 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.335 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a3cb2967:::obj-fill-195:head# 2024-05-08T18:03:06.335 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.377 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a3ffc098:::obj-fill-293:head# 2024-05-08T18:03:06.377 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.413 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a4a31ccc:::obj-fill-413:head# 2024-05-08T18:03:06.413 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.430 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a51c3677:::obj-fill-384:head# 2024-05-08T18:03:06.430 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.447 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a5e941a7:::obj-fill-141:head# 2024-05-08T18:03:06.447 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.463 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a6cdd8b2:::obj-fill-342:head# 2024-05-08T18:03:06.463 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.482 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a6e20b86:::obj-fill-593:head# 2024-05-08T18:03:06.482 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.497 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a7a9ccf9:::obj-fill-129:head# 2024-05-08T18:03:06.497 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.513 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a7b702d3:::obj-fill-49:head# 2024-05-08T18:03:06.513 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.530 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a8daf8bd:::obj-fill-391:head# 2024-05-08T18:03:06.530 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.547 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:a99c3cef:::obj-fill-171:head# 2024-05-08T18:03:06.547 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.563 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:aabb5718:::obj-fill-521:head# 2024-05-08T18:03:06.563 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.580 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ab0cb851:::obj-fill-183:head# 2024-05-08T18:03:06.580 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.597 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ab7a05e4:::obj-fill-203:head# 2024-05-08T18:03:06.597 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.622 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ab7dda83:::obj-fill-113:head# 2024-05-08T18:03:06.622 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.638 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:abb3502c:::obj-fill-461:head# 2024-05-08T18:03:06.638 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.655 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ac1c41be:::obj-fill-162:head# 2024-05-08T18:03:06.655 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.672 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ac2114ba:::obj-fill-239:head# 2024-05-08T18:03:06.672 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.689 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ad355fca:::obj-fill-271:head# 2024-05-08T18:03:06.689 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.705 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ad4634a0:::obj-fill-487:head# 2024-05-08T18:03:06.705 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.722 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:add2bb13:::obj-fill-31:head# 2024-05-08T18:03:06.722 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.738 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:aeb6258d:::obj-fill-124:head# 2024-05-08T18:03:06.739 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.755 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:af17f7d7:::obj-fill-464:head# 2024-05-08T18:03:06.755 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.772 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:af1e1cf0:::obj-fill-237:head# 2024-05-08T18:03:06.772 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.789 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:afc439ce:::obj-fill-248:head# 2024-05-08T18:03:06.789 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.805 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:afceab4d:::obj-fill-527:head# 2024-05-08T18:03:06.806 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.822 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b03af40c:::obj-fill-143:head# 2024-05-08T18:03:06.822 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.839 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b04cf0db:::obj-fill-507:head# 2024-05-08T18:03:06.839 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.855 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b07896f0:::obj-fill-269:head# 2024-05-08T18:03:06.856 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.872 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b0b954d5:::obj-fill-524:head# 2024-05-08T18:03:06.872 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.889 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b1cbfcb7:::obj-fill-134:head# 2024-05-08T18:03:06.889 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.906 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b2978fd3:::obj-fill-27:head# 2024-05-08T18:03:06.906 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.922 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b394798f:::obj-fill-156:head# 2024-05-08T18:03:06.922 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.939 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b3c6f36d:::obj-fill-401:head# 2024-05-08T18:03:06.939 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.955 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b3f8e5ac:::obj-fill-290:head# 2024-05-08T18:03:06.955 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.972 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b41ed5f8:::obj-fill-76:head# 2024-05-08T18:03:06.972 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:06.990 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b4878e76:::obj-fill-253:head# 2024-05-08T18:03:06.990 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.005 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b4e19741:::obj-fill-503:head# 2024-05-08T18:03:07.006 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.022 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b53a3690:::obj-fill-264:head# 2024-05-08T18:03:07.022 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.042 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2024-05-08T18:03:07.042 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.055 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b55af5e6:::obj-fill-491:head# 2024-05-08T18:03:07.056 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.097 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b57edf82:::obj-fill-526:head# 2024-05-08T18:03:07.098 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.114 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b589d2be:::obj-fill-323:head# 2024-05-08T18:03:07.115 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.131 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b6207f32:::obj-fill-344:head# 2024-05-08T18:03:07.131 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.147 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b757ee2e:::obj-fill-433:head# 2024-05-08T18:03:07.147 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.164 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b75cc479:::obj-fill-34:head# 2024-05-08T18:03:07.164 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.181 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b7b03117:::obj-fill-42:head# 2024-05-08T18:03:07.181 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.197 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b7e6205d:::obj-fill-501:head# 2024-05-08T18:03:07.197 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.214 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b8d18b7a:::obj-fill-353:head# 2024-05-08T18:03:07.214 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.231 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b9189c29:::obj-fill-328:head# 2024-05-08T18:03:07.231 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.247 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b98e07aa:::obj-fill-54:head# 2024-05-08T18:03:07.247 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.264 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:b9cd1e9a:::obj-fill-371:head# 2024-05-08T18:03:07.264 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.281 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:bc3322bb:::obj-fill-340:head# 2024-05-08T18:03:07.281 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.298 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:bcf43161:::obj-fill-294:head# 2024-05-08T18:03:07.298 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.314 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:bd07fc4f:::obj-fill-549:head# 2024-05-08T18:03:07.314 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.331 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:bdf48e47:::obj-fill-430:head# 2024-05-08T18:03:07.331 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.347 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:be01c111:::obj-fill-1:head# 2024-05-08T18:03:07.348 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.364 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:be3a4bc7:::obj-fill-102:head# 2024-05-08T18:03:07.364 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.381 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:be8e1fcd:::obj-fill-321:head# 2024-05-08T18:03:07.381 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.398 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:bf5fcbac:::obj-fill-287:head# 2024-05-08T18:03:07.398 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.414 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:bf806d14:::obj-fill-115:head# 2024-05-08T18:03:07.414 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.431 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:bfb28823:::obj-fill-72:head# 2024-05-08T18:03:07.431 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.448 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:bfef805e:::obj-fill-119:head# 2024-05-08T18:03:07.448 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.464 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c02f8e10:::obj-fill-497:head# 2024-05-08T18:03:07.465 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.481 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c050cd6e:::obj-fill-8:head# 2024-05-08T18:03:07.481 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.498 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c218e297:::obj-fill-173:head# 2024-05-08T18:03:07.498 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.514 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c2bc66fe:::obj-fill-252:head# 2024-05-08T18:03:07.515 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.531 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c3b55903:::obj-fill-428:head# 2024-05-08T18:03:07.531 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.548 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c51907b0:::obj-fill-457:head# 2024-05-08T18:03:07.548 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.564 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c561dc83:::obj-fill-75:head# 2024-05-08T18:03:07.564 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.581 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c5d1e1a9:::obj-fill-268:head# 2024-05-08T18:03:07.581 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.598 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c60ab0d0:::obj-fill-303:head# 2024-05-08T18:03:07.598 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.614 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c644ce52:::obj-fill-514:head# 2024-05-08T18:03:07.615 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.631 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c6ab3a11:::obj-fill-407:head# 2024-05-08T18:03:07.631 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.648 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c74377bf:::obj-fill-432:head# 2024-05-08T18:03:07.648 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.664 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c767fff6:::obj-fill-531:head# 2024-05-08T18:03:07.665 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.681 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c7a9adad:::obj-fill-475:head# 2024-05-08T18:03:07.682 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.698 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c7e3a9c2:::obj-fill-465:head# 2024-05-08T18:03:07.698 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.715 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c850aed7:::obj-fill-424:head# 2024-05-08T18:03:07.715 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.731 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c8a0088a:::obj-fill-329:head# 2024-05-08T18:03:07.731 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.771 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:c9d419f9:::obj-fill-176:head# 2024-05-08T18:03:07.772 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.780 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:caf25ec2:::obj-fill-274:head# 2024-05-08T18:03:07.780 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.814 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cb625830:::obj-fill-70:head# 2024-05-08T18:03:07.814 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.869 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cbb65125:::obj-fill-529:head# 2024-05-08T18:03:07.869 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.888 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cbe2544c:::obj-fill-3:head# 2024-05-08T18:03:07.888 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.896 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cbfce4ee:::obj-fill-455:head# 2024-05-08T18:03:07.897 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.905 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cc62419c:::obj-fill-498:head# 2024-05-08T18:03:07.905 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.913 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cce831fa:::obj-fill-160:head# 2024-05-08T18:03:07.913 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.922 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cda71af4:::obj-fill-122:head# 2024-05-08T18:03:07.922 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.930 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cea7a728:::obj-fill-265:head# 2024-05-08T18:03:07.930 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.938 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cee19f0a:::obj-fill-142:head# 2024-05-08T18:03:07.938 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.947 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cf22117e:::obj-fill-499:head# 2024-05-08T18:03:07.947 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.955 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cfbfa66d:::obj-fill-66:head# 2024-05-08T18:03:07.955 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.963 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cfc2552c:::obj-fill-211:head# 2024-05-08T18:03:07.963 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.972 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:cfc563e8:::obj-fill-392:head# 2024-05-08T18:03:07.972 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.980 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d02d8880:::obj-fill-362:head# 2024-05-08T18:03:07.980 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.988 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d054947e:::obj-fill-67:head# 2024-05-08T18:03:07.988 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:07.997 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d061c977:::obj-fill-164:head# 2024-05-08T18:03:07.997 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.005 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d06a5f57:::obj-fill-296:head# 2024-05-08T18:03:08.005 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.013 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d110062a:::obj-fill-343:head# 2024-05-08T18:03:08.014 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.022 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d1b8ad47:::obj-fill-383:head# 2024-05-08T18:03:08.022 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.030 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d1e80db6:::obj-fill-117:head# 2024-05-08T18:03:08.030 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.038 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d210027e:::obj-fill-231:head# 2024-05-08T18:03:08.039 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.047 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d24428ed:::obj-fill-199:head# 2024-05-08T18:03:08.047 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.055 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d27c3c4b:::obj-fill-154:head# 2024-05-08T18:03:08.055 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.097 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d28957e3:::obj-fill-263:head# 2024-05-08T18:03:08.097 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.105 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d2d44da7:::obj-fill-544:head# 2024-05-08T18:03:08.105 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.114 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d31004a4:::obj-fill-434:head# 2024-05-08T18:03:08.114 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.122 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d32487c3:::obj-fill-385:head# 2024-05-08T18:03:08.122 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.130 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d340891c:::obj-fill-12:head# 2024-05-08T18:03:08.130 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.139 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d4135728:::obj-fill-310:head# 2024-05-08T18:03:08.139 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.147 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d5a43972:::obj-fill-9:head# 2024-05-08T18:03:08.147 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.155 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d5efeb15:::obj-fill-347:head# 2024-05-08T18:03:08.156 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.164 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d6463f70:::obj-fill-536:head# 2024-05-08T18:03:08.164 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.172 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d666d9b7:::obj-fill-420:head# 2024-05-08T18:03:08.173 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.180 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d6e86688:::obj-fill-166:head# 2024-05-08T18:03:08.180 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.189 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d730370d:::obj-fill-206:head# 2024-05-08T18:03:08.189 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.197 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d783551c:::obj-fill-109:head# 2024-05-08T18:03:08.197 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.205 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d7f77e5f:::obj-fill-551:head# 2024-05-08T18:03:08.206 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.214 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d843056c:::obj-fill-291:head# 2024-05-08T18:03:08.214 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.222 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d84eb173:::obj-fill-221:head# 2024-05-08T18:03:08.222 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.231 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d8dd069c:::obj-fill-60:head# 2024-05-08T18:03:08.231 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.239 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d8f2f750:::obj-fill-562:head# 2024-05-08T18:03:08.239 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.289 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d8f80ac2:::obj-fill-179:head# 2024-05-08T18:03:08.289 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.331 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:d9f904cf:::obj-fill-308:head# 2024-05-08T18:03:08.332 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.386 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:db0a534b:::obj-fill-410:head# 2024-05-08T18:03:08.387 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.405 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:dc4403f4:::obj-fill-416:head# 2024-05-08T18:03:08.406 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.414 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:dc66c3ca:::obj-fill-220:head# 2024-05-08T18:03:08.414 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.422 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:dc8198dc:::obj-fill-596:head# 2024-05-08T18:03:08.422 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.431 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:dcbade2b:::obj-fill-10:head# 2024-05-08T18:03:08.431 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.439 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ddb787ea:::obj-fill-556:head# 2024-05-08T18:03:08.439 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.447 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:de58065b:::obj-fill-306:head# 2024-05-08T18:03:08.447 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.456 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:deaa6fab:::obj-fill-194:head# 2024-05-08T18:03:08.456 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.464 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:dfee7714:::obj-fill-202:head# 2024-05-08T18:03:08.464 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.472 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:dff5df4a:::obj-fill-565:head# 2024-05-08T18:03:08.473 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.481 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e2053442:::obj-fill-107:head# 2024-05-08T18:03:08.481 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.489 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e32055b8:::obj-fill-57:head# 2024-05-08T18:03:08.489 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.497 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e37fac1e:::obj-fill-161:head# 2024-05-08T18:03:08.498 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.506 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e388f5aa:::obj-fill-273:head# 2024-05-08T18:03:08.506 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.548 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e38b1f4d:::obj-fill-393:head# 2024-05-08T18:03:08.548 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.556 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e4792474:::obj-fill-158:head# 2024-05-08T18:03:08.556 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.564 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e4899cb0:::obj-fill-270:head# 2024-05-08T18:03:08.564 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.572 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e62ae9f1:::obj-fill-288:head# 2024-05-08T18:03:08.573 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.581 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e64fd95a:::obj-fill-449:head# 2024-05-08T18:03:08.581 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.589 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e6682cfc:::obj-fill-373:head# 2024-05-08T18:03:08.589 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.597 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e716717b:::obj-fill-178:head# 2024-05-08T18:03:08.598 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.606 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e80226af:::obj-fill-354:head# 2024-05-08T18:03:08.606 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.614 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e83a5940:::obj-fill-564:head# 2024-05-08T18:03:08.614 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.623 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e854bfbe:::obj-fill-589:head# 2024-05-08T18:03:08.623 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.631 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e8b197bc:::obj-fill-89:head# 2024-05-08T18:03:08.631 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.639 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e92fca88:::obj-fill-397:head# 2024-05-08T18:03:08.639 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.648 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e94d8f7b:::obj-fill-261:head# 2024-05-08T18:03:08.648 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.656 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:e98cc0a4:::obj-fill-525:head# 2024-05-08T18:03:08.656 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.664 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ea5a9459:::obj-fill-431:head# 2024-05-08T18:03:08.665 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.673 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ebc54d47:::obj-fill-258:head# 2024-05-08T18:03:08.673 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.681 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ec0002dd:::obj-fill-205:head# 2024-05-08T18:03:08.681 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.689 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ec740b5c:::obj-fill-46:head# 2024-05-08T18:03:08.690 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.698 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ed35dda4:::obj-fill-170:head# 2024-05-08T18:03:08.698 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.706 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ed51b8f7:::obj-fill-91:head# 2024-05-08T18:03:08.706 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.714 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:edd96161:::obj-fill-48:head# 2024-05-08T18:03:08.715 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.723 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ee3f0d4b:::obj-fill-47:head# 2024-05-08T18:03:08.723 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.734 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ee4784dd:::obj-fill-480:head# 2024-05-08T18:03:08.734 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.740 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ee5a8271:::obj-fill-198:head# 2024-05-08T18:03:08.740 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.748 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ef745b66:::obj-fill-145:head# 2024-05-08T18:03:08.748 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.756 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:efa5309d:::obj-fill-215:head# 2024-05-08T18:03:08.756 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.765 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:efbdd3a1:::obj-fill-276:head# 2024-05-08T18:03:08.765 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.773 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f059d4c0:::obj-fill-482:head# 2024-05-08T18:03:08.773 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.781 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f0f9fb7a:::obj-fill-379:head# 2024-05-08T18:03:08.781 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.790 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f16a3656:::obj-fill-462:head# 2024-05-08T18:03:08.790 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.832 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f1b395ae:::obj-fill-25:head# 2024-05-08T18:03:08.832 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.840 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f5876dad:::obj-fill-359:head# 2024-05-08T18:03:08.840 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.848 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f5a283cd:::obj-fill-534:head# 2024-05-08T18:03:08.848 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.856 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f5cd905a:::obj-fill-358:head# 2024-05-08T18:03:08.857 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.865 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f5e48302:::obj-fill-406:head# 2024-05-08T18:03:08.865 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.873 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f5ea65fc:::obj-fill-52:head# 2024-05-08T18:03:08.873 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.881 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f642de6b:::obj-fill-204:head# 2024-05-08T18:03:08.882 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.890 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f716eafd:::obj-fill-502:head# 2024-05-08T18:03:08.890 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.898 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f752e9cb:::obj-fill-23:head# 2024-05-08T18:03:08.898 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.907 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f85fe42c:::obj-fill-346:head# 2024-05-08T18:03:08.907 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.915 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:f882fd3b:::obj-fill-355:head# 2024-05-08T18:03:08.915 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.923 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fa133332:::obj-fill-309:head# 2024-05-08T18:03:08.923 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.932 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fa875e52:::obj-fill-64:head# 2024-05-08T18:03:08.932 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.942 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fad91a22:::obj-fill-481:head# 2024-05-08T18:03:08.942 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.948 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fbbc3122:::obj-fill-111:head# 2024-05-08T18:03:08.948 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.957 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fc539ddb:::obj-fill-181:head# 2024-05-08T18:03:08.957 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.965 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fc54128d:::obj-fill-104:head# 2024-05-08T18:03:08.965 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.973 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fe00aded:::obj-fill-365:head# 2024-05-08T18:03:08.974 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.982 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fe1e9971:::obj-fill-189:head# 2024-05-08T18:03:08.982 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.990 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ff0e0563:::obj-fill-508:head# 2024-05-08T18:03:08.990 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:08.998 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ff4e156c:::obj-fill-441:head# 2024-05-08T18:03:08.998 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:09.007 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:ffa355f7:::obj-fill-500:head# 2024-05-08T18:03:09.007 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:09.015 INFO:tasks.workunit.client.0.smithi117.stdout:Write #1:fff6c93b:::obj-fill-277:head# 2024-05-08T18:03:09.015 INFO:tasks.workunit.client.0.smithi117.stdout:snapset 0=[]:{} 2024-05-08T18:03:09.024 INFO:tasks.workunit.client.0.smithi117.stdout:write_pg epoch 36 info 1.0( v 36'600 (36'500,36'600] local-lis/les=24/25 n=600 ec=21/21 lis/c=24/24 les/c/f=25/25/0 sis=24) 2024-05-08T18:03:09.040 INFO:tasks.workunit.client.0.smithi117.stdout:Import successful 2024-05-08T18:03:09.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:495: TEST_backfill_multi_partial: ceph pg dump pgs 2024-05-08T18:03:09.981 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:03:09.981 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:02:40.593761+0000 0'0 48:35 [2,0] 2 [2,0] 2 0'0 2024-05-08T17:59:29.398606+0000 0'0 2024-05-08T17:59:29.398606+0000 0 0 periodic scrub scheduled @ 2024-05-09T18:24:28.190256+0000 0 0 2024-05-08T18:03:09.981 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 600 0 0 0 0 614400 0 0 100 500 100 active+clean 2024-05-08T18:02:40.685985+0000 42'600 48:663 [2,0] 2 [2,0] 2 0'0 2024-05-08T17:59:26.608578+0000 0'0 2024-05-08T17:59:26.608578+0000 0 0 periodic scrub scheduled @ 2024-05-09T23:31:43.256696+0000 0 0 2024-05-08T18:03:09.982 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 600 0 0 0 0 1566600 0 0 100 500 100 stale+active+clean 2024-05-08T17:59:26.468644+0000 36'600 36:641 [1] 1 [1] 1 0'0 2024-05-08T17:59:23.872011+0000 0'0 2024-05-08T17:59:23.872011+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:36:40.373032+0000 0 0 2024-05-08T18:03:09.982 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:03:09.982 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:03:09.982 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:03:09.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:496: TEST_backfill_multi_partial: sleep 20 2024-05-08T18:03:29.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:497: TEST_backfill_multi_partial: ceph pg dump pgs 2024-05-08T18:03:30.402 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:03:30.403 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:02:40.593761+0000 0'0 48:35 [2,0] 2 [2,0] 2 0'0 2024-05-08T17:59:29.398606+0000 0'0 2024-05-08T17:59:29.398606+0000 0 0 periodic scrub scheduled @ 2024-05-09T18:24:28.190256+0000 0 0 2024-05-08T18:03:30.403 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 600 0 0 0 0 614400 0 0 100 500 100 active+clean 2024-05-08T18:02:40.685985+0000 42'600 48:663 [2,0] 2 [2,0] 2 0'0 2024-05-08T17:59:26.608578+0000 0'0 2024-05-08T17:59:26.608578+0000 0 0 periodic scrub scheduled @ 2024-05-09T23:31:43.256696+0000 0 0 2024-05-08T18:03:30.403 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 600 0 0 0 0 1566600 0 0 100 500 100 stale+active+clean 2024-05-08T17:59:26.468644+0000 36'600 36:641 [1] 1 [1] 1 0'0 2024-05-08T17:59:23.872011+0000 0'0 2024-05-08T17:59:23.872011+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:36:40.373032+0000 0 0 2024-05-08T18:03:30.403 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:03:30.403 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:03:30.403 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:03:30.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=2611 count=1 2024-05-08T18:03:30.419 INFO:tasks.workunit.client.0.smithi117.stderr:1+0 records in 2024-05-08T18:03:30.419 INFO:tasks.workunit.client.0.smithi117.stderr:1+0 records out 2024-05-08T18:03:30.419 INFO:tasks.workunit.client.0.smithi117.stderr:2611 bytes (2.6 kB, 2.5 KiB) copied, 0.000156834 s, 16.6 MB/s 2024-05-08T18:03:30.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: seq 1 600 2024-05-08T18:03:30.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:30.422 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:30.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:30.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-1 td/osd-backfill-space/datafile 2024-05-08T18:03:30.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:30.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-1 td/osd-backfill-space/datafile 2024-05-08T18:03:30.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:30.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:30.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:30.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-2 td/osd-backfill-space/datafile 2024-05-08T18:03:30.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:30.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-2 td/osd-backfill-space/datafile 2024-05-08T18:03:30.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:30.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:30.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:30.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-3 td/osd-backfill-space/datafile 2024-05-08T18:03:30.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:30.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-3 td/osd-backfill-space/datafile 2024-05-08T18:03:31.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:31.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:31.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-4 td/osd-backfill-space/datafile 2024-05-08T18:03:31.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-4 td/osd-backfill-space/datafile 2024-05-08T18:03:31.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:31.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:31.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-5 td/osd-backfill-space/datafile 2024-05-08T18:03:31.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-5 td/osd-backfill-space/datafile 2024-05-08T18:03:31.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:31.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:31.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-6 td/osd-backfill-space/datafile 2024-05-08T18:03:31.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-6 td/osd-backfill-space/datafile 2024-05-08T18:03:31.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:31.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:31.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-7 td/osd-backfill-space/datafile 2024-05-08T18:03:31.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-7 td/osd-backfill-space/datafile 2024-05-08T18:03:31.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:31.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:31.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:31.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-8 td/osd-backfill-space/datafile 2024-05-08T18:03:32.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:32.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-8 td/osd-backfill-space/datafile 2024-05-08T18:03:32.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:32.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:32.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:32.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-9 td/osd-backfill-space/datafile 2024-05-08T18:03:32.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:32.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-9 td/osd-backfill-space/datafile 2024-05-08T18:03:32.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:32.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:32.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:32.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-10 td/osd-backfill-space/datafile 2024-05-08T18:03:32.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:32.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-10 td/osd-backfill-space/datafile 2024-05-08T18:03:32.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:32.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:32.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:32.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-11 td/osd-backfill-space/datafile 2024-05-08T18:03:32.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:32.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-11 td/osd-backfill-space/datafile 2024-05-08T18:03:32.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:32.922 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-12 td/osd-backfill-space/datafile 2024-05-08T18:03:33.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-12 td/osd-backfill-space/datafile 2024-05-08T18:03:33.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:33.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:33.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-13 td/osd-backfill-space/datafile 2024-05-08T18:03:33.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-13 td/osd-backfill-space/datafile 2024-05-08T18:03:33.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:33.373 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:33.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-14 td/osd-backfill-space/datafile 2024-05-08T18:03:33.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-14 td/osd-backfill-space/datafile 2024-05-08T18:03:33.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:33.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:33.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-15 td/osd-backfill-space/datafile 2024-05-08T18:03:33.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-15 td/osd-backfill-space/datafile 2024-05-08T18:03:33.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:33.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:33.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-16 td/osd-backfill-space/datafile 2024-05-08T18:03:33.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:33.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-16 td/osd-backfill-space/datafile 2024-05-08T18:03:34.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:34.075 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:34.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:34.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-17 td/osd-backfill-space/datafile 2024-05-08T18:03:34.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:34.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-17 td/osd-backfill-space/datafile 2024-05-08T18:03:34.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:34.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:34.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:34.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-18 td/osd-backfill-space/datafile 2024-05-08T18:03:34.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:34.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-18 td/osd-backfill-space/datafile 2024-05-08T18:03:34.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:34.569 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:34.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:34.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-19 td/osd-backfill-space/datafile 2024-05-08T18:03:34.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:34.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-19 td/osd-backfill-space/datafile 2024-05-08T18:03:34.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:34.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:34.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:34.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-20 td/osd-backfill-space/datafile 2024-05-08T18:03:34.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:34.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-20 td/osd-backfill-space/datafile 2024-05-08T18:03:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:35.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-21 td/osd-backfill-space/datafile 2024-05-08T18:03:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-21 td/osd-backfill-space/datafile 2024-05-08T18:03:35.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:35.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:35.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:35.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-22 td/osd-backfill-space/datafile 2024-05-08T18:03:35.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:35.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-22 td/osd-backfill-space/datafile 2024-05-08T18:03:35.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:35.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:35.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:35.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-23 td/osd-backfill-space/datafile 2024-05-08T18:03:35.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:35.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-23 td/osd-backfill-space/datafile 2024-05-08T18:03:35.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:35.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:35.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:35.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-24 td/osd-backfill-space/datafile 2024-05-08T18:03:35.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:35.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-24 td/osd-backfill-space/datafile 2024-05-08T18:03:36.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:36.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:36.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-25 td/osd-backfill-space/datafile 2024-05-08T18:03:36.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-25 td/osd-backfill-space/datafile 2024-05-08T18:03:36.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:36.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:36.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-26 td/osd-backfill-space/datafile 2024-05-08T18:03:36.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-26 td/osd-backfill-space/datafile 2024-05-08T18:03:36.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:36.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:36.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-27 td/osd-backfill-space/datafile 2024-05-08T18:03:36.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-27 td/osd-backfill-space/datafile 2024-05-08T18:03:36.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:36.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:36.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-28 td/osd-backfill-space/datafile 2024-05-08T18:03:36.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-28 td/osd-backfill-space/datafile 2024-05-08T18:03:36.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:36.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:36.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:36.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-29 td/osd-backfill-space/datafile 2024-05-08T18:03:37.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:37.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile 2024-05-08T18:03:37.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:37.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:37.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:37.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-30 td/osd-backfill-space/datafile 2024-05-08T18:03:37.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:37.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-30 td/osd-backfill-space/datafile 2024-05-08T18:03:37.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:37.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:37.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:37.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-31 td/osd-backfill-space/datafile 2024-05-08T18:03:37.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:37.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-31 td/osd-backfill-space/datafile 2024-05-08T18:03:37.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:37.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:37.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:37.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-32 td/osd-backfill-space/datafile 2024-05-08T18:03:37.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:37.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-32 td/osd-backfill-space/datafile 2024-05-08T18:03:37.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:37.913 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:37.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:37.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-33 td/osd-backfill-space/datafile 2024-05-08T18:03:38.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-33 td/osd-backfill-space/datafile 2024-05-08T18:03:38.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:38.122 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:38.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-34 td/osd-backfill-space/datafile 2024-05-08T18:03:38.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-34 td/osd-backfill-space/datafile 2024-05-08T18:03:38.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:38.390 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:38.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-35 td/osd-backfill-space/datafile 2024-05-08T18:03:38.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-35 td/osd-backfill-space/datafile 2024-05-08T18:03:38.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:38.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:38.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-36 td/osd-backfill-space/datafile 2024-05-08T18:03:38.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-36 td/osd-backfill-space/datafile 2024-05-08T18:03:38.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:38.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:38.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-37 td/osd-backfill-space/datafile 2024-05-08T18:03:38.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:38.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-37 td/osd-backfill-space/datafile 2024-05-08T18:03:39.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:39.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:39.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:39.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-38 td/osd-backfill-space/datafile 2024-05-08T18:03:39.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:39.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-38 td/osd-backfill-space/datafile 2024-05-08T18:03:39.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:39.293 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:39.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:39.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-39 td/osd-backfill-space/datafile 2024-05-08T18:03:39.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:39.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-39 td/osd-backfill-space/datafile 2024-05-08T18:03:39.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:39.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:39.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:39.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-40 td/osd-backfill-space/datafile 2024-05-08T18:03:39.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:39.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-40 td/osd-backfill-space/datafile 2024-05-08T18:03:39.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:39.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:39.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:39.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-41 td/osd-backfill-space/datafile 2024-05-08T18:03:39.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:39.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-41 td/osd-backfill-space/datafile 2024-05-08T18:03:40.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:40.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:40.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:40.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-42 td/osd-backfill-space/datafile 2024-05-08T18:03:40.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:40.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-42 td/osd-backfill-space/datafile 2024-05-08T18:03:40.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:40.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:40.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:40.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-43 td/osd-backfill-space/datafile 2024-05-08T18:03:40.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:40.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-43 td/osd-backfill-space/datafile 2024-05-08T18:03:40.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:40.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:40.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:40.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-44 td/osd-backfill-space/datafile 2024-05-08T18:03:40.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:40.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-44 td/osd-backfill-space/datafile 2024-05-08T18:03:40.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:40.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:40.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:40.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-45 td/osd-backfill-space/datafile 2024-05-08T18:03:40.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:40.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-45 td/osd-backfill-space/datafile 2024-05-08T18:03:41.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:41.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:41.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-46 td/osd-backfill-space/datafile 2024-05-08T18:03:41.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile 2024-05-08T18:03:41.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:41.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:41.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-47 td/osd-backfill-space/datafile 2024-05-08T18:03:41.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-47 td/osd-backfill-space/datafile 2024-05-08T18:03:41.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:41.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-48 td/osd-backfill-space/datafile 2024-05-08T18:03:41.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-48 td/osd-backfill-space/datafile 2024-05-08T18:03:41.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:41.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:41.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-49 td/osd-backfill-space/datafile 2024-05-08T18:03:41.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-49 td/osd-backfill-space/datafile 2024-05-08T18:03:41.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:41.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:41.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:41.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-50 td/osd-backfill-space/datafile 2024-05-08T18:03:42.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:42.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-50 td/osd-backfill-space/datafile 2024-05-08T18:03:42.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:42.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:42.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:42.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-51 td/osd-backfill-space/datafile 2024-05-08T18:03:42.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:42.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-51 td/osd-backfill-space/datafile 2024-05-08T18:03:42.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:42.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:42.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:42.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-52 td/osd-backfill-space/datafile 2024-05-08T18:03:42.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:42.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-52 td/osd-backfill-space/datafile 2024-05-08T18:03:42.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:42.671 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:42.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:42.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-53 td/osd-backfill-space/datafile 2024-05-08T18:03:42.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:42.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-53 td/osd-backfill-space/datafile 2024-05-08T18:03:42.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:42.930 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:42.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:42.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-54 td/osd-backfill-space/datafile 2024-05-08T18:03:43.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-54 td/osd-backfill-space/datafile 2024-05-08T18:03:43.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:43.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:43.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-55 td/osd-backfill-space/datafile 2024-05-08T18:03:43.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-55 td/osd-backfill-space/datafile 2024-05-08T18:03:43.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:43.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:43.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-56 td/osd-backfill-space/datafile 2024-05-08T18:03:43.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-56 td/osd-backfill-space/datafile 2024-05-08T18:03:43.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:43.556 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:43.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-57 td/osd-backfill-space/datafile 2024-05-08T18:03:43.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-57 td/osd-backfill-space/datafile 2024-05-08T18:03:43.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:43.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:43.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-58 td/osd-backfill-space/datafile 2024-05-08T18:03:43.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-58 td/osd-backfill-space/datafile 2024-05-08T18:03:43.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:43.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:43.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:43.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-59 td/osd-backfill-space/datafile 2024-05-08T18:03:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-59 td/osd-backfill-space/datafile 2024-05-08T18:03:44.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:44.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:44.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-60 td/osd-backfill-space/datafile 2024-05-08T18:03:44.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-60 td/osd-backfill-space/datafile 2024-05-08T18:03:44.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:44.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:44.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-61 td/osd-backfill-space/datafile 2024-05-08T18:03:44.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-61 td/osd-backfill-space/datafile 2024-05-08T18:03:44.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:44.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:44.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-62 td/osd-backfill-space/datafile 2024-05-08T18:03:44.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-62 td/osd-backfill-space/datafile 2024-05-08T18:03:44.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:44.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:44.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile 2024-05-08T18:03:44.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2024-05-08T18:03:44.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:44.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:44.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:44.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-64 td/osd-backfill-space/datafile 2024-05-08T18:03:45.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-64 td/osd-backfill-space/datafile 2024-05-08T18:03:45.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:45.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:45.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-65 td/osd-backfill-space/datafile 2024-05-08T18:03:45.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-65 td/osd-backfill-space/datafile 2024-05-08T18:03:45.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:45.352 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:45.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-66 td/osd-backfill-space/datafile 2024-05-08T18:03:45.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-66 td/osd-backfill-space/datafile 2024-05-08T18:03:45.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:45.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:45.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-67 td/osd-backfill-space/datafile 2024-05-08T18:03:45.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-67 td/osd-backfill-space/datafile 2024-05-08T18:03:45.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:45.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:45.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-68 td/osd-backfill-space/datafile 2024-05-08T18:03:45.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-68 td/osd-backfill-space/datafile 2024-05-08T18:03:45.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:45.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:45.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:45.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-69 td/osd-backfill-space/datafile 2024-05-08T18:03:46.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-69 td/osd-backfill-space/datafile 2024-05-08T18:03:46.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:46.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:46.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-70 td/osd-backfill-space/datafile 2024-05-08T18:03:46.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-70 td/osd-backfill-space/datafile 2024-05-08T18:03:46.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:46.240 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:46.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-71 td/osd-backfill-space/datafile 2024-05-08T18:03:46.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-71 td/osd-backfill-space/datafile 2024-05-08T18:03:46.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:46.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:46.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-72 td/osd-backfill-space/datafile 2024-05-08T18:03:46.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-72 td/osd-backfill-space/datafile 2024-05-08T18:03:46.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:46.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:46.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-73 td/osd-backfill-space/datafile 2024-05-08T18:03:46.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-73 td/osd-backfill-space/datafile 2024-05-08T18:03:46.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:46.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:46.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-74 td/osd-backfill-space/datafile 2024-05-08T18:03:46.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-74 td/osd-backfill-space/datafile 2024-05-08T18:03:46.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:46.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:46.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-75 td/osd-backfill-space/datafile 2024-05-08T18:03:46.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-75 td/osd-backfill-space/datafile 2024-05-08T18:03:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:46.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:46.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:46.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-76 td/osd-backfill-space/datafile 2024-05-08T18:03:47.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-76 td/osd-backfill-space/datafile 2024-05-08T18:03:47.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:47.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:47.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-77 td/osd-backfill-space/datafile 2024-05-08T18:03:47.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-77 td/osd-backfill-space/datafile 2024-05-08T18:03:47.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:47.273 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:47.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-78 td/osd-backfill-space/datafile 2024-05-08T18:03:47.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-78 td/osd-backfill-space/datafile 2024-05-08T18:03:47.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:47.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:47.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-79 td/osd-backfill-space/datafile 2024-05-08T18:03:47.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-79 td/osd-backfill-space/datafile 2024-05-08T18:03:47.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:47.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:47.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile 2024-05-08T18:03:47.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-80 td/osd-backfill-space/datafile 2024-05-08T18:03:47.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:47.732 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:47.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-81 td/osd-backfill-space/datafile 2024-05-08T18:03:47.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-81 td/osd-backfill-space/datafile 2024-05-08T18:03:47.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:47.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:47.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:47.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-82 td/osd-backfill-space/datafile 2024-05-08T18:03:48.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-82 td/osd-backfill-space/datafile 2024-05-08T18:03:48.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:48.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:48.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-83 td/osd-backfill-space/datafile 2024-05-08T18:03:48.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-83 td/osd-backfill-space/datafile 2024-05-08T18:03:48.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:48.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:48.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-84 td/osd-backfill-space/datafile 2024-05-08T18:03:48.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-84 td/osd-backfill-space/datafile 2024-05-08T18:03:48.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:48.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:48.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-85 td/osd-backfill-space/datafile 2024-05-08T18:03:48.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-85 td/osd-backfill-space/datafile 2024-05-08T18:03:48.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:48.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:48.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-86 td/osd-backfill-space/datafile 2024-05-08T18:03:48.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-86 td/osd-backfill-space/datafile 2024-05-08T18:03:48.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:48.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:48.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-87 td/osd-backfill-space/datafile 2024-05-08T18:03:48.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-87 td/osd-backfill-space/datafile 2024-05-08T18:03:48.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:48.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:48.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:48.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-88 td/osd-backfill-space/datafile 2024-05-08T18:03:49.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-88 td/osd-backfill-space/datafile 2024-05-08T18:03:49.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:49.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:49.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-89 td/osd-backfill-space/datafile 2024-05-08T18:03:49.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-89 td/osd-backfill-space/datafile 2024-05-08T18:03:49.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:49.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:49.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-90 td/osd-backfill-space/datafile 2024-05-08T18:03:49.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-90 td/osd-backfill-space/datafile 2024-05-08T18:03:49.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:49.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:49.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-91 td/osd-backfill-space/datafile 2024-05-08T18:03:49.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-91 td/osd-backfill-space/datafile 2024-05-08T18:03:49.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:49.598 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:49.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-92 td/osd-backfill-space/datafile 2024-05-08T18:03:49.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-92 td/osd-backfill-space/datafile 2024-05-08T18:03:49.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:49.748 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-93 td/osd-backfill-space/datafile 2024-05-08T18:03:49.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-93 td/osd-backfill-space/datafile 2024-05-08T18:03:49.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:49.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:49.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-94 td/osd-backfill-space/datafile 2024-05-08T18:03:49.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:49.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-94 td/osd-backfill-space/datafile 2024-05-08T18:03:50.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:50.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:50.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-95 td/osd-backfill-space/datafile 2024-05-08T18:03:50.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-95 td/osd-backfill-space/datafile 2024-05-08T18:03:50.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:50.215 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:50.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-96 td/osd-backfill-space/datafile 2024-05-08T18:03:50.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-96 td/osd-backfill-space/datafile 2024-05-08T18:03:50.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:50.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:50.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2024-05-08T18:03:50.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-97 td/osd-backfill-space/datafile 2024-05-08T18:03:50.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:50.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:50.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-98 td/osd-backfill-space/datafile 2024-05-08T18:03:50.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-98 td/osd-backfill-space/datafile 2024-05-08T18:03:50.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:50.723 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:50.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-99 td/osd-backfill-space/datafile 2024-05-08T18:03:50.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-99 td/osd-backfill-space/datafile 2024-05-08T18:03:50.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:50.873 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:50.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-100 td/osd-backfill-space/datafile 2024-05-08T18:03:50.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:50.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-100 td/osd-backfill-space/datafile 2024-05-08T18:03:51.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:51.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:51.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-101 td/osd-backfill-space/datafile 2024-05-08T18:03:51.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-101 td/osd-backfill-space/datafile 2024-05-08T18:03:51.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:51.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:51.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-102 td/osd-backfill-space/datafile 2024-05-08T18:03:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-102 td/osd-backfill-space/datafile 2024-05-08T18:03:51.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:51.315 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:51.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-103 td/osd-backfill-space/datafile 2024-05-08T18:03:51.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-103 td/osd-backfill-space/datafile 2024-05-08T18:03:51.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:51.507 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:51.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-104 td/osd-backfill-space/datafile 2024-05-08T18:03:51.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-104 td/osd-backfill-space/datafile 2024-05-08T18:03:51.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:51.656 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:51.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-105 td/osd-backfill-space/datafile 2024-05-08T18:03:51.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-105 td/osd-backfill-space/datafile 2024-05-08T18:03:51.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:51.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:51.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-106 td/osd-backfill-space/datafile 2024-05-08T18:03:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-106 td/osd-backfill-space/datafile 2024-05-08T18:03:52.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:52.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:52.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-107 td/osd-backfill-space/datafile 2024-05-08T18:03:52.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-107 td/osd-backfill-space/datafile 2024-05-08T18:03:52.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:52.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:52.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-108 td/osd-backfill-space/datafile 2024-05-08T18:03:52.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-108 td/osd-backfill-space/datafile 2024-05-08T18:03:52.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:52.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:52.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-109 td/osd-backfill-space/datafile 2024-05-08T18:03:52.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-109 td/osd-backfill-space/datafile 2024-05-08T18:03:52.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:52.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:52.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-110 td/osd-backfill-space/datafile 2024-05-08T18:03:52.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-110 td/osd-backfill-space/datafile 2024-05-08T18:03:52.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:52.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:52.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-111 td/osd-backfill-space/datafile 2024-05-08T18:03:52.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-111 td/osd-backfill-space/datafile 2024-05-08T18:03:52.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:52.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:52.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-112 td/osd-backfill-space/datafile 2024-05-08T18:03:52.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:52.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-112 td/osd-backfill-space/datafile 2024-05-08T18:03:52.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:52.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:53.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-113 td/osd-backfill-space/datafile 2024-05-08T18:03:53.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-113 td/osd-backfill-space/datafile 2024-05-08T18:03:53.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:53.148 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:53.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-114 td/osd-backfill-space/datafile 2024-05-08T18:03:53.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-114 td/osd-backfill-space/datafile 2024-05-08T18:03:53.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:53.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:53.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-115 td/osd-backfill-space/datafile 2024-05-08T18:03:53.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-115 td/osd-backfill-space/datafile 2024-05-08T18:03:53.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:53.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:53.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-116 td/osd-backfill-space/datafile 2024-05-08T18:03:53.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-116 td/osd-backfill-space/datafile 2024-05-08T18:03:53.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:53.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:53.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-117 td/osd-backfill-space/datafile 2024-05-08T18:03:53.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-117 td/osd-backfill-space/datafile 2024-05-08T18:03:53.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:53.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:53.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-118 td/osd-backfill-space/datafile 2024-05-08T18:03:53.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-118 td/osd-backfill-space/datafile 2024-05-08T18:03:53.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:53.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:53.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-119 td/osd-backfill-space/datafile 2024-05-08T18:03:53.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:53.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-119 td/osd-backfill-space/datafile 2024-05-08T18:03:54.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:54.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:54.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-120 td/osd-backfill-space/datafile 2024-05-08T18:03:54.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-120 td/osd-backfill-space/datafile 2024-05-08T18:03:54.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:54.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:54.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-121 td/osd-backfill-space/datafile 2024-05-08T18:03:54.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-121 td/osd-backfill-space/datafile 2024-05-08T18:03:54.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:54.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:54.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-122 td/osd-backfill-space/datafile 2024-05-08T18:03:54.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-122 td/osd-backfill-space/datafile 2024-05-08T18:03:54.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:54.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:54.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-123 td/osd-backfill-space/datafile 2024-05-08T18:03:54.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-123 td/osd-backfill-space/datafile 2024-05-08T18:03:54.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:54.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:54.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-124 td/osd-backfill-space/datafile 2024-05-08T18:03:54.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-124 td/osd-backfill-space/datafile 2024-05-08T18:03:54.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:54.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:54.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-125 td/osd-backfill-space/datafile 2024-05-08T18:03:54.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:54.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-125 td/osd-backfill-space/datafile 2024-05-08T18:03:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:55.065 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:55.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-126 td/osd-backfill-space/datafile 2024-05-08T18:03:55.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-126 td/osd-backfill-space/datafile 2024-05-08T18:03:55.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:55.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:55.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-127 td/osd-backfill-space/datafile 2024-05-08T18:03:55.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-127 td/osd-backfill-space/datafile 2024-05-08T18:03:55.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:55.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:55.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-128 td/osd-backfill-space/datafile 2024-05-08T18:03:55.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-128 td/osd-backfill-space/datafile 2024-05-08T18:03:55.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:55.523 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:55.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-129 td/osd-backfill-space/datafile 2024-05-08T18:03:55.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-129 td/osd-backfill-space/datafile 2024-05-08T18:03:55.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:55.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:55.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-130 td/osd-backfill-space/datafile 2024-05-08T18:03:55.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile 2024-05-08T18:03:55.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:55.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:55.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-131 td/osd-backfill-space/datafile 2024-05-08T18:03:55.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:55.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-131 td/osd-backfill-space/datafile 2024-05-08T18:03:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:56.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:56.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-132 td/osd-backfill-space/datafile 2024-05-08T18:03:56.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-132 td/osd-backfill-space/datafile 2024-05-08T18:03:56.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:56.148 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:56.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-133 td/osd-backfill-space/datafile 2024-05-08T18:03:56.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-133 td/osd-backfill-space/datafile 2024-05-08T18:03:56.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:56.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:56.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-134 td/osd-backfill-space/datafile 2024-05-08T18:03:56.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-134 td/osd-backfill-space/datafile 2024-05-08T18:03:56.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:56.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:56.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-135 td/osd-backfill-space/datafile 2024-05-08T18:03:56.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-135 td/osd-backfill-space/datafile 2024-05-08T18:03:56.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:56.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:56.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-136 td/osd-backfill-space/datafile 2024-05-08T18:03:56.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-136 td/osd-backfill-space/datafile 2024-05-08T18:03:56.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:56.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:56.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-137 td/osd-backfill-space/datafile 2024-05-08T18:03:56.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:56.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-137 td/osd-backfill-space/datafile 2024-05-08T18:03:57.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:57.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:57.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-138 td/osd-backfill-space/datafile 2024-05-08T18:03:57.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-138 td/osd-backfill-space/datafile 2024-05-08T18:03:57.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:57.166 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:57.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-139 td/osd-backfill-space/datafile 2024-05-08T18:03:57.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-139 td/osd-backfill-space/datafile 2024-05-08T18:03:57.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:57.315 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:57.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-140 td/osd-backfill-space/datafile 2024-05-08T18:03:57.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-140 td/osd-backfill-space/datafile 2024-05-08T18:03:57.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:57.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:57.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-141 td/osd-backfill-space/datafile 2024-05-08T18:03:57.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-141 td/osd-backfill-space/datafile 2024-05-08T18:03:57.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:57.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:57.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-142 td/osd-backfill-space/datafile 2024-05-08T18:03:57.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-142 td/osd-backfill-space/datafile 2024-05-08T18:03:57.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:57.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:57.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-143 td/osd-backfill-space/datafile 2024-05-08T18:03:57.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:57.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-143 td/osd-backfill-space/datafile 2024-05-08T18:03:57.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:57.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:58.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-144 td/osd-backfill-space/datafile 2024-05-08T18:03:58.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-144 td/osd-backfill-space/datafile 2024-05-08T18:03:58.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:58.149 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:58.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-145 td/osd-backfill-space/datafile 2024-05-08T18:03:58.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-145 td/osd-backfill-space/datafile 2024-05-08T18:03:58.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:58.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:58.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-146 td/osd-backfill-space/datafile 2024-05-08T18:03:58.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-146 td/osd-backfill-space/datafile 2024-05-08T18:03:58.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:58.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:58.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-147 td/osd-backfill-space/datafile 2024-05-08T18:03:58.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile 2024-05-08T18:03:58.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:58.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:58.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-148 td/osd-backfill-space/datafile 2024-05-08T18:03:58.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-148 td/osd-backfill-space/datafile 2024-05-08T18:03:58.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:58.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:58.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:58.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-149 td/osd-backfill-space/datafile 2024-05-08T18:03:59.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-149 td/osd-backfill-space/datafile 2024-05-08T18:03:59.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:59.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:59.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-150 td/osd-backfill-space/datafile 2024-05-08T18:03:59.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-150 td/osd-backfill-space/datafile 2024-05-08T18:03:59.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:59.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:59.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-151 td/osd-backfill-space/datafile 2024-05-08T18:03:59.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-151 td/osd-backfill-space/datafile 2024-05-08T18:03:59.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:59.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:59.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-152 td/osd-backfill-space/datafile 2024-05-08T18:03:59.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-152 td/osd-backfill-space/datafile 2024-05-08T18:03:59.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:59.541 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:59.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-153 td/osd-backfill-space/datafile 2024-05-08T18:03:59.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-153 td/osd-backfill-space/datafile 2024-05-08T18:03:59.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:59.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:59.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-154 td/osd-backfill-space/datafile 2024-05-08T18:03:59.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-154 td/osd-backfill-space/datafile 2024-05-08T18:03:59.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:59.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:03:59.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-155 td/osd-backfill-space/datafile 2024-05-08T18:03:59.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:03:59.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-155 td/osd-backfill-space/datafile 2024-05-08T18:03:59.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:03:59.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:00.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-156 td/osd-backfill-space/datafile 2024-05-08T18:04:00.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-156 td/osd-backfill-space/datafile 2024-05-08T18:04:00.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:00.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:00.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-157 td/osd-backfill-space/datafile 2024-05-08T18:04:00.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-157 td/osd-backfill-space/datafile 2024-05-08T18:04:00.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:00.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:00.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-158 td/osd-backfill-space/datafile 2024-05-08T18:04:00.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-158 td/osd-backfill-space/datafile 2024-05-08T18:04:00.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:00.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:00.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-159 td/osd-backfill-space/datafile 2024-05-08T18:04:00.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-159 td/osd-backfill-space/datafile 2024-05-08T18:04:00.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:00.691 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:00.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-160 td/osd-backfill-space/datafile 2024-05-08T18:04:00.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-160 td/osd-backfill-space/datafile 2024-05-08T18:04:00.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:00.865 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:00.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-161 td/osd-backfill-space/datafile 2024-05-08T18:04:00.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:00.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-161 td/osd-backfill-space/datafile 2024-05-08T18:04:01.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:01.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:01.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-162 td/osd-backfill-space/datafile 2024-05-08T18:04:01.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-162 td/osd-backfill-space/datafile 2024-05-08T18:04:01.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:01.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:01.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-163 td/osd-backfill-space/datafile 2024-05-08T18:04:01.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-163 td/osd-backfill-space/datafile 2024-05-08T18:04:01.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:01.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:01.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile 2024-05-08T18:04:01.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2024-05-08T18:04:01.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:01.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:01.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-165 td/osd-backfill-space/datafile 2024-05-08T18:04:01.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-165 td/osd-backfill-space/datafile 2024-05-08T18:04:01.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:01.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:01.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-166 td/osd-backfill-space/datafile 2024-05-08T18:04:01.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-166 td/osd-backfill-space/datafile 2024-05-08T18:04:01.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:01.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:01.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-167 td/osd-backfill-space/datafile 2024-05-08T18:04:01.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-167 td/osd-backfill-space/datafile 2024-05-08T18:04:01.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:01.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:01.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:01.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-168 td/osd-backfill-space/datafile 2024-05-08T18:04:02.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-168 td/osd-backfill-space/datafile 2024-05-08T18:04:02.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:02.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:02.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-169 td/osd-backfill-space/datafile 2024-05-08T18:04:02.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-169 td/osd-backfill-space/datafile 2024-05-08T18:04:02.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:02.300 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:02.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-170 td/osd-backfill-space/datafile 2024-05-08T18:04:02.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-170 td/osd-backfill-space/datafile 2024-05-08T18:04:02.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:02.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:02.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-171 td/osd-backfill-space/datafile 2024-05-08T18:04:02.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-171 td/osd-backfill-space/datafile 2024-05-08T18:04:02.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:02.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:02.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-172 td/osd-backfill-space/datafile 2024-05-08T18:04:02.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-172 td/osd-backfill-space/datafile 2024-05-08T18:04:02.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:02.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:02.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-173 td/osd-backfill-space/datafile 2024-05-08T18:04:02.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-173 td/osd-backfill-space/datafile 2024-05-08T18:04:02.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:02.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:02.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:02.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-174 td/osd-backfill-space/datafile 2024-05-08T18:04:03.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-174 td/osd-backfill-space/datafile 2024-05-08T18:04:03.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:03.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:03.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-175 td/osd-backfill-space/datafile 2024-05-08T18:04:03.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-175 td/osd-backfill-space/datafile 2024-05-08T18:04:03.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:03.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:03.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-176 td/osd-backfill-space/datafile 2024-05-08T18:04:03.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-176 td/osd-backfill-space/datafile 2024-05-08T18:04:03.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:03.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:03.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-177 td/osd-backfill-space/datafile 2024-05-08T18:04:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-177 td/osd-backfill-space/datafile 2024-05-08T18:04:03.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:03.549 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:03.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-178 td/osd-backfill-space/datafile 2024-05-08T18:04:03.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-178 td/osd-backfill-space/datafile 2024-05-08T18:04:03.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:03.690 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:03.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-179 td/osd-backfill-space/datafile 2024-05-08T18:04:03.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-179 td/osd-backfill-space/datafile 2024-05-08T18:04:03.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:03.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:03.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:03.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-180 td/osd-backfill-space/datafile 2024-05-08T18:04:04.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-180 td/osd-backfill-space/datafile 2024-05-08T18:04:04.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:04.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:04.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile 2024-05-08T18:04:04.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-181 td/osd-backfill-space/datafile 2024-05-08T18:04:04.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:04.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:04.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-182 td/osd-backfill-space/datafile 2024-05-08T18:04:04.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-182 td/osd-backfill-space/datafile 2024-05-08T18:04:04.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:04.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:04.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-183 td/osd-backfill-space/datafile 2024-05-08T18:04:04.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-183 td/osd-backfill-space/datafile 2024-05-08T18:04:04.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:04.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:04.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-184 td/osd-backfill-space/datafile 2024-05-08T18:04:04.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-184 td/osd-backfill-space/datafile 2024-05-08T18:04:04.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:04.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:04.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-185 td/osd-backfill-space/datafile 2024-05-08T18:04:04.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-185 td/osd-backfill-space/datafile 2024-05-08T18:04:04.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:04.882 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:04.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-186 td/osd-backfill-space/datafile 2024-05-08T18:04:04.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:04.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-186 td/osd-backfill-space/datafile 2024-05-08T18:04:05.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:05.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:05.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-187 td/osd-backfill-space/datafile 2024-05-08T18:04:05.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-187 td/osd-backfill-space/datafile 2024-05-08T18:04:05.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:05.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:05.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-188 td/osd-backfill-space/datafile 2024-05-08T18:04:05.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-188 td/osd-backfill-space/datafile 2024-05-08T18:04:05.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:05.408 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:05.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-189 td/osd-backfill-space/datafile 2024-05-08T18:04:05.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-189 td/osd-backfill-space/datafile 2024-05-08T18:04:05.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:05.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:05.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-190 td/osd-backfill-space/datafile 2024-05-08T18:04:05.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-190 td/osd-backfill-space/datafile 2024-05-08T18:04:05.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:05.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:05.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-191 td/osd-backfill-space/datafile 2024-05-08T18:04:05.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-191 td/osd-backfill-space/datafile 2024-05-08T18:04:05.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:05.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:05.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-192 td/osd-backfill-space/datafile 2024-05-08T18:04:05.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:05.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-192 td/osd-backfill-space/datafile 2024-05-08T18:04:06.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:06.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-193 td/osd-backfill-space/datafile 2024-05-08T18:04:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-193 td/osd-backfill-space/datafile 2024-05-08T18:04:06.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:06.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:06.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-194 td/osd-backfill-space/datafile 2024-05-08T18:04:06.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-194 td/osd-backfill-space/datafile 2024-05-08T18:04:06.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:06.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:06.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-195 td/osd-backfill-space/datafile 2024-05-08T18:04:06.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-195 td/osd-backfill-space/datafile 2024-05-08T18:04:06.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:06.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:06.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-196 td/osd-backfill-space/datafile 2024-05-08T18:04:06.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-196 td/osd-backfill-space/datafile 2024-05-08T18:04:06.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:06.858 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:06.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-197 td/osd-backfill-space/datafile 2024-05-08T18:04:06.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:06.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-197 td/osd-backfill-space/datafile 2024-05-08T18:04:07.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:07.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:07.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2024-05-08T18:04:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-198 td/osd-backfill-space/datafile 2024-05-08T18:04:07.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:07.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:07.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-199 td/osd-backfill-space/datafile 2024-05-08T18:04:07.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-199 td/osd-backfill-space/datafile 2024-05-08T18:04:07.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:07.332 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:07.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-200 td/osd-backfill-space/datafile 2024-05-08T18:04:07.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-200 td/osd-backfill-space/datafile 2024-05-08T18:04:07.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:07.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:07.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-201 td/osd-backfill-space/datafile 2024-05-08T18:04:07.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-201 td/osd-backfill-space/datafile 2024-05-08T18:04:07.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:07.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:07.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-202 td/osd-backfill-space/datafile 2024-05-08T18:04:07.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-202 td/osd-backfill-space/datafile 2024-05-08T18:04:07.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:07.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:07.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-203 td/osd-backfill-space/datafile 2024-05-08T18:04:07.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-203 td/osd-backfill-space/datafile 2024-05-08T18:04:07.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:07.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:07.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:07.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-204 td/osd-backfill-space/datafile 2024-05-08T18:04:08.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-204 td/osd-backfill-space/datafile 2024-05-08T18:04:08.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:08.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:08.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-205 td/osd-backfill-space/datafile 2024-05-08T18:04:08.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-205 td/osd-backfill-space/datafile 2024-05-08T18:04:08.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:08.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:08.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-206 td/osd-backfill-space/datafile 2024-05-08T18:04:08.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-206 td/osd-backfill-space/datafile 2024-05-08T18:04:08.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:08.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:08.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-207 td/osd-backfill-space/datafile 2024-05-08T18:04:08.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-207 td/osd-backfill-space/datafile 2024-05-08T18:04:08.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:08.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:08.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-208 td/osd-backfill-space/datafile 2024-05-08T18:04:08.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-208 td/osd-backfill-space/datafile 2024-05-08T18:04:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:08.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:08.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-209 td/osd-backfill-space/datafile 2024-05-08T18:04:08.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-209 td/osd-backfill-space/datafile 2024-05-08T18:04:08.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:08.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:08.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-210 td/osd-backfill-space/datafile 2024-05-08T18:04:08.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:08.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-210 td/osd-backfill-space/datafile 2024-05-08T18:04:09.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:09.024 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:09.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-211 td/osd-backfill-space/datafile 2024-05-08T18:04:09.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-211 td/osd-backfill-space/datafile 2024-05-08T18:04:09.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:09.166 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:09.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-212 td/osd-backfill-space/datafile 2024-05-08T18:04:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-212 td/osd-backfill-space/datafile 2024-05-08T18:04:09.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:09.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:09.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-213 td/osd-backfill-space/datafile 2024-05-08T18:04:09.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-213 td/osd-backfill-space/datafile 2024-05-08T18:04:09.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:09.508 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:09.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-214 td/osd-backfill-space/datafile 2024-05-08T18:04:09.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-214 td/osd-backfill-space/datafile 2024-05-08T18:04:09.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:09.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:09.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-215 td/osd-backfill-space/datafile 2024-05-08T18:04:09.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-215 td/osd-backfill-space/datafile 2024-05-08T18:04:09.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:09.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:09.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-216 td/osd-backfill-space/datafile 2024-05-08T18:04:09.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:09.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-216 td/osd-backfill-space/datafile 2024-05-08T18:04:10.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:10.000 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:10.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-217 td/osd-backfill-space/datafile 2024-05-08T18:04:10.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-217 td/osd-backfill-space/datafile 2024-05-08T18:04:10.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:10.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:10.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-218 td/osd-backfill-space/datafile 2024-05-08T18:04:10.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-218 td/osd-backfill-space/datafile 2024-05-08T18:04:10.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:10.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:10.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-219 td/osd-backfill-space/datafile 2024-05-08T18:04:10.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-219 td/osd-backfill-space/datafile 2024-05-08T18:04:10.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:10.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:10.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-220 td/osd-backfill-space/datafile 2024-05-08T18:04:10.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-220 td/osd-backfill-space/datafile 2024-05-08T18:04:10.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:10.651 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:10.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-221 td/osd-backfill-space/datafile 2024-05-08T18:04:10.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-221 td/osd-backfill-space/datafile 2024-05-08T18:04:10.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:10.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:10.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-222 td/osd-backfill-space/datafile 2024-05-08T18:04:10.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-222 td/osd-backfill-space/datafile 2024-05-08T18:04:10.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:10.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:10.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:10.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-223 td/osd-backfill-space/datafile 2024-05-08T18:04:11.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-223 td/osd-backfill-space/datafile 2024-05-08T18:04:11.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:11.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:11.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-224 td/osd-backfill-space/datafile 2024-05-08T18:04:11.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-224 td/osd-backfill-space/datafile 2024-05-08T18:04:11.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:11.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:11.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-225 td/osd-backfill-space/datafile 2024-05-08T18:04:11.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-225 td/osd-backfill-space/datafile 2024-05-08T18:04:11.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:11.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:11.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-226 td/osd-backfill-space/datafile 2024-05-08T18:04:11.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-226 td/osd-backfill-space/datafile 2024-05-08T18:04:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:11.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:11.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-227 td/osd-backfill-space/datafile 2024-05-08T18:04:11.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:11.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-227 td/osd-backfill-space/datafile 2024-05-08T18:04:12.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:12.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:12.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-228 td/osd-backfill-space/datafile 2024-05-08T18:04:12.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-228 td/osd-backfill-space/datafile 2024-05-08T18:04:12.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:12.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:12.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-229 td/osd-backfill-space/datafile 2024-05-08T18:04:12.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-229 td/osd-backfill-space/datafile 2024-05-08T18:04:12.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:12.351 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:12.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-230 td/osd-backfill-space/datafile 2024-05-08T18:04:12.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-230 td/osd-backfill-space/datafile 2024-05-08T18:04:12.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:12.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:12.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-231 td/osd-backfill-space/datafile 2024-05-08T18:04:12.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile 2024-05-08T18:04:12.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:12.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:12.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-232 td/osd-backfill-space/datafile 2024-05-08T18:04:12.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-232 td/osd-backfill-space/datafile 2024-05-08T18:04:12.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:12.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:12.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-233 td/osd-backfill-space/datafile 2024-05-08T18:04:12.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-233 td/osd-backfill-space/datafile 2024-05-08T18:04:12.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:12.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:12.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:12.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-234 td/osd-backfill-space/datafile 2024-05-08T18:04:13.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-234 td/osd-backfill-space/datafile 2024-05-08T18:04:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:13.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:13.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-235 td/osd-backfill-space/datafile 2024-05-08T18:04:13.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-235 td/osd-backfill-space/datafile 2024-05-08T18:04:13.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:13.240 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:13.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-236 td/osd-backfill-space/datafile 2024-05-08T18:04:13.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-236 td/osd-backfill-space/datafile 2024-05-08T18:04:13.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:13.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:13.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-237 td/osd-backfill-space/datafile 2024-05-08T18:04:13.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-237 td/osd-backfill-space/datafile 2024-05-08T18:04:13.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:13.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:13.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-238 td/osd-backfill-space/datafile 2024-05-08T18:04:13.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-238 td/osd-backfill-space/datafile 2024-05-08T18:04:13.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:13.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:13.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-239 td/osd-backfill-space/datafile 2024-05-08T18:04:13.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-239 td/osd-backfill-space/datafile 2024-05-08T18:04:13.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:13.858 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:13.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-240 td/osd-backfill-space/datafile 2024-05-08T18:04:13.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:13.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-240 td/osd-backfill-space/datafile 2024-05-08T18:04:14.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:14.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:14.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-241 td/osd-backfill-space/datafile 2024-05-08T18:04:14.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-241 td/osd-backfill-space/datafile 2024-05-08T18:04:14.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:14.166 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:14.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-242 td/osd-backfill-space/datafile 2024-05-08T18:04:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-242 td/osd-backfill-space/datafile 2024-05-08T18:04:14.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:14.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:14.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-243 td/osd-backfill-space/datafile 2024-05-08T18:04:14.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-243 td/osd-backfill-space/datafile 2024-05-08T18:04:14.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:14.507 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:14.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-244 td/osd-backfill-space/datafile 2024-05-08T18:04:14.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-244 td/osd-backfill-space/datafile 2024-05-08T18:04:14.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:14.641 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:14.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-245 td/osd-backfill-space/datafile 2024-05-08T18:04:14.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-245 td/osd-backfill-space/datafile 2024-05-08T18:04:14.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:14.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:14.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-246 td/osd-backfill-space/datafile 2024-05-08T18:04:14.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-246 td/osd-backfill-space/datafile 2024-05-08T18:04:14.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:14.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:14.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-247 td/osd-backfill-space/datafile 2024-05-08T18:04:14.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:14.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-247 td/osd-backfill-space/datafile 2024-05-08T18:04:15.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:15.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:15.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-248 td/osd-backfill-space/datafile 2024-05-08T18:04:15.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile 2024-05-08T18:04:15.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:15.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:15.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-249 td/osd-backfill-space/datafile 2024-05-08T18:04:15.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-249 td/osd-backfill-space/datafile 2024-05-08T18:04:15.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:15.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:15.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-250 td/osd-backfill-space/datafile 2024-05-08T18:04:15.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-250 td/osd-backfill-space/datafile 2024-05-08T18:04:15.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:15.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:15.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-251 td/osd-backfill-space/datafile 2024-05-08T18:04:15.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-251 td/osd-backfill-space/datafile 2024-05-08T18:04:15.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:15.641 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:15.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-252 td/osd-backfill-space/datafile 2024-05-08T18:04:15.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-252 td/osd-backfill-space/datafile 2024-05-08T18:04:15.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:15.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:15.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-253 td/osd-backfill-space/datafile 2024-05-08T18:04:15.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:15.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-253 td/osd-backfill-space/datafile 2024-05-08T18:04:16.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:16.000 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:16.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-254 td/osd-backfill-space/datafile 2024-05-08T18:04:16.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-254 td/osd-backfill-space/datafile 2024-05-08T18:04:16.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:16.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:16.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-255 td/osd-backfill-space/datafile 2024-05-08T18:04:16.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-255 td/osd-backfill-space/datafile 2024-05-08T18:04:16.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:16.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:16.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-256 td/osd-backfill-space/datafile 2024-05-08T18:04:16.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-256 td/osd-backfill-space/datafile 2024-05-08T18:04:16.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:16.509 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-257 td/osd-backfill-space/datafile 2024-05-08T18:04:16.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-257 td/osd-backfill-space/datafile 2024-05-08T18:04:16.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:16.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:16.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-258 td/osd-backfill-space/datafile 2024-05-08T18:04:16.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-258 td/osd-backfill-space/datafile 2024-05-08T18:04:16.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:16.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:16.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-259 td/osd-backfill-space/datafile 2024-05-08T18:04:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-259 td/osd-backfill-space/datafile 2024-05-08T18:04:16.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:16.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:16.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:16.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-260 td/osd-backfill-space/datafile 2024-05-08T18:04:17.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-260 td/osd-backfill-space/datafile 2024-05-08T18:04:17.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:17.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:17.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-261 td/osd-backfill-space/datafile 2024-05-08T18:04:17.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-261 td/osd-backfill-space/datafile 2024-05-08T18:04:17.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:17.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:17.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-262 td/osd-backfill-space/datafile 2024-05-08T18:04:17.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-262 td/osd-backfill-space/datafile 2024-05-08T18:04:17.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:17.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:17.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-263 td/osd-backfill-space/datafile 2024-05-08T18:04:17.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-263 td/osd-backfill-space/datafile 2024-05-08T18:04:17.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:17.516 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:17.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-264 td/osd-backfill-space/datafile 2024-05-08T18:04:17.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-264 td/osd-backfill-space/datafile 2024-05-08T18:04:17.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:17.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:17.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile 2024-05-08T18:04:17.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2024-05-08T18:04:17.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:17.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:17.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-266 td/osd-backfill-space/datafile 2024-05-08T18:04:17.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-266 td/osd-backfill-space/datafile 2024-05-08T18:04:17.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:17.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:17.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:17.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-267 td/osd-backfill-space/datafile 2024-05-08T18:04:18.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-267 td/osd-backfill-space/datafile 2024-05-08T18:04:18.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:18.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:18.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-268 td/osd-backfill-space/datafile 2024-05-08T18:04:18.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-268 td/osd-backfill-space/datafile 2024-05-08T18:04:18.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:18.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:18.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-269 td/osd-backfill-space/datafile 2024-05-08T18:04:18.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-269 td/osd-backfill-space/datafile 2024-05-08T18:04:18.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:18.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:18.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-270 td/osd-backfill-space/datafile 2024-05-08T18:04:18.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-270 td/osd-backfill-space/datafile 2024-05-08T18:04:18.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:18.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:18.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-271 td/osd-backfill-space/datafile 2024-05-08T18:04:18.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-271 td/osd-backfill-space/datafile 2024-05-08T18:04:18.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:18.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:18.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-272 td/osd-backfill-space/datafile 2024-05-08T18:04:18.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-272 td/osd-backfill-space/datafile 2024-05-08T18:04:18.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:18.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:18.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:18.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-273 td/osd-backfill-space/datafile 2024-05-08T18:04:19.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-273 td/osd-backfill-space/datafile 2024-05-08T18:04:19.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:19.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:19.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-274 td/osd-backfill-space/datafile 2024-05-08T18:04:19.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-274 td/osd-backfill-space/datafile 2024-05-08T18:04:19.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:19.250 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:19.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-275 td/osd-backfill-space/datafile 2024-05-08T18:04:19.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-275 td/osd-backfill-space/datafile 2024-05-08T18:04:19.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:19.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:19.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-276 td/osd-backfill-space/datafile 2024-05-08T18:04:19.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-276 td/osd-backfill-space/datafile 2024-05-08T18:04:19.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:19.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:19.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-277 td/osd-backfill-space/datafile 2024-05-08T18:04:19.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-277 td/osd-backfill-space/datafile 2024-05-08T18:04:19.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:19.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:19.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-278 td/osd-backfill-space/datafile 2024-05-08T18:04:19.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-278 td/osd-backfill-space/datafile 2024-05-08T18:04:19.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:19.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:19.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-279 td/osd-backfill-space/datafile 2024-05-08T18:04:19.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-279 td/osd-backfill-space/datafile 2024-05-08T18:04:19.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:19.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:19.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:19.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-280 td/osd-backfill-space/datafile 2024-05-08T18:04:20.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-280 td/osd-backfill-space/datafile 2024-05-08T18:04:20.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:20.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:20.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-281 td/osd-backfill-space/datafile 2024-05-08T18:04:20.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-281 td/osd-backfill-space/datafile 2024-05-08T18:04:20.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:20.263 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:20.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile 2024-05-08T18:04:20.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-282 td/osd-backfill-space/datafile 2024-05-08T18:04:20.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:20.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:20.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-283 td/osd-backfill-space/datafile 2024-05-08T18:04:20.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-283 td/osd-backfill-space/datafile 2024-05-08T18:04:20.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:20.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-284 td/osd-backfill-space/datafile 2024-05-08T18:04:20.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-284 td/osd-backfill-space/datafile 2024-05-08T18:04:20.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:20.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:20.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-285 td/osd-backfill-space/datafile 2024-05-08T18:04:20.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-285 td/osd-backfill-space/datafile 2024-05-08T18:04:20.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:20.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:20.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-286 td/osd-backfill-space/datafile 2024-05-08T18:04:20.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:20.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-286 td/osd-backfill-space/datafile 2024-05-08T18:04:21.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:21.000 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:21.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-287 td/osd-backfill-space/datafile 2024-05-08T18:04:21.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-287 td/osd-backfill-space/datafile 2024-05-08T18:04:21.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:21.134 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:21.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-288 td/osd-backfill-space/datafile 2024-05-08T18:04:21.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-288 td/osd-backfill-space/datafile 2024-05-08T18:04:21.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:21.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:21.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-289 td/osd-backfill-space/datafile 2024-05-08T18:04:21.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-289 td/osd-backfill-space/datafile 2024-05-08T18:04:21.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:21.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:21.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-290 td/osd-backfill-space/datafile 2024-05-08T18:04:21.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-290 td/osd-backfill-space/datafile 2024-05-08T18:04:21.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:21.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:21.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-291 td/osd-backfill-space/datafile 2024-05-08T18:04:21.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-291 td/osd-backfill-space/datafile 2024-05-08T18:04:21.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:21.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:21.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-292 td/osd-backfill-space/datafile 2024-05-08T18:04:21.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-292 td/osd-backfill-space/datafile 2024-05-08T18:04:21.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:21.909 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:21.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:21.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-293 td/osd-backfill-space/datafile 2024-05-08T18:04:22.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-293 td/osd-backfill-space/datafile 2024-05-08T18:04:22.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:22.076 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:22.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-294 td/osd-backfill-space/datafile 2024-05-08T18:04:22.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-294 td/osd-backfill-space/datafile 2024-05-08T18:04:22.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:22.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:22.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-295 td/osd-backfill-space/datafile 2024-05-08T18:04:22.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-295 td/osd-backfill-space/datafile 2024-05-08T18:04:22.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:22.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:22.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-296 td/osd-backfill-space/datafile 2024-05-08T18:04:22.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-296 td/osd-backfill-space/datafile 2024-05-08T18:04:22.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:22.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:22.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-297 td/osd-backfill-space/datafile 2024-05-08T18:04:22.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-297 td/osd-backfill-space/datafile 2024-05-08T18:04:22.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:22.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:22.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-298 td/osd-backfill-space/datafile 2024-05-08T18:04:22.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-298 td/osd-backfill-space/datafile 2024-05-08T18:04:22.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:22.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:22.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2024-05-08T18:04:22.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-299 td/osd-backfill-space/datafile 2024-05-08T18:04:22.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:22.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:22.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:22.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-300 td/osd-backfill-space/datafile 2024-05-08T18:04:23.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-300 td/osd-backfill-space/datafile 2024-05-08T18:04:23.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:23.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:23.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-301 td/osd-backfill-space/datafile 2024-05-08T18:04:23.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-301 td/osd-backfill-space/datafile 2024-05-08T18:04:23.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:23.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:23.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-302 td/osd-backfill-space/datafile 2024-05-08T18:04:23.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-302 td/osd-backfill-space/datafile 2024-05-08T18:04:23.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:23.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:23.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-303 td/osd-backfill-space/datafile 2024-05-08T18:04:23.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-303 td/osd-backfill-space/datafile 2024-05-08T18:04:23.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:23.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:23.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-304 td/osd-backfill-space/datafile 2024-05-08T18:04:23.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-304 td/osd-backfill-space/datafile 2024-05-08T18:04:23.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:23.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:23.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-305 td/osd-backfill-space/datafile 2024-05-08T18:04:23.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-305 td/osd-backfill-space/datafile 2024-05-08T18:04:23.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:23.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-306 td/osd-backfill-space/datafile 2024-05-08T18:04:23.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:23.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-306 td/osd-backfill-space/datafile 2024-05-08T18:04:24.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:24.000 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:24.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-307 td/osd-backfill-space/datafile 2024-05-08T18:04:24.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-307 td/osd-backfill-space/datafile 2024-05-08T18:04:24.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:24.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:24.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-308 td/osd-backfill-space/datafile 2024-05-08T18:04:24.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-308 td/osd-backfill-space/datafile 2024-05-08T18:04:24.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:24.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:24.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-309 td/osd-backfill-space/datafile 2024-05-08T18:04:24.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-309 td/osd-backfill-space/datafile 2024-05-08T18:04:24.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:24.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:24.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-310 td/osd-backfill-space/datafile 2024-05-08T18:04:24.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-310 td/osd-backfill-space/datafile 2024-05-08T18:04:24.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:24.651 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:24.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-311 td/osd-backfill-space/datafile 2024-05-08T18:04:24.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-311 td/osd-backfill-space/datafile 2024-05-08T18:04:24.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:24.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:24.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-312 td/osd-backfill-space/datafile 2024-05-08T18:04:24.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-312 td/osd-backfill-space/datafile 2024-05-08T18:04:24.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:24.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:24.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:24.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-313 td/osd-backfill-space/datafile 2024-05-08T18:04:25.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-313 td/osd-backfill-space/datafile 2024-05-08T18:04:25.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:25.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:25.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-314 td/osd-backfill-space/datafile 2024-05-08T18:04:25.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-314 td/osd-backfill-space/datafile 2024-05-08T18:04:25.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:25.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:25.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-315 td/osd-backfill-space/datafile 2024-05-08T18:04:25.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-315 td/osd-backfill-space/datafile 2024-05-08T18:04:25.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:25.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:25.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-316 td/osd-backfill-space/datafile 2024-05-08T18:04:25.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-316 td/osd-backfill-space/datafile 2024-05-08T18:04:25.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:25.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:25.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-317 td/osd-backfill-space/datafile 2024-05-08T18:04:25.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-317 td/osd-backfill-space/datafile 2024-05-08T18:04:25.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:25.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:25.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-318 td/osd-backfill-space/datafile 2024-05-08T18:04:25.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-318 td/osd-backfill-space/datafile 2024-05-08T18:04:25.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:25.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:25.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-319 td/osd-backfill-space/datafile 2024-05-08T18:04:25.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-319 td/osd-backfill-space/datafile 2024-05-08T18:04:25.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:25.967 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:25.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:25.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-320 td/osd-backfill-space/datafile 2024-05-08T18:04:26.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-320 td/osd-backfill-space/datafile 2024-05-08T18:04:26.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:26.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:26.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-321 td/osd-backfill-space/datafile 2024-05-08T18:04:26.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-321 td/osd-backfill-space/datafile 2024-05-08T18:04:26.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:26.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:26.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-322 td/osd-backfill-space/datafile 2024-05-08T18:04:26.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-322 td/osd-backfill-space/datafile 2024-05-08T18:04:26.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:26.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:26.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-323 td/osd-backfill-space/datafile 2024-05-08T18:04:26.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-323 td/osd-backfill-space/datafile 2024-05-08T18:04:26.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:26.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:26.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-324 td/osd-backfill-space/datafile 2024-05-08T18:04:26.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-324 td/osd-backfill-space/datafile 2024-05-08T18:04:26.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:26.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:26.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-325 td/osd-backfill-space/datafile 2024-05-08T18:04:26.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-325 td/osd-backfill-space/datafile 2024-05-08T18:04:26.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:26.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:26.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-326 td/osd-backfill-space/datafile 2024-05-08T18:04:26.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-326 td/osd-backfill-space/datafile 2024-05-08T18:04:26.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:26.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:26.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:26.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-327 td/osd-backfill-space/datafile 2024-05-08T18:04:27.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-327 td/osd-backfill-space/datafile 2024-05-08T18:04:27.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:27.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:27.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-328 td/osd-backfill-space/datafile 2024-05-08T18:04:27.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-328 td/osd-backfill-space/datafile 2024-05-08T18:04:27.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:27.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:27.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-329 td/osd-backfill-space/datafile 2024-05-08T18:04:27.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-329 td/osd-backfill-space/datafile 2024-05-08T18:04:27.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:27.392 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:27.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-330 td/osd-backfill-space/datafile 2024-05-08T18:04:27.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-330 td/osd-backfill-space/datafile 2024-05-08T18:04:27.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:27.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:27.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-331 td/osd-backfill-space/datafile 2024-05-08T18:04:27.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-331 td/osd-backfill-space/datafile 2024-05-08T18:04:27.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:27.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:27.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-332 td/osd-backfill-space/datafile 2024-05-08T18:04:27.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile 2024-05-08T18:04:27.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:27.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:27.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:27.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-333 td/osd-backfill-space/datafile 2024-05-08T18:04:28.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-333 td/osd-backfill-space/datafile 2024-05-08T18:04:28.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:28.076 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:28.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-334 td/osd-backfill-space/datafile 2024-05-08T18:04:28.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-334 td/osd-backfill-space/datafile 2024-05-08T18:04:28.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:28.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:28.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-335 td/osd-backfill-space/datafile 2024-05-08T18:04:28.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-335 td/osd-backfill-space/datafile 2024-05-08T18:04:28.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:28.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:28.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-336 td/osd-backfill-space/datafile 2024-05-08T18:04:28.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-336 td/osd-backfill-space/datafile 2024-05-08T18:04:28.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:28.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:28.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-337 td/osd-backfill-space/datafile 2024-05-08T18:04:28.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-337 td/osd-backfill-space/datafile 2024-05-08T18:04:28.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:28.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:28.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-338 td/osd-backfill-space/datafile 2024-05-08T18:04:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-338 td/osd-backfill-space/datafile 2024-05-08T18:04:28.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:28.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:28.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-339 td/osd-backfill-space/datafile 2024-05-08T18:04:28.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-339 td/osd-backfill-space/datafile 2024-05-08T18:04:28.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:28.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:28.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:28.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-340 td/osd-backfill-space/datafile 2024-05-08T18:04:29.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-340 td/osd-backfill-space/datafile 2024-05-08T18:04:29.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:29.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:29.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-341 td/osd-backfill-space/datafile 2024-05-08T18:04:29.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-341 td/osd-backfill-space/datafile 2024-05-08T18:04:29.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:29.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:29.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-342 td/osd-backfill-space/datafile 2024-05-08T18:04:29.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-342 td/osd-backfill-space/datafile 2024-05-08T18:04:29.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:29.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:29.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-343 td/osd-backfill-space/datafile 2024-05-08T18:04:29.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-343 td/osd-backfill-space/datafile 2024-05-08T18:04:29.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:29.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:29.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-344 td/osd-backfill-space/datafile 2024-05-08T18:04:29.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-344 td/osd-backfill-space/datafile 2024-05-08T18:04:29.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:29.659 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:29.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-345 td/osd-backfill-space/datafile 2024-05-08T18:04:29.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-345 td/osd-backfill-space/datafile 2024-05-08T18:04:29.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:29.819 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:29.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-346 td/osd-backfill-space/datafile 2024-05-08T18:04:29.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-346 td/osd-backfill-space/datafile 2024-05-08T18:04:29.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:29.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:29.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:29.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-347 td/osd-backfill-space/datafile 2024-05-08T18:04:30.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-347 td/osd-backfill-space/datafile 2024-05-08T18:04:30.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:30.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:30.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-348 td/osd-backfill-space/datafile 2024-05-08T18:04:30.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-348 td/osd-backfill-space/datafile 2024-05-08T18:04:30.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:30.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:30.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-349 td/osd-backfill-space/datafile 2024-05-08T18:04:30.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile 2024-05-08T18:04:30.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:30.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:30.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-350 td/osd-backfill-space/datafile 2024-05-08T18:04:30.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-350 td/osd-backfill-space/datafile 2024-05-08T18:04:30.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:30.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:30.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-351 td/osd-backfill-space/datafile 2024-05-08T18:04:30.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-351 td/osd-backfill-space/datafile 2024-05-08T18:04:30.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:30.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:30.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-352 td/osd-backfill-space/datafile 2024-05-08T18:04:30.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-352 td/osd-backfill-space/datafile 2024-05-08T18:04:30.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:30.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:30.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-353 td/osd-backfill-space/datafile 2024-05-08T18:04:30.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:30.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-353 td/osd-backfill-space/datafile 2024-05-08T18:04:31.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:31.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:31.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-354 td/osd-backfill-space/datafile 2024-05-08T18:04:31.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-354 td/osd-backfill-space/datafile 2024-05-08T18:04:31.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:31.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:31.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-355 td/osd-backfill-space/datafile 2024-05-08T18:04:31.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-355 td/osd-backfill-space/datafile 2024-05-08T18:04:31.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:31.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:31.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-356 td/osd-backfill-space/datafile 2024-05-08T18:04:31.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-356 td/osd-backfill-space/datafile 2024-05-08T18:04:31.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:31.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:31.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-357 td/osd-backfill-space/datafile 2024-05-08T18:04:31.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-357 td/osd-backfill-space/datafile 2024-05-08T18:04:31.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:31.551 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:31.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-358 td/osd-backfill-space/datafile 2024-05-08T18:04:31.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-358 td/osd-backfill-space/datafile 2024-05-08T18:04:31.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:31.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:31.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-359 td/osd-backfill-space/datafile 2024-05-08T18:04:31.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-359 td/osd-backfill-space/datafile 2024-05-08T18:04:31.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:31.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:31.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-360 td/osd-backfill-space/datafile 2024-05-08T18:04:31.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-360 td/osd-backfill-space/datafile 2024-05-08T18:04:31.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:31.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:31.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:31.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-361 td/osd-backfill-space/datafile 2024-05-08T18:04:32.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-361 td/osd-backfill-space/datafile 2024-05-08T18:04:32.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:32.076 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:32.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-362 td/osd-backfill-space/datafile 2024-05-08T18:04:32.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-362 td/osd-backfill-space/datafile 2024-05-08T18:04:32.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:32.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:32.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-363 td/osd-backfill-space/datafile 2024-05-08T18:04:32.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-363 td/osd-backfill-space/datafile 2024-05-08T18:04:32.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:32.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:32.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-364 td/osd-backfill-space/datafile 2024-05-08T18:04:32.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-364 td/osd-backfill-space/datafile 2024-05-08T18:04:32.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:32.484 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:32.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-365 td/osd-backfill-space/datafile 2024-05-08T18:04:32.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-365 td/osd-backfill-space/datafile 2024-05-08T18:04:32.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:32.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:32.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile 2024-05-08T18:04:32.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2024-05-08T18:04:32.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:32.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:32.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-367 td/osd-backfill-space/datafile 2024-05-08T18:04:32.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-367 td/osd-backfill-space/datafile 2024-05-08T18:04:32.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:32.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:32.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-368 td/osd-backfill-space/datafile 2024-05-08T18:04:32.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-368 td/osd-backfill-space/datafile 2024-05-08T18:04:32.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:32.950 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:32.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:32.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-369 td/osd-backfill-space/datafile 2024-05-08T18:04:33.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-369 td/osd-backfill-space/datafile 2024-05-08T18:04:33.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:33.068 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:33.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-370 td/osd-backfill-space/datafile 2024-05-08T18:04:33.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-370 td/osd-backfill-space/datafile 2024-05-08T18:04:33.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:33.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:33.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-371 td/osd-backfill-space/datafile 2024-05-08T18:04:33.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-371 td/osd-backfill-space/datafile 2024-05-08T18:04:33.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:33.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:33.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-372 td/osd-backfill-space/datafile 2024-05-08T18:04:33.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-372 td/osd-backfill-space/datafile 2024-05-08T18:04:33.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:33.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:33.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-373 td/osd-backfill-space/datafile 2024-05-08T18:04:33.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-373 td/osd-backfill-space/datafile 2024-05-08T18:04:33.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:33.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:33.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-374 td/osd-backfill-space/datafile 2024-05-08T18:04:33.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-374 td/osd-backfill-space/datafile 2024-05-08T18:04:33.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:33.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:33.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-375 td/osd-backfill-space/datafile 2024-05-08T18:04:33.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-375 td/osd-backfill-space/datafile 2024-05-08T18:04:33.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:33.894 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:33.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-376 td/osd-backfill-space/datafile 2024-05-08T18:04:33.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:33.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-376 td/osd-backfill-space/datafile 2024-05-08T18:04:34.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:34.068 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:34.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-377 td/osd-backfill-space/datafile 2024-05-08T18:04:34.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-377 td/osd-backfill-space/datafile 2024-05-08T18:04:34.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:34.202 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:34.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-378 td/osd-backfill-space/datafile 2024-05-08T18:04:34.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-378 td/osd-backfill-space/datafile 2024-05-08T18:04:34.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:34.351 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:34.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-379 td/osd-backfill-space/datafile 2024-05-08T18:04:34.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-379 td/osd-backfill-space/datafile 2024-05-08T18:04:34.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:34.502 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:34.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-380 td/osd-backfill-space/datafile 2024-05-08T18:04:34.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-380 td/osd-backfill-space/datafile 2024-05-08T18:04:34.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:34.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:34.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-381 td/osd-backfill-space/datafile 2024-05-08T18:04:34.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-381 td/osd-backfill-space/datafile 2024-05-08T18:04:34.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:34.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:34.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-382 td/osd-backfill-space/datafile 2024-05-08T18:04:34.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-382 td/osd-backfill-space/datafile 2024-05-08T18:04:34.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:34.894 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:34.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile 2024-05-08T18:04:34.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:34.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-383 td/osd-backfill-space/datafile 2024-05-08T18:04:35.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:35.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:35.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-384 td/osd-backfill-space/datafile 2024-05-08T18:04:35.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-384 td/osd-backfill-space/datafile 2024-05-08T18:04:35.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:35.160 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:35.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-385 td/osd-backfill-space/datafile 2024-05-08T18:04:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-385 td/osd-backfill-space/datafile 2024-05-08T18:04:35.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:35.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:35.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-386 td/osd-backfill-space/datafile 2024-05-08T18:04:35.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-386 td/osd-backfill-space/datafile 2024-05-08T18:04:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:35.427 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-387 td/osd-backfill-space/datafile 2024-05-08T18:04:35.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-387 td/osd-backfill-space/datafile 2024-05-08T18:04:35.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:35.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:35.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-388 td/osd-backfill-space/datafile 2024-05-08T18:04:35.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-388 td/osd-backfill-space/datafile 2024-05-08T18:04:35.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:35.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:35.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-389 td/osd-backfill-space/datafile 2024-05-08T18:04:35.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-389 td/osd-backfill-space/datafile 2024-05-08T18:04:35.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:35.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:35.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-390 td/osd-backfill-space/datafile 2024-05-08T18:04:35.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:35.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-390 td/osd-backfill-space/datafile 2024-05-08T18:04:36.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:36.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:36.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-391 td/osd-backfill-space/datafile 2024-05-08T18:04:36.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-391 td/osd-backfill-space/datafile 2024-05-08T18:04:36.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:36.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:36.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-392 td/osd-backfill-space/datafile 2024-05-08T18:04:36.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-392 td/osd-backfill-space/datafile 2024-05-08T18:04:36.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:36.346 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:36.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-393 td/osd-backfill-space/datafile 2024-05-08T18:04:36.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-393 td/osd-backfill-space/datafile 2024-05-08T18:04:36.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:36.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:36.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-394 td/osd-backfill-space/datafile 2024-05-08T18:04:36.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-394 td/osd-backfill-space/datafile 2024-05-08T18:04:36.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:36.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:36.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-395 td/osd-backfill-space/datafile 2024-05-08T18:04:36.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-395 td/osd-backfill-space/datafile 2024-05-08T18:04:36.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:36.876 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:36.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-396 td/osd-backfill-space/datafile 2024-05-08T18:04:36.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:36.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-396 td/osd-backfill-space/datafile 2024-05-08T18:04:37.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:37.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:37.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-397 td/osd-backfill-space/datafile 2024-05-08T18:04:37.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-397 td/osd-backfill-space/datafile 2024-05-08T18:04:37.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:37.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:37.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-398 td/osd-backfill-space/datafile 2024-05-08T18:04:37.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-398 td/osd-backfill-space/datafile 2024-05-08T18:04:37.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:37.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:37.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-399 td/osd-backfill-space/datafile 2024-05-08T18:04:37.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-399 td/osd-backfill-space/datafile 2024-05-08T18:04:37.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:37.596 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:37.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2024-05-08T18:04:37.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-400 td/osd-backfill-space/datafile 2024-05-08T18:04:37.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:37.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:37.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-401 td/osd-backfill-space/datafile 2024-05-08T18:04:37.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-401 td/osd-backfill-space/datafile 2024-05-08T18:04:37.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:37.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:37.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:37.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-402 td/osd-backfill-space/datafile 2024-05-08T18:04:38.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-402 td/osd-backfill-space/datafile 2024-05-08T18:04:38.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:38.077 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:38.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-403 td/osd-backfill-space/datafile 2024-05-08T18:04:38.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-403 td/osd-backfill-space/datafile 2024-05-08T18:04:38.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:38.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:38.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-404 td/osd-backfill-space/datafile 2024-05-08T18:04:38.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-404 td/osd-backfill-space/datafile 2024-05-08T18:04:38.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:38.412 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:38.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-405 td/osd-backfill-space/datafile 2024-05-08T18:04:38.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-405 td/osd-backfill-space/datafile 2024-05-08T18:04:38.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:38.553 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:38.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-406 td/osd-backfill-space/datafile 2024-05-08T18:04:38.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-406 td/osd-backfill-space/datafile 2024-05-08T18:04:38.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:38.685 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:38.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-407 td/osd-backfill-space/datafile 2024-05-08T18:04:38.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-407 td/osd-backfill-space/datafile 2024-05-08T18:04:38.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:38.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:38.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-408 td/osd-backfill-space/datafile 2024-05-08T18:04:38.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-408 td/osd-backfill-space/datafile 2024-05-08T18:04:38.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:38.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:38.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:38.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-409 td/osd-backfill-space/datafile 2024-05-08T18:04:39.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-409 td/osd-backfill-space/datafile 2024-05-08T18:04:39.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:39.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:39.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-410 td/osd-backfill-space/datafile 2024-05-08T18:04:39.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-410 td/osd-backfill-space/datafile 2024-05-08T18:04:39.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:39.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:39.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-411 td/osd-backfill-space/datafile 2024-05-08T18:04:39.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-411 td/osd-backfill-space/datafile 2024-05-08T18:04:39.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:39.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:39.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-412 td/osd-backfill-space/datafile 2024-05-08T18:04:39.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-412 td/osd-backfill-space/datafile 2024-05-08T18:04:39.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:39.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:39.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-413 td/osd-backfill-space/datafile 2024-05-08T18:04:39.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-413 td/osd-backfill-space/datafile 2024-05-08T18:04:39.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:39.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:39.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-414 td/osd-backfill-space/datafile 2024-05-08T18:04:39.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-414 td/osd-backfill-space/datafile 2024-05-08T18:04:39.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:39.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:39.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-415 td/osd-backfill-space/datafile 2024-05-08T18:04:39.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-415 td/osd-backfill-space/datafile 2024-05-08T18:04:39.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:39.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:39.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:39.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-416 td/osd-backfill-space/datafile 2024-05-08T18:04:40.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-416 td/osd-backfill-space/datafile 2024-05-08T18:04:40.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:40.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:40.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-417 td/osd-backfill-space/datafile 2024-05-08T18:04:40.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-417 td/osd-backfill-space/datafile 2024-05-08T18:04:40.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:40.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:40.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-418 td/osd-backfill-space/datafile 2024-05-08T18:04:40.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-418 td/osd-backfill-space/datafile 2024-05-08T18:04:40.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:40.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:40.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-419 td/osd-backfill-space/datafile 2024-05-08T18:04:40.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-419 td/osd-backfill-space/datafile 2024-05-08T18:04:40.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:40.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:40.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-420 td/osd-backfill-space/datafile 2024-05-08T18:04:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-420 td/osd-backfill-space/datafile 2024-05-08T18:04:40.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:40.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:40.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-421 td/osd-backfill-space/datafile 2024-05-08T18:04:40.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-421 td/osd-backfill-space/datafile 2024-05-08T18:04:40.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:40.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:40.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-422 td/osd-backfill-space/datafile 2024-05-08T18:04:40.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:40.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-422 td/osd-backfill-space/datafile 2024-05-08T18:04:41.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:41.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:41.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-423 td/osd-backfill-space/datafile 2024-05-08T18:04:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-423 td/osd-backfill-space/datafile 2024-05-08T18:04:41.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:41.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:41.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-424 td/osd-backfill-space/datafile 2024-05-08T18:04:41.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-424 td/osd-backfill-space/datafile 2024-05-08T18:04:41.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:41.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:41.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-425 td/osd-backfill-space/datafile 2024-05-08T18:04:41.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-425 td/osd-backfill-space/datafile 2024-05-08T18:04:41.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:41.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:41.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-426 td/osd-backfill-space/datafile 2024-05-08T18:04:41.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-426 td/osd-backfill-space/datafile 2024-05-08T18:04:41.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:41.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:41.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-427 td/osd-backfill-space/datafile 2024-05-08T18:04:41.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-427 td/osd-backfill-space/datafile 2024-05-08T18:04:41.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:41.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:41.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-428 td/osd-backfill-space/datafile 2024-05-08T18:04:41.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-428 td/osd-backfill-space/datafile 2024-05-08T18:04:41.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:41.819 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:41.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-429 td/osd-backfill-space/datafile 2024-05-08T18:04:41.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-429 td/osd-backfill-space/datafile 2024-05-08T18:04:41.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:41.979 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:41.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:41.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-430 td/osd-backfill-space/datafile 2024-05-08T18:04:42.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:42.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-430 td/osd-backfill-space/datafile 2024-05-08T18:04:42.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:42.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:42.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:42.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-431 td/osd-backfill-space/datafile 2024-05-08T18:04:42.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:42.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-431 td/osd-backfill-space/datafile 2024-05-08T18:04:42.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:42.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:42.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:42.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-432 td/osd-backfill-space/datafile 2024-05-08T18:04:42.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:42.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-432 td/osd-backfill-space/datafile 2024-05-08T18:04:42.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:42.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:42.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:42.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-433 td/osd-backfill-space/datafile 2024-05-08T18:04:42.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:42.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile 2024-05-08T18:04:42.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:42.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:42.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:42.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-434 td/osd-backfill-space/datafile 2024-05-08T18:04:43.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-434 td/osd-backfill-space/datafile 2024-05-08T18:04:43.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:43.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:43.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-435 td/osd-backfill-space/datafile 2024-05-08T18:04:43.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-435 td/osd-backfill-space/datafile 2024-05-08T18:04:43.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:43.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:43.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-436 td/osd-backfill-space/datafile 2024-05-08T18:04:43.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-436 td/osd-backfill-space/datafile 2024-05-08T18:04:43.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:43.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:43.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-437 td/osd-backfill-space/datafile 2024-05-08T18:04:43.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-437 td/osd-backfill-space/datafile 2024-05-08T18:04:43.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:43.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:43.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-438 td/osd-backfill-space/datafile 2024-05-08T18:04:43.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-438 td/osd-backfill-space/datafile 2024-05-08T18:04:43.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:43.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:43.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-439 td/osd-backfill-space/datafile 2024-05-08T18:04:43.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-439 td/osd-backfill-space/datafile 2024-05-08T18:04:43.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:43.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:43.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-440 td/osd-backfill-space/datafile 2024-05-08T18:04:43.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:43.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-440 td/osd-backfill-space/datafile 2024-05-08T18:04:44.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:44.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:44.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-441 td/osd-backfill-space/datafile 2024-05-08T18:04:44.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-441 td/osd-backfill-space/datafile 2024-05-08T18:04:44.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:44.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:44.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-442 td/osd-backfill-space/datafile 2024-05-08T18:04:44.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-442 td/osd-backfill-space/datafile 2024-05-08T18:04:44.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:44.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:44.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-443 td/osd-backfill-space/datafile 2024-05-08T18:04:44.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-443 td/osd-backfill-space/datafile 2024-05-08T18:04:44.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:44.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:44.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-444 td/osd-backfill-space/datafile 2024-05-08T18:04:44.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-444 td/osd-backfill-space/datafile 2024-05-08T18:04:44.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:44.653 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:44.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-445 td/osd-backfill-space/datafile 2024-05-08T18:04:44.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-445 td/osd-backfill-space/datafile 2024-05-08T18:04:44.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:44.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:44.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-446 td/osd-backfill-space/datafile 2024-05-08T18:04:44.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-446 td/osd-backfill-space/datafile 2024-05-08T18:04:44.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:44.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:44.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:44.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-447 td/osd-backfill-space/datafile 2024-05-08T18:04:45.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-447 td/osd-backfill-space/datafile 2024-05-08T18:04:45.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:45.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:45.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-448 td/osd-backfill-space/datafile 2024-05-08T18:04:45.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-448 td/osd-backfill-space/datafile 2024-05-08T18:04:45.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:45.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:45.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-449 td/osd-backfill-space/datafile 2024-05-08T18:04:45.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-449 td/osd-backfill-space/datafile 2024-05-08T18:04:45.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:45.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:45.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-450 td/osd-backfill-space/datafile 2024-05-08T18:04:45.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile 2024-05-08T18:04:45.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:45.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:45.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-451 td/osd-backfill-space/datafile 2024-05-08T18:04:45.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-451 td/osd-backfill-space/datafile 2024-05-08T18:04:45.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:45.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:45.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-452 td/osd-backfill-space/datafile 2024-05-08T18:04:45.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-452 td/osd-backfill-space/datafile 2024-05-08T18:04:45.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:45.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:45.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-453 td/osd-backfill-space/datafile 2024-05-08T18:04:45.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-453 td/osd-backfill-space/datafile 2024-05-08T18:04:45.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:45.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:45.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:45.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-454 td/osd-backfill-space/datafile 2024-05-08T18:04:46.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-454 td/osd-backfill-space/datafile 2024-05-08T18:04:46.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:46.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:46.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-455 td/osd-backfill-space/datafile 2024-05-08T18:04:46.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-455 td/osd-backfill-space/datafile 2024-05-08T18:04:46.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:46.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:46.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-456 td/osd-backfill-space/datafile 2024-05-08T18:04:46.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-456 td/osd-backfill-space/datafile 2024-05-08T18:04:46.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:46.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:46.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-457 td/osd-backfill-space/datafile 2024-05-08T18:04:46.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-457 td/osd-backfill-space/datafile 2024-05-08T18:04:46.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:46.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:46.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-458 td/osd-backfill-space/datafile 2024-05-08T18:04:46.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-458 td/osd-backfill-space/datafile 2024-05-08T18:04:46.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:46.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:46.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-459 td/osd-backfill-space/datafile 2024-05-08T18:04:46.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-459 td/osd-backfill-space/datafile 2024-05-08T18:04:46.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:46.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:46.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-460 td/osd-backfill-space/datafile 2024-05-08T18:04:46.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:46.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-460 td/osd-backfill-space/datafile 2024-05-08T18:04:47.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:47.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:47.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-461 td/osd-backfill-space/datafile 2024-05-08T18:04:47.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-461 td/osd-backfill-space/datafile 2024-05-08T18:04:47.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:47.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:47.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-462 td/osd-backfill-space/datafile 2024-05-08T18:04:47.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-462 td/osd-backfill-space/datafile 2024-05-08T18:04:47.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:47.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:47.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-463 td/osd-backfill-space/datafile 2024-05-08T18:04:47.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-463 td/osd-backfill-space/datafile 2024-05-08T18:04:47.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:47.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:47.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-464 td/osd-backfill-space/datafile 2024-05-08T18:04:47.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-464 td/osd-backfill-space/datafile 2024-05-08T18:04:47.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:47.553 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:47.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-465 td/osd-backfill-space/datafile 2024-05-08T18:04:47.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-465 td/osd-backfill-space/datafile 2024-05-08T18:04:47.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:47.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:47.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-466 td/osd-backfill-space/datafile 2024-05-08T18:04:47.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-466 td/osd-backfill-space/datafile 2024-05-08T18:04:47.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:47.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:47.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile 2024-05-08T18:04:47.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2024-05-08T18:04:47.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:47.969 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:47.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:47.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-468 td/osd-backfill-space/datafile 2024-05-08T18:04:48.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-468 td/osd-backfill-space/datafile 2024-05-08T18:04:48.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:48.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:48.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-469 td/osd-backfill-space/datafile 2024-05-08T18:04:48.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-469 td/osd-backfill-space/datafile 2024-05-08T18:04:48.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:48.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:48.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-470 td/osd-backfill-space/datafile 2024-05-08T18:04:48.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-470 td/osd-backfill-space/datafile 2024-05-08T18:04:48.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:48.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:48.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-471 td/osd-backfill-space/datafile 2024-05-08T18:04:48.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-471 td/osd-backfill-space/datafile 2024-05-08T18:04:48.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:48.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-472 td/osd-backfill-space/datafile 2024-05-08T18:04:48.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-472 td/osd-backfill-space/datafile 2024-05-08T18:04:48.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:48.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:48.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-473 td/osd-backfill-space/datafile 2024-05-08T18:04:48.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-473 td/osd-backfill-space/datafile 2024-05-08T18:04:48.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:48.886 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:48.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-474 td/osd-backfill-space/datafile 2024-05-08T18:04:48.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:48.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-474 td/osd-backfill-space/datafile 2024-05-08T18:04:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:49.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-475 td/osd-backfill-space/datafile 2024-05-08T18:04:49.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-475 td/osd-backfill-space/datafile 2024-05-08T18:04:49.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:49.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:49.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-476 td/osd-backfill-space/datafile 2024-05-08T18:04:49.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-476 td/osd-backfill-space/datafile 2024-05-08T18:04:49.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:49.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:49.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-477 td/osd-backfill-space/datafile 2024-05-08T18:04:49.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-477 td/osd-backfill-space/datafile 2024-05-08T18:04:49.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:49.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:49.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-478 td/osd-backfill-space/datafile 2024-05-08T18:04:49.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-478 td/osd-backfill-space/datafile 2024-05-08T18:04:49.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:49.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:49.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-479 td/osd-backfill-space/datafile 2024-05-08T18:04:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-479 td/osd-backfill-space/datafile 2024-05-08T18:04:49.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:49.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:49.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-480 td/osd-backfill-space/datafile 2024-05-08T18:04:49.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-480 td/osd-backfill-space/datafile 2024-05-08T18:04:49.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:49.887 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:49.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-481 td/osd-backfill-space/datafile 2024-05-08T18:04:49.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:49.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-481 td/osd-backfill-space/datafile 2024-05-08T18:04:50.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:50.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:50.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-482 td/osd-backfill-space/datafile 2024-05-08T18:04:50.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-482 td/osd-backfill-space/datafile 2024-05-08T18:04:50.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:50.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:50.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-483 td/osd-backfill-space/datafile 2024-05-08T18:04:50.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-483 td/osd-backfill-space/datafile 2024-05-08T18:04:50.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:50.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:50.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile 2024-05-08T18:04:50.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-484 td/osd-backfill-space/datafile 2024-05-08T18:04:50.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:50.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:50.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-485 td/osd-backfill-space/datafile 2024-05-08T18:04:50.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-485 td/osd-backfill-space/datafile 2024-05-08T18:04:50.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:50.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:50.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-486 td/osd-backfill-space/datafile 2024-05-08T18:04:50.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-486 td/osd-backfill-space/datafile 2024-05-08T18:04:50.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:50.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:50.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-487 td/osd-backfill-space/datafile 2024-05-08T18:04:50.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-487 td/osd-backfill-space/datafile 2024-05-08T18:04:50.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:50.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:50.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-488 td/osd-backfill-space/datafile 2024-05-08T18:04:50.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:50.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-488 td/osd-backfill-space/datafile 2024-05-08T18:04:51.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:51.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-489 td/osd-backfill-space/datafile 2024-05-08T18:04:51.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-489 td/osd-backfill-space/datafile 2024-05-08T18:04:51.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:51.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:51.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-490 td/osd-backfill-space/datafile 2024-05-08T18:04:51.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-490 td/osd-backfill-space/datafile 2024-05-08T18:04:51.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:51.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:51.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-491 td/osd-backfill-space/datafile 2024-05-08T18:04:51.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-491 td/osd-backfill-space/datafile 2024-05-08T18:04:51.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:51.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:51.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-492 td/osd-backfill-space/datafile 2024-05-08T18:04:51.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-492 td/osd-backfill-space/datafile 2024-05-08T18:04:51.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:51.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:51.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-493 td/osd-backfill-space/datafile 2024-05-08T18:04:51.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-493 td/osd-backfill-space/datafile 2024-05-08T18:04:51.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:51.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:51.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-494 td/osd-backfill-space/datafile 2024-05-08T18:04:51.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-494 td/osd-backfill-space/datafile 2024-05-08T18:04:51.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:51.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:51.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-495 td/osd-backfill-space/datafile 2024-05-08T18:04:51.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:51.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-495 td/osd-backfill-space/datafile 2024-05-08T18:04:52.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:52.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:52.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-496 td/osd-backfill-space/datafile 2024-05-08T18:04:52.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-496 td/osd-backfill-space/datafile 2024-05-08T18:04:52.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:52.186 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:52.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-497 td/osd-backfill-space/datafile 2024-05-08T18:04:52.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-497 td/osd-backfill-space/datafile 2024-05-08T18:04:52.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:52.362 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:52.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-498 td/osd-backfill-space/datafile 2024-05-08T18:04:52.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-498 td/osd-backfill-space/datafile 2024-05-08T18:04:52.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:52.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:52.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-499 td/osd-backfill-space/datafile 2024-05-08T18:04:52.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-499 td/osd-backfill-space/datafile 2024-05-08T18:04:52.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:52.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:52.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-500 td/osd-backfill-space/datafile 2024-05-08T18:04:52.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-500 td/osd-backfill-space/datafile 2024-05-08T18:04:52.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:52.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:52.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2024-05-08T18:04:52.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-501 td/osd-backfill-space/datafile 2024-05-08T18:04:52.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:52.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:52.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-502 td/osd-backfill-space/datafile 2024-05-08T18:04:52.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:52.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-502 td/osd-backfill-space/datafile 2024-05-08T18:04:53.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:53.036 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:53.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-503 td/osd-backfill-space/datafile 2024-05-08T18:04:53.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-503 td/osd-backfill-space/datafile 2024-05-08T18:04:53.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:53.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:53.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-504 td/osd-backfill-space/datafile 2024-05-08T18:04:53.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-504 td/osd-backfill-space/datafile 2024-05-08T18:04:53.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:53.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:53.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-505 td/osd-backfill-space/datafile 2024-05-08T18:04:53.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-505 td/osd-backfill-space/datafile 2024-05-08T18:04:53.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:53.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:53.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-506 td/osd-backfill-space/datafile 2024-05-08T18:04:53.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-506 td/osd-backfill-space/datafile 2024-05-08T18:04:53.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:53.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:53.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-507 td/osd-backfill-space/datafile 2024-05-08T18:04:53.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-507 td/osd-backfill-space/datafile 2024-05-08T18:04:53.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:53.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:53.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-508 td/osd-backfill-space/datafile 2024-05-08T18:04:53.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-508 td/osd-backfill-space/datafile 2024-05-08T18:04:53.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:53.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:53.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-509 td/osd-backfill-space/datafile 2024-05-08T18:04:53.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-509 td/osd-backfill-space/datafile 2024-05-08T18:04:53.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:53.969 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:53.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:53.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-510 td/osd-backfill-space/datafile 2024-05-08T18:04:54.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-510 td/osd-backfill-space/datafile 2024-05-08T18:04:54.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:54.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:54.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-511 td/osd-backfill-space/datafile 2024-05-08T18:04:54.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-511 td/osd-backfill-space/datafile 2024-05-08T18:04:54.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:54.245 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:54.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-512 td/osd-backfill-space/datafile 2024-05-08T18:04:54.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-512 td/osd-backfill-space/datafile 2024-05-08T18:04:54.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:54.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:54.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-513 td/osd-backfill-space/datafile 2024-05-08T18:04:54.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-513 td/osd-backfill-space/datafile 2024-05-08T18:04:54.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:54.596 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:54.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-514 td/osd-backfill-space/datafile 2024-05-08T18:04:54.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-514 td/osd-backfill-space/datafile 2024-05-08T18:04:54.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:54.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:54.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-515 td/osd-backfill-space/datafile 2024-05-08T18:04:54.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-515 td/osd-backfill-space/datafile 2024-05-08T18:04:54.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:54.870 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:54.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-516 td/osd-backfill-space/datafile 2024-05-08T18:04:54.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-516 td/osd-backfill-space/datafile 2024-05-08T18:04:54.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:54.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:54.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:54.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-517 td/osd-backfill-space/datafile 2024-05-08T18:04:55.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-517 td/osd-backfill-space/datafile 2024-05-08T18:04:55.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:55.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:55.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-518 td/osd-backfill-space/datafile 2024-05-08T18:04:55.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-518 td/osd-backfill-space/datafile 2024-05-08T18:04:55.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:55.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:55.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-519 td/osd-backfill-space/datafile 2024-05-08T18:04:55.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-519 td/osd-backfill-space/datafile 2024-05-08T18:04:55.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:55.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:55.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-520 td/osd-backfill-space/datafile 2024-05-08T18:04:55.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-520 td/osd-backfill-space/datafile 2024-05-08T18:04:55.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:55.553 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:55.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-521 td/osd-backfill-space/datafile 2024-05-08T18:04:55.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-521 td/osd-backfill-space/datafile 2024-05-08T18:04:55.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:55.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:55.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-522 td/osd-backfill-space/datafile 2024-05-08T18:04:55.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-522 td/osd-backfill-space/datafile 2024-05-08T18:04:55.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:55.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:55.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-523 td/osd-backfill-space/datafile 2024-05-08T18:04:55.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-523 td/osd-backfill-space/datafile 2024-05-08T18:04:55.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:55.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:55.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:55.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-524 td/osd-backfill-space/datafile 2024-05-08T18:04:56.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-524 td/osd-backfill-space/datafile 2024-05-08T18:04:56.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:56.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:56.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-525 td/osd-backfill-space/datafile 2024-05-08T18:04:56.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-525 td/osd-backfill-space/datafile 2024-05-08T18:04:56.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:56.237 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:56.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-526 td/osd-backfill-space/datafile 2024-05-08T18:04:56.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-526 td/osd-backfill-space/datafile 2024-05-08T18:04:56.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:56.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:56.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-527 td/osd-backfill-space/datafile 2024-05-08T18:04:56.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-527 td/osd-backfill-space/datafile 2024-05-08T18:04:56.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:56.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:56.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-528 td/osd-backfill-space/datafile 2024-05-08T18:04:56.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-528 td/osd-backfill-space/datafile 2024-05-08T18:04:56.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:56.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:56.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-529 td/osd-backfill-space/datafile 2024-05-08T18:04:56.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-529 td/osd-backfill-space/datafile 2024-05-08T18:04:56.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:56.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:56.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-530 td/osd-backfill-space/datafile 2024-05-08T18:04:56.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-530 td/osd-backfill-space/datafile 2024-05-08T18:04:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:56.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:56.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-531 td/osd-backfill-space/datafile 2024-05-08T18:04:57.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-531 td/osd-backfill-space/datafile 2024-05-08T18:04:57.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:57.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:57.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-532 td/osd-backfill-space/datafile 2024-05-08T18:04:57.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-532 td/osd-backfill-space/datafile 2024-05-08T18:04:57.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:57.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:57.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-533 td/osd-backfill-space/datafile 2024-05-08T18:04:57.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-533 td/osd-backfill-space/datafile 2024-05-08T18:04:57.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:57.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:57.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-534 td/osd-backfill-space/datafile 2024-05-08T18:04:57.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile 2024-05-08T18:04:57.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:57.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:57.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-535 td/osd-backfill-space/datafile 2024-05-08T18:04:57.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-535 td/osd-backfill-space/datafile 2024-05-08T18:04:57.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:57.662 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:57.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-536 td/osd-backfill-space/datafile 2024-05-08T18:04:57.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-536 td/osd-backfill-space/datafile 2024-05-08T18:04:57.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:57.787 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:57.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-537 td/osd-backfill-space/datafile 2024-05-08T18:04:57.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-537 td/osd-backfill-space/datafile 2024-05-08T18:04:57.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:57.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:57.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:57.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-538 td/osd-backfill-space/datafile 2024-05-08T18:04:58.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-538 td/osd-backfill-space/datafile 2024-05-08T18:04:58.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:58.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:58.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-539 td/osd-backfill-space/datafile 2024-05-08T18:04:58.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-539 td/osd-backfill-space/datafile 2024-05-08T18:04:58.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:58.312 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:58.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-540 td/osd-backfill-space/datafile 2024-05-08T18:04:58.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-540 td/osd-backfill-space/datafile 2024-05-08T18:04:58.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:58.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:58.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-541 td/osd-backfill-space/datafile 2024-05-08T18:04:58.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-541 td/osd-backfill-space/datafile 2024-05-08T18:04:58.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:58.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:58.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-542 td/osd-backfill-space/datafile 2024-05-08T18:04:58.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-542 td/osd-backfill-space/datafile 2024-05-08T18:04:58.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:58.754 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:58.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-543 td/osd-backfill-space/datafile 2024-05-08T18:04:58.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-543 td/osd-backfill-space/datafile 2024-05-08T18:04:58.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:58.879 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:58.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-544 td/osd-backfill-space/datafile 2024-05-08T18:04:58.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:58.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-544 td/osd-backfill-space/datafile 2024-05-08T18:04:59.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:59.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:59.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-545 td/osd-backfill-space/datafile 2024-05-08T18:04:59.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-545 td/osd-backfill-space/datafile 2024-05-08T18:04:59.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:59.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:59.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-546 td/osd-backfill-space/datafile 2024-05-08T18:04:59.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-546 td/osd-backfill-space/datafile 2024-05-08T18:04:59.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:59.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:59.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-547 td/osd-backfill-space/datafile 2024-05-08T18:04:59.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-547 td/osd-backfill-space/datafile 2024-05-08T18:04:59.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:59.404 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:59.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-548 td/osd-backfill-space/datafile 2024-05-08T18:04:59.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-548 td/osd-backfill-space/datafile 2024-05-08T18:04:59.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:59.546 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:59.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-549 td/osd-backfill-space/datafile 2024-05-08T18:04:59.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-549 td/osd-backfill-space/datafile 2024-05-08T18:04:59.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:59.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:59.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-550 td/osd-backfill-space/datafile 2024-05-08T18:04:59.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-550 td/osd-backfill-space/datafile 2024-05-08T18:04:59.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:59.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:59.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-551 td/osd-backfill-space/datafile 2024-05-08T18:04:59.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile 2024-05-08T18:04:59.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:04:59.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:04:59.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:04:59.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-552 td/osd-backfill-space/datafile 2024-05-08T18:05:00.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-552 td/osd-backfill-space/datafile 2024-05-08T18:05:00.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:00.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:00.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-553 td/osd-backfill-space/datafile 2024-05-08T18:05:00.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-553 td/osd-backfill-space/datafile 2024-05-08T18:05:00.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:00.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:00.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-554 td/osd-backfill-space/datafile 2024-05-08T18:05:00.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-554 td/osd-backfill-space/datafile 2024-05-08T18:05:00.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:00.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:00.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-555 td/osd-backfill-space/datafile 2024-05-08T18:05:00.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-555 td/osd-backfill-space/datafile 2024-05-08T18:05:00.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:00.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:00.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-556 td/osd-backfill-space/datafile 2024-05-08T18:05:00.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-556 td/osd-backfill-space/datafile 2024-05-08T18:05:00.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:00.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:00.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-557 td/osd-backfill-space/datafile 2024-05-08T18:05:00.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-557 td/osd-backfill-space/datafile 2024-05-08T18:05:00.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:00.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:00.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-558 td/osd-backfill-space/datafile 2024-05-08T18:05:00.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-558 td/osd-backfill-space/datafile 2024-05-08T18:05:00.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:00.937 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:00.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-559 td/osd-backfill-space/datafile 2024-05-08T18:05:00.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:00.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-559 td/osd-backfill-space/datafile 2024-05-08T18:05:01.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:01.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:01.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-560 td/osd-backfill-space/datafile 2024-05-08T18:05:01.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-560 td/osd-backfill-space/datafile 2024-05-08T18:05:01.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:01.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:01.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-561 td/osd-backfill-space/datafile 2024-05-08T18:05:01.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-561 td/osd-backfill-space/datafile 2024-05-08T18:05:01.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:01.387 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:01.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-562 td/osd-backfill-space/datafile 2024-05-08T18:05:01.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-562 td/osd-backfill-space/datafile 2024-05-08T18:05:01.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:01.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:01.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-563 td/osd-backfill-space/datafile 2024-05-08T18:05:01.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-563 td/osd-backfill-space/datafile 2024-05-08T18:05:01.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:01.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:01.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-564 td/osd-backfill-space/datafile 2024-05-08T18:05:01.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-564 td/osd-backfill-space/datafile 2024-05-08T18:05:01.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:01.787 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:01.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-565 td/osd-backfill-space/datafile 2024-05-08T18:05:01.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-565 td/osd-backfill-space/datafile 2024-05-08T18:05:01.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:01.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:01.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:01.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-566 td/osd-backfill-space/datafile 2024-05-08T18:05:02.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-566 td/osd-backfill-space/datafile 2024-05-08T18:05:02.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:02.070 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:02.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-567 td/osd-backfill-space/datafile 2024-05-08T18:05:02.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-567 td/osd-backfill-space/datafile 2024-05-08T18:05:02.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:02.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:02.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile 2024-05-08T18:05:02.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2024-05-08T18:05:02.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:02.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:02.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-569 td/osd-backfill-space/datafile 2024-05-08T18:05:02.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-569 td/osd-backfill-space/datafile 2024-05-08T18:05:02.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:02.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:02.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-570 td/osd-backfill-space/datafile 2024-05-08T18:05:02.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-570 td/osd-backfill-space/datafile 2024-05-08T18:05:02.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:02.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:02.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-571 td/osd-backfill-space/datafile 2024-05-08T18:05:02.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-571 td/osd-backfill-space/datafile 2024-05-08T18:05:02.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:02.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:02.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-572 td/osd-backfill-space/datafile 2024-05-08T18:05:02.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-572 td/osd-backfill-space/datafile 2024-05-08T18:05:02.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:02.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:02.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-573 td/osd-backfill-space/datafile 2024-05-08T18:05:02.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-573 td/osd-backfill-space/datafile 2024-05-08T18:05:02.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:02.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:02.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:02.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-574 td/osd-backfill-space/datafile 2024-05-08T18:05:03.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-574 td/osd-backfill-space/datafile 2024-05-08T18:05:03.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:03.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:03.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-575 td/osd-backfill-space/datafile 2024-05-08T18:05:03.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-575 td/osd-backfill-space/datafile 2024-05-08T18:05:03.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:03.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:03.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-576 td/osd-backfill-space/datafile 2024-05-08T18:05:03.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-576 td/osd-backfill-space/datafile 2024-05-08T18:05:03.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:03.312 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:03.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-577 td/osd-backfill-space/datafile 2024-05-08T18:05:03.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-577 td/osd-backfill-space/datafile 2024-05-08T18:05:03.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:03.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:03.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-578 td/osd-backfill-space/datafile 2024-05-08T18:05:03.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-578 td/osd-backfill-space/datafile 2024-05-08T18:05:03.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:03.572 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:03.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-579 td/osd-backfill-space/datafile 2024-05-08T18:05:03.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-579 td/osd-backfill-space/datafile 2024-05-08T18:05:03.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:03.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:03.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-580 td/osd-backfill-space/datafile 2024-05-08T18:05:03.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-580 td/osd-backfill-space/datafile 2024-05-08T18:05:03.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:03.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:03.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-581 td/osd-backfill-space/datafile 2024-05-08T18:05:03.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-581 td/osd-backfill-space/datafile 2024-05-08T18:05:03.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:03.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:03.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:03.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-582 td/osd-backfill-space/datafile 2024-05-08T18:05:04.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-582 td/osd-backfill-space/datafile 2024-05-08T18:05:04.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:04.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:04.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-583 td/osd-backfill-space/datafile 2024-05-08T18:05:04.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-583 td/osd-backfill-space/datafile 2024-05-08T18:05:04.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:04.351 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:04.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-584 td/osd-backfill-space/datafile 2024-05-08T18:05:04.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-584 td/osd-backfill-space/datafile 2024-05-08T18:05:04.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:04.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:04.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile 2024-05-08T18:05:04.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-585 td/osd-backfill-space/datafile 2024-05-08T18:05:04.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:04.613 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:04.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-586 td/osd-backfill-space/datafile 2024-05-08T18:05:04.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-586 td/osd-backfill-space/datafile 2024-05-08T18:05:04.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:04.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:04.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-587 td/osd-backfill-space/datafile 2024-05-08T18:05:04.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-587 td/osd-backfill-space/datafile 2024-05-08T18:05:04.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:04.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:04.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-588 td/osd-backfill-space/datafile 2024-05-08T18:05:04.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:04.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-588 td/osd-backfill-space/datafile 2024-05-08T18:05:05.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:05.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:05.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-589 td/osd-backfill-space/datafile 2024-05-08T18:05:05.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-589 td/osd-backfill-space/datafile 2024-05-08T18:05:05.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:05.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:05.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-590 td/osd-backfill-space/datafile 2024-05-08T18:05:05.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-590 td/osd-backfill-space/datafile 2024-05-08T18:05:05.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:05.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:05.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-591 td/osd-backfill-space/datafile 2024-05-08T18:05:05.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-591 td/osd-backfill-space/datafile 2024-05-08T18:05:05.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:05.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:05.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-592 td/osd-backfill-space/datafile 2024-05-08T18:05:05.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-592 td/osd-backfill-space/datafile 2024-05-08T18:05:05.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:05.488 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:05.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-593 td/osd-backfill-space/datafile 2024-05-08T18:05:05.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-593 td/osd-backfill-space/datafile 2024-05-08T18:05:05.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:05.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:05.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-594 td/osd-backfill-space/datafile 2024-05-08T18:05:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-594 td/osd-backfill-space/datafile 2024-05-08T18:05:05.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:05.721 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:05.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-595 td/osd-backfill-space/datafile 2024-05-08T18:05:05.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-595 td/osd-backfill-space/datafile 2024-05-08T18:05:05.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:05.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:05.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-596 td/osd-backfill-space/datafile 2024-05-08T18:05:05.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:05.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-596 td/osd-backfill-space/datafile 2024-05-08T18:05:06.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:06.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:06.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:06.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-597 td/osd-backfill-space/datafile 2024-05-08T18:05:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-597 td/osd-backfill-space/datafile 2024-05-08T18:05:06.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:06.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:06.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:06.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-598 td/osd-backfill-space/datafile 2024-05-08T18:05:06.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:06.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-598 td/osd-backfill-space/datafile 2024-05-08T18:05:06.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:06.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:06.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:06.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-599 td/osd-backfill-space/datafile 2024-05-08T18:05:06.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:06.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-599 td/osd-backfill-space/datafile 2024-05-08T18:05:06.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-05-08T18:05:06.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:06.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:06.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-600 td/osd-backfill-space/datafile 2024-05-08T18:05:06.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-05-08T18:05:06.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-600 td/osd-backfill-space/datafile 2024-05-08T18:05:06.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:509: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.2.pid TERM 2024-05-08T18:05:06.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.2.pid 2024-05-08T18:05:06.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=173687 2024-05-08T18:05:06.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2024-05-08T18:05:06.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-05-08T18:05:06.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2024-05-08T18:05:06.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:05:06.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 173687 2024-05-08T18:05:06.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T18:05:06.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T18:05:06.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2024-05-08T18:05:06.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:05:06.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 173687 2024-05-08T18:05:06.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T18:05:06.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T18:05:06.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.2 2024-05-08T18:05:06.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:05:06.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 173687 2024-05-08T18:05:06.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2024-05-08T18:05:06.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2024-05-08T18:05:06.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2024-05-08T18:05:06.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:510: TEST_backfill_multi_partial: ceph osd out osd.2 2024-05-08T18:05:07.675 INFO:tasks.workunit.client.0.smithi117.stderr:osd.2 is already out. 2024-05-08T18:05:07.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:512: TEST_backfill_multi_partial: activate_osd td/osd-backfill-space 1 2024-05-08T18:05:07.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/osd-backfill-space 2024-05-08T18:05:07.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2024-05-08T18:05:07.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2024-05-08T18:05:07.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:05:07.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:05:07.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:05:07.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:05:07.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:05:07.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2024-05-08T18:05:07.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2024-05-08T18:05:07.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T18:05:07.700 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T18:05:07.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2024-05-08T18:05:07.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:05:07.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/osd-backfill-space/1/whoami 2024-05-08T18:05:07.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2024-05-08T18:05:07.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2024-05-08T18:05:07.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2024-05-08T18:05:07.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2024-05-08T18:05:07.736 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:05:07.734+0000 7f9911cfc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:05:07.764 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:05:07.762+0000 7f9911cfc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:05:07.766 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:05:07.766+0000 7f9911cfc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:05:08.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2024-05-08T18:05:08.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:05:08.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T18:05:08.297 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:05:08.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:05:08.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:05:08.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:05:08.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:05:08.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:05:08.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:05:08.323 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:05:08.322+0000 7f9911cfc7c0 -1 Falling back to public interface 2024-05-08T18:05:08.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:05:09.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:05:09.856 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:05:09.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:05:09.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:05:09.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:05:09.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:05:10.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:05:11.210 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:05:11.210+0000 7f9911cfc7c0 -1 osd.1 46 log_to_monitors true 2024-05-08T18:05:11.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:05:11.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:05:11.283 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:05:11.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:05:11.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:05:11.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:05:11.731 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up out weight 0 up_from 53 up_thru 33 down_at 48 last_clean_interval [42,46) [v2:127.0.0.1:6810/3055085259,v1:127.0.0.1:6811/3055085259] [v2:127.0.0.1:6812/3055085259,v1:127.0.0.1:6813/3055085259] exists,up 83e506b4-d223-4635-bdd2-899e68cc9fac 2024-05-08T18:05:11.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:05:11.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:05:11.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:05:11.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:513: TEST_backfill_multi_partial: ceph osd in osd.1 2024-05-08T18:05:12.354 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already in. 2024-05-08T18:05:12.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:514: TEST_backfill_multi_partial: sleep 30 2024-05-08T18:05:42.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:516: TEST_backfill_multi_partial: wait_for_not_backfilling 1200 2024-05-08T18:05:42.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-05-08T18:05:42.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-05-08T18:05:42.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-05-08T18:05:42.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:05:42.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:05:42.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-05-08T18:05:42.372 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:05:42.372 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:05:42.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:05:42.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:05:42.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:05:43.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-05-08T18:05:43.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:05:43.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:05:43.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:05:43.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:05:43.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:05:43.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:05:43.565 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:05:43.565 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T18:05:43.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:05:43.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:43.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:05:43.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836580 2024-05-08T18:05:43.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836580 2024-05-08T18:05:43.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836580' 2024-05-08T18:05:43.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:43.734 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:05:43.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=227633266697 2024-05-08T18:05:43.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 227633266697 2024-05-08T18:05:43.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836580 1-227633266697' 2024-05-08T18:05:43.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:43.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:05:44.040 INFO:tasks.workunit.client.0.smithi117.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-05-08T18:05:44.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq= 2024-05-08T18:05:44.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z '' 2024-05-08T18:05:44.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: continue 2024-05-08T18:05:44.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:05:44.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836580 2024-05-08T18:05:44.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:05:44.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:05:44.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836580 2024-05-08T18:05:44.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:05:44.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836580 2024-05-08T18:05:44.045 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836580 2024-05-08T18:05:44.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836580' 2024-05-08T18:05:44.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:05:44.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836580 -lt 21474836580 2024-05-08T18:05:44.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:05:44.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:05:44.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-227633266697 2024-05-08T18:05:44.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:05:44.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-227633266697 2024-05-08T18:05:44.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:05:44.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=227633266697 2024-05-08T18:05:44.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 227633266697' 2024-05-08T18:05:44.485 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 227633266697 2024-05-08T18:05:44.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:05:44.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 227633266695 -lt 227633266697 2024-05-08T18:05:44.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:05:45.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:05:45.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:05:46.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 227633266697 -lt 227633266697 2024-05-08T18:05:46.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:05:46.321 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:05:46.321 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:05:46.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 3 == 0 2024-05-08T18:05:46.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:05:46.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:05:46.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:05:46.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:05:46.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:05:46.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:05:46.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:05:47.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:05:47.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:05:47.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:05:47.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:05:47.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:517: TEST_backfill_multi_partial: wait_for_not_activating 60 2024-05-08T18:05:47.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-05-08T18:05:47.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-05-08T18:05:47.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-05-08T18:05:47.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:05:47.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:05:47.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-05-08T18:05:47.356 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:05:47.357 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:05:47.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:05:47.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:05:47.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:05:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-05-08T18:05:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:05:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:05:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:05:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:05:47.402 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:05:47.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:05:47.801 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:05:47.801 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T18:05:47.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:05:47.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:47.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:05:47.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836583 2024-05-08T18:05:47.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836583 2024-05-08T18:05:47.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836583' 2024-05-08T18:05:47.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:47.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:05:48.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=227633266700 2024-05-08T18:05:48.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 227633266700 2024-05-08T18:05:48.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836583 1-227633266700' 2024-05-08T18:05:48.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:48.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:05:48.253 INFO:tasks.workunit.client.0.smithi117.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-05-08T18:05:48.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq= 2024-05-08T18:05:48.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z '' 2024-05-08T18:05:48.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: continue 2024-05-08T18:05:48.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:05:48.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836583 2024-05-08T18:05:48.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:05:48.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:05:48.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836583 2024-05-08T18:05:48.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:05:48.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836583 2024-05-08T18:05:48.258 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836583 2024-05-08T18:05:48.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836583' 2024-05-08T18:05:48.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:05:48.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836581 -lt 21474836583 2024-05-08T18:05:48.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:05:49.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:05:49.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:05:50.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836584 -lt 21474836583 2024-05-08T18:05:50.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:05:50.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:05:50.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-227633266700 2024-05-08T18:05:50.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:05:50.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:05:50.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-227633266700 2024-05-08T18:05:50.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=227633266700 2024-05-08T18:05:50.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 227633266700' 2024-05-08T18:05:50.105 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 227633266700 2024-05-08T18:05:50.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:05:50.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 227633266700 -lt 227633266700 2024-05-08T18:05:50.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:05:50.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:05:50.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:05:51.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 3 == 0 2024-05-08T18:05:51.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:05:51.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-05-08T18:05:51.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-05-08T18:05:51.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:05:51.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-05-08T18:05:51.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-05-08T18:05:51.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:05:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:05:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:05:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:05:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:05:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:519: TEST_backfill_multi_partial: flush_pg_stats 2024-05-08T18:05:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:05:51.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:05:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:05:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:05:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T18:05:51.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:05:51.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:51.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:05:52.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836586 2024-05-08T18:05:52.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836586 2024-05-08T18:05:52.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836586' 2024-05-08T18:05:52.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:52.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:05:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=227633266702 2024-05-08T18:05:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 227633266702 2024-05-08T18:05:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836586 1-227633266702' 2024-05-08T18:05:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:05:52.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:05:52.432 INFO:tasks.workunit.client.0.smithi117.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-05-08T18:05:52.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq= 2024-05-08T18:05:52.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z '' 2024-05-08T18:05:52.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: continue 2024-05-08T18:05:52.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:05:52.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836586 2024-05-08T18:05:52.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:05:52.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:05:52.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836586 2024-05-08T18:05:52.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:05:52.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836586 2024-05-08T18:05:52.437 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836586 2024-05-08T18:05:52.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836586' 2024-05-08T18:05:52.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:05:52.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836584 -lt 21474836586 2024-05-08T18:05:52.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:05:53.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:05:53.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:05:54.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836586 -lt 21474836586 2024-05-08T18:05:54.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:05:54.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-227633266702 2024-05-08T18:05:54.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:05:54.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:05:54.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-227633266702 2024-05-08T18:05:54.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:05:54.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=227633266702 2024-05-08T18:05:54.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 227633266702' 2024-05-08T18:05:54.256 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 227633266702 2024-05-08T18:05:54.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:05:54.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 227633266703 -lt 227633266702 2024-05-08T18:05:54.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:520: TEST_backfill_multi_partial: ceph pg dump pgs 2024-05-08T18:05:55.093 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:05:55.093 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 600 0 600 0 0 1566600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T18:05:44.519511+0000 48'600 58:665 [1,0] 1 [0] 0 0'0 2024-05-08T17:59:29.398606+0000 0'0 2024-05-08T17:59:29.398606+0000 0 0 no scrub is scheduled 0 0 2024-05-08T18:05:55.093 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 600 0 0 0 0 1566600 0 0 10 1190 10 active+clean 2024-05-08T18:05:33.348543+0000 48'1200 58:2495 [1,0] 1 [1,0] 1 0'0 2024-05-08T17:59:26.608578+0000 0'0 2024-05-08T17:59:26.608578+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:33:52.203821+0000 0 0 2024-05-08T18:05:55.093 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 600 0 0 0 0 1566600 0 0 100 500 100 active+clean 2024-05-08T18:05:13.497819+0000 36'600 58:655 [1] 1 [1] 1 0'0 2024-05-08T17:59:23.872011+0000 0'0 2024-05-08T17:59:23.872011+0000 0 0 periodic scrub scheduled @ 2024-05-10T01:51:21.187229+0000 0 0 2024-05-08T18:05:55.093 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:05:55.093 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:05:55.093 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:05:55.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:522: TEST_backfill_multi_partial: ERRORS=0 2024-05-08T18:05:55.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:523: TEST_backfill_multi_partial: get_num_in_state backfill_toofull 2024-05-08T18:05:55.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfill_toofull 2024-05-08T18:05:55.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:05:55.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfill_toofull"))' 2024-05-08T18:05:55.109 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:05:55.109 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfill_toofull"))] | length' 2024-05-08T18:05:55.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:523: TEST_backfill_multi_partial: '[' 1 '!=' 1 ']' 2024-05-08T18:05:55.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:529: TEST_backfill_multi_partial: get_num_in_state active+clean 2024-05-08T18:05:55.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=active+clean 2024-05-08T18:05:55.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:05:55.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("active+clean"))' 2024-05-08T18:05:55.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:05:55.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("active+clean"))] | length' 2024-05-08T18:05:55.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:529: TEST_backfill_multi_partial: '[' 2 '!=' 2 ']' 2024-05-08T18:05:55.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:535: TEST_backfill_multi_partial: '[' 0 '!=' 0 ']' 2024-05-08T18:05:55.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: delete_pool fillpool 2024-05-08T18:05:55.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=fillpool 2024-05-08T18:05:55.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2024-05-08T18:05:56.405 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'fillpool' does not exist 2024-05-08T18:05:56.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:541: TEST_backfill_multi_partial: seq 1 2 2024-05-08T18:05:56.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:541: TEST_backfill_multi_partial: for i in $(seq 1 $pools) 2024-05-08T18:05:56.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:543: TEST_backfill_multi_partial: delete_pool test1 2024-05-08T18:05:56.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test1 2024-05-08T18:05:56.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-05-08T18:05:56.963 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' does not exist 2024-05-08T18:05:56.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:541: TEST_backfill_multi_partial: for i in $(seq 1 $pools) 2024-05-08T18:05:56.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:543: TEST_backfill_multi_partial: delete_pool test2 2024-05-08T18:05:56.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test2 2024-05-08T18:05:56.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-05-08T18:05:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' does not exist 2024-05-08T18:05:57.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:545: TEST_backfill_multi_partial: kill_daemons td/osd-backfill-space 2024-05-08T18:05:57.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:05:57.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:05:57.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:05:57.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:05:57.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:06:02.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:06:02.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:546: TEST_backfill_multi_partial: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2024-05-08T18:06:02.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-05-08T18:06:02.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:06:02.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:06:02.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:06:02.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:06:02.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:06:02.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:06:02.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:06:02.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:06:03.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:06:03.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:06:03.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:06:03.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:06:03.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:06:03.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:06:03.008 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:06:03.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:06:03.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:06:03.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:06:03.010 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:06:03.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:06:03.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:06:03.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:06:03.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:06:03.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:03.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:03.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:06:03.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:06:03.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:06:03.110 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:06:03.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:06:03.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:06:03.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:06:03.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:06:03.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:06:03.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:06:03.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:06:03.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:06:03.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:06:03.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:06:03.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:06:03.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:06:03.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:06:03.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:03.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:03.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:06:03.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:06:03.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:06:03.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2024-05-08T18:06:03.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T18:06:03.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:03.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:03.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.109971 2024-05-08T18:06:03.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T18:06:03.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_test_multi td/osd-backfill-space 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:192: TEST_backfill_test_multi: local dir=td/osd-backfill-space 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:193: TEST_backfill_test_multi: local pools=8 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:194: TEST_backfill_test_multi: local OSDS=20 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:196: TEST_backfill_test_multi: run_mon td/osd-backfill-space a 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T18:06:03.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2024-05-08T18:06:03.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-05-08T18:06:03.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T18:06:03.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:06:03.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:06:03.530 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:06:03.530 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:03.530 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:03.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:06:03.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T18:06:03.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T18:06:03.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T18:06:03.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:06:03.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:06:03.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T18:06:03.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T18:06:03.759 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:06:03.759 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:06:03.759 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:06:03.759 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:06:03.760 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:03.760 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:03.760 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:06:03.760 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:06:03.760 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get fsid 2024-05-08T18:06:03.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T18:06:03.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:06:03.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:06:03.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T18:06:03.876 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T18:06:03.876 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:06:03.876 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:06:03.876 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:06:03.876 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:06:03.876 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:03.877 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:03.877 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:06:03.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:06:03.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get mon_host 2024-05-08T18:06:03.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:197: TEST_backfill_test_multi: run_mgr td/osd-backfill-space x 2024-05-08T18:06:03.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-space 2024-05-08T18:06:03.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T18:06:03.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T18:06:03.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T18:06:03.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-space/x 2024-05-08T18:06:03.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T18:06:04.910 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T18:06:04.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:06:04.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:06:04.911 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:06:04.911 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:04.911 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:04.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:06:04.912 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:06:04.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:06:04.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:198: TEST_backfill_test_multi: export CEPH_ARGS 2024-05-08T18:06:04.987 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: expr 20 - 1 2024-05-08T18:06:04.988 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: seq 0 19 2024-05-08T18:06:04.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:06:04.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 0 2024-05-08T18:06:04.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:06:04.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:06:04.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T18:06:04.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:06:04.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:06:04.993 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:06:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:06:04.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T18:06:04.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:06:04.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c6416fc2-f597-4090-8911-10429295b6a2 2024-05-08T18:06:04.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 c6416fc2-f597-4090-8911-10429295b6a2' 2024-05-08T18:06:04.996 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 c6416fc2-f597-4090-8911-10429295b6a2 2024-05-08T18:06:04.996 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:06:05.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQANvztmF1tIARAAmBmwItoBk+94yo/Tup/xNw== 2024-05-08T18:06:05.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQANvztmF1tIARAAmBmwItoBk+94yo/Tup/xNw=="}' 2024-05-08T18:06:05.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c6416fc2-f597-4090-8911-10429295b6a2 -i td/osd-backfill-space/0/new.json 2024-05-08T18:06:05.335 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:06:05.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/0/new.json 2024-05-08T18:06:05.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQANvztmF1tIARAAmBmwItoBk+94yo/Tup/xNw== --osd-uuid c6416fc2-f597-4090-8911-10429295b6a2 2024-05-08T18:06:05.393 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:05.393+0000 7faedcd777c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:05.412 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:05.413+0000 7faedcd777c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:05.413 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:05.413+0000 7faedcd777c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:05.414 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:05.417+0000 7faedcd777c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:06:05.414 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:05.417+0000 7faedcd777c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:06:05.414 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:05.417+0000 7faedcd777c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:06:05.451 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:05.453+0000 7faedcd777c0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-05-08T18:06:11.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-05-08T18:06:11.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:06:11.881 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T18:06:11.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T18:06:11.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:06:12.443 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T18:06:12.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T18:06:12.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:06:12.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:06:12.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:06:12.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:06:12.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:12.481+0000 7f306c8527c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:12.525 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:12.525+0000 7f306c8527c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:12.527 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:12.529+0000 7f306c8527c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T18:06:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:06:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T18:06:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:06:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:06:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:12.905 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:06:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:06:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:12.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:13.112 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:13.113+0000 7f306c8527c0 -1 Falling back to public interface 2024-05-08T18:06:13.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:14.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:14.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:14.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:06:14.357 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:06:14.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:14.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:14.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:15.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:15.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:15.763 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:06:15.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:06:15.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:15.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:15.769 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:15.769+0000 7f306c8527c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:06:16.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:17.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:17.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:17.346 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:06:17.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:06:17.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:17.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:17.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:18.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:18.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:18.831 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:06:18.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:06:18.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:18.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:19.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:20.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:20.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:20.306 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:06:20.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:06:20.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:20.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:20.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:21.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:21.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:21.782 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:06:21.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:06:21.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:21.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:22.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:23.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:23.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:23.222 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:06:23.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:06:23.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:23.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:23.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:24.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:24.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:24.837 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:06:24.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:06:24.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:24.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:25.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:26.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:26.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:26.324 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:06:26.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:06:26.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:26.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:26.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:27.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:27.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:27.813 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:06:27.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:06:27.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:27.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:28.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:29.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:29.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:29.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:06:29.280 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:06:29.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:29.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:30.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:31.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:31.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:31.176 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:06:31.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:06:31.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:31.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:31.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:32.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:32.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:32.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:06:32.897 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:06:32.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:32.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:33.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:34.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:34.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:34.735 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:06:34.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:06:34.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:34.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:35.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:36.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:36.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:36.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:06:36.623 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:06:36.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:36.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:37.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:38.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:38.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:38.403 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:06:38.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:06:38.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:38.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:39.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:40.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:40.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:40.396 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:06:40.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:06:40.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:40.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:40.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:41.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:41.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:41.932 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:06:41.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:06:41.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:41.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:06:42.394 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3229469180,v1:127.0.0.1:6803/3229469180] [v2:127.0.0.1:6804/3229469180,v1:127.0.0.1:6805/3229469180] exists,up c6416fc2-f597-4090-8911-10429295b6a2 2024-05-08T18:06:42.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:06:42.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:06:42.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:06:42.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 1 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T18:06:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:06:42.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:06:42.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=97d87c58-15ba-406a-b6f5-018efb8c3e27 2024-05-08T18:06:42.401 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 97d87c58-15ba-406a-b6f5-018efb8c3e27 2024-05-08T18:06:42.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 97d87c58-15ba-406a-b6f5-018efb8c3e27' 2024-05-08T18:06:42.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:06:42.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAyvztmryKkGRAAQDaQQfuQHyIQejSYsnxqeg== 2024-05-08T18:06:42.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAyvztmryKkGRAAQDaQQfuQHyIQejSYsnxqeg=="}' 2024-05-08T18:06:42.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 97d87c58-15ba-406a-b6f5-018efb8c3e27 -i td/osd-backfill-space/1/new.json 2024-05-08T18:06:42.890 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:06:42.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/1/new.json 2024-05-08T18:06:42.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAyvztmryKkGRAAQDaQQfuQHyIQejSYsnxqeg== --osd-uuid 97d87c58-15ba-406a-b6f5-018efb8c3e27 2024-05-08T18:06:42.948 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:42.948+0000 7f363b0387c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:42.963 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:42.964+0000 7f363b0387c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:42.965 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:42.964+0000 7f363b0387c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:42.965 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:42.964+0000 7f363b0387c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:06:42.965 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:42.964+0000 7f363b0387c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:06:42.965 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:42.964+0000 7f363b0387c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:06:43.003 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:43.004+0000 7f363b0387c0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-05-08T18:06:49.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-05-08T18:06:49.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:06:49.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T18:06:49.997 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T18:06:49.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:06:50.578 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T18:06:50.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T18:06:50.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:06:50.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:06:50.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:06:50.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:06:50.617 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:50.616+0000 7fb693b5f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:50.661 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:50.660+0000 7fb693b5f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:50.662 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:50.664+0000 7fb693b5f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:06:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T18:06:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:06:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T18:06:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:06:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:06:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:51.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:06:51.046 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:06:51.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:51.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:06:51.231 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:51.232+0000 7fb693b5f7c0 -1 Falling back to public interface 2024-05-08T18:06:51.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:52.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:52.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:52.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:06:52.523 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:06:52.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:52.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:06:52.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:53.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:53.944 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:06:53.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:53.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:06:53.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:53.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:06:53.952 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:06:53.952+0000 7fb693b5f7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:06:54.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:55.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:55.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:55.372 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:06:55.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:06:55.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:55.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:06:55.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:56.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:56.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:56.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:06:56.816 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:06:56.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:56.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:06:57.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:58.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:58.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:58.290 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:06:58.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:06:58.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:58.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:06:58.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:06:59.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:06:59.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:06:59.738 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:06:59.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:06:59.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:06:59.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:00.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:01.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:01.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:01.222 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:07:01.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:07:01.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:01.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:01.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:02.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:02.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:02.643 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:07:02.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:07:02.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:02.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:03.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:04.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:04.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:04.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:07:04.139 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:07:04.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:04.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:04.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:05.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:05.663 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:07:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:07:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:05.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:06.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:07.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:07.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:07.137 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:07:07.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:07:07.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:07.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:07.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:08.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:08.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:08.576 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:07:08.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:07:08.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:08.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:09.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:10.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:10.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:10.494 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:07:10.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:07:10.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:10.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:11.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:12.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:12.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:12.089 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:07:12.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:07:12.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:12.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:12.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:13.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:13.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:13.782 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:07:13.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:07:13.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:13.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:14.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:15.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:15.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:15.386 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:07:15.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:07:15.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:15.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:16.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:17.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:17.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:17.269 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:07:17.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:07:17.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:17.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:18.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:19.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:19.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:19.198 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:07:19.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:07:19.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:19.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:20.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:21.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:21.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:21.076 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:07:21.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:07:21.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:21.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:07:21.534 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1237482903,v1:127.0.0.1:6811/1237482903] [v2:127.0.0.1:6812/1237482903,v1:127.0.0.1:6813/1237482903] exists,up 97d87c58-15ba-406a-b6f5-018efb8c3e27 2024-05-08T18:07:21.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:07:21.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:07:21.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:07:21.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:07:21.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 2 2024-05-08T18:07:21.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:07:21.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:07:21.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:07:21.538 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:07:21.538 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:07:21.538 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:07:21.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:07:21.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=469aee08-2ec7-4b09-9b7c-5fa2845f08a2 2024-05-08T18:07:21.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 469aee08-2ec7-4b09-9b7c-5fa2845f08a2' 2024-05-08T18:07:21.540 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 469aee08-2ec7-4b09-9b7c-5fa2845f08a2 2024-05-08T18:07:21.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:07:21.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBZvztmUaUGIhAAhxyC4cXkgt+ZmV6Z0vTFpw== 2024-05-08T18:07:21.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBZvztmUaUGIhAAhxyC4cXkgt+ZmV6Z0vTFpw=="}' 2024-05-08T18:07:21.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 469aee08-2ec7-4b09-9b7c-5fa2845f08a2 -i td/osd-backfill-space/2/new.json 2024-05-08T18:07:22.064 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:07:22.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/2/new.json 2024-05-08T18:07:22.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBZvztmUaUGIhAAhxyC4cXkgt+ZmV6Z0vTFpw== --osd-uuid 469aee08-2ec7-4b09-9b7c-5fa2845f08a2 2024-05-08T18:07:22.119 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:22.119+0000 7fa491ba07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:07:22.188 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:22.187+0000 7fa491ba07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:07:22.189 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:22.187+0000 7fa491ba07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:07:22.190 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:22.191+0000 7fa491ba07c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:07:22.190 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:22.191+0000 7fa491ba07c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:07:22.190 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:22.191+0000 7fa491ba07c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:07:22.314 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:22.315+0000 7fa491ba07c0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-05-08T18:07:29.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-05-08T18:07:29.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:07:29.298 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T18:07:29.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T18:07:29.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:07:29.869 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T18:07:29.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T18:07:29.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:07:29.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:07:29.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:07:29.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:07:29.908 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:29.907+0000 7fde1a2967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:07:29.943 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:29.943+0000 7fde1a2967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:07:29.945 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:29.943+0000 7fde1a2967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:07:30.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T18:07:30.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:07:30.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T18:07:30.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:07:30.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:07:30.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:30.324 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:07:30.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:07:30.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:30.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:30.527 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:30.527+0000 7fde1a2967c0 -1 Falling back to public interface 2024-05-08T18:07:30.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:31.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:31.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:31.750 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:07:31.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:07:31.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:31.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:32.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:33.176 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:07:33.175+0000 7fde1a2967c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:07:33.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:33.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:33.199 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:07:33.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:07:33.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:33.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:33.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:34.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:34.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:34.996 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:07:34.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:07:34.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:34.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:35.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:36.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:36.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:36.478 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:07:36.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:07:36.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:36.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:36.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:37.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:37.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:37.938 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:07:37.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:07:37.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:37.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:38.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:39.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:39.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:39.458 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:07:39.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:07:39.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:39.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:40.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:41.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:41.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:41.151 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:07:41.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:07:41.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:41.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:41.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:42.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:42.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:42.624 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:07:42.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:07:42.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:42.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:43.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:44.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:44.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:44.220 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:07:44.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:07:44.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:44.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:44.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:45.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:45.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:45.754 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:07:45.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:07:45.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:45.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:46.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:47.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:47.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:47.326 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:07:47.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:07:47.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:47.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:47.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:48.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:48.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:48.908 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:07:48.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:07:48.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:48.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:49.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:50.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:50.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:50.741 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:07:50.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:07:50.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:50.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:51.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:52.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:52.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:52.617 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:07:52.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:07:52.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:52.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:53.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:54.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:54.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:54.503 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:07:54.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:07:54.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:54.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:55.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:56.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:56.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:56.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:07:56.430 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:07:56.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:56.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:57.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:07:58.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:07:58.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:07:58.506 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:07:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:07:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:07:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:07:59.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:00.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:00.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:00.052 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:08:00.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:08:00.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:00.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:08:00.498 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3233510409,v1:127.0.0.1:6819/3233510409] [v2:127.0.0.1:6820/3233510409,v1:127.0.0.1:6821/3233510409] exists,up 469aee08-2ec7-4b09-9b7c-5fa2845f08a2 2024-05-08T18:08:00.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:08:00.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:08:00.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 3 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/3 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-05-08T18:08:00.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:08:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:08:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/3 2024-05-08T18:08:00.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:08:00.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=30875cda-a8f9-460a-805c-750aa8994ddb 2024-05-08T18:08:00.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 30875cda-a8f9-460a-805c-750aa8994ddb' 2024-05-08T18:08:00.506 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 30875cda-a8f9-460a-805c-750aa8994ddb 2024-05-08T18:08:00.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:08:00.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCAvztmDvbUHxAAevQMjAad6WGW2Dy6XAqolQ== 2024-05-08T18:08:00.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCAvztmDvbUHxAAevQMjAad6WGW2Dy6XAqolQ=="}' 2024-05-08T18:08:00.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 30875cda-a8f9-460a-805c-750aa8994ddb -i td/osd-backfill-space/3/new.json 2024-05-08T18:08:01.021 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:08:01.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/3/new.json 2024-05-08T18:08:01.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCAvztmDvbUHxAAevQMjAad6WGW2Dy6XAqolQ== --osd-uuid 30875cda-a8f9-460a-805c-750aa8994ddb 2024-05-08T18:08:01.078 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:01.075+0000 7ffbefd657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:01.115 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:01.115+0000 7ffbefd657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:01.118 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:01.115+0000 7ffbefd657c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:01.118 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:01.115+0000 7ffbefd657c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:08:01.118 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:01.115+0000 7ffbefd657c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:08:01.118 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:01.115+0000 7ffbefd657c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:08:01.154 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:01.155+0000 7ffbefd657c0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-05-08T18:08:07.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-05-08T18:08:07.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:08:07.800 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T18:08:07.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T18:08:07.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:08:08.357 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T18:08:08.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T18:08:08.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:08:08.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:08:08.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:08:08.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:08:08.395 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:08.395+0000 7f80fad777c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:08.438 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:08.435+0000 7f80fad777c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:08.439 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:08.439+0000 7f80fad777c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:08.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T18:08:08.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:08:08.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T18:08:08.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:08:08.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:08:08.831 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:08:08.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:08.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:08:08.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:08.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:09.000 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:08.998+0000 7f80fad777c0 -1 Falling back to public interface 2024-05-08T18:08:09.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:10.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:10.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:10.260 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:08:10.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:08:10.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:10.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:10.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:11.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:11.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:11.675 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:08:11.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:08:11.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:11.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:11.730 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:11.730+0000 7f80fad777c0 -1 osd.3 0 log_to_monitors true 2024-05-08T18:08:12.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:13.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:13.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:13.097 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:08:13.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:08:13.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:13.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:13.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:14.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:14.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:14.576 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:08:14.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:08:14.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:14.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:15.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:16.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:16.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:16.048 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:08:16.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:08:16.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:16.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:16.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:17.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:17.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:17.516 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:08:17.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:08:17.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:17.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:18.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:19.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:19.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:19.165 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:08:19.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:08:19.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:19.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:19.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:20.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:20.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:20.911 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:08:20.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:08:20.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:20.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:21.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:22.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:22.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:22.350 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:08:22.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:08:22.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:22.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:22.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:23.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:23.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:23.916 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:08:23.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:08:23.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:23.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:24.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:25.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:25.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:25.384 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:08:25.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:08:25.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:25.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:25.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:26.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:26.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:26.948 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:08:26.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:08:26.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:26.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:28.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:29.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:29.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:29.022 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:08:29.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:08:29.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:29.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:29.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:30.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:30.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:30.871 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:08:30.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:08:30.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:30.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:31.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:32.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:32.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:32.744 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:08:32.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:08:32.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:32.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:33.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:34.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:34.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:34.630 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:08:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:08:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:35.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:36.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:36.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:36.340 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:08:36.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:08:36.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:36.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:37.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:38.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:38.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:38.251 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:08:38.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:08:38.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:38.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:08:38.737 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2695514116,v1:127.0.0.1:6827/2695514116] [v2:127.0.0.1:6828/2695514116,v1:127.0.0.1:6829/2695514116] exists,up 30875cda-a8f9-460a-805c-750aa8994ddb 2024-05-08T18:08:38.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:08:38.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:08:38.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:08:38.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:08:38.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 4 2024-05-08T18:08:38.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/4 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:08:38.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:08:38.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:08:38.742 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:08:38.742 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:08:38.742 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:08:38.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:08:38.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/4 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4a242c46-5556-46a9-8432-b0ed3d6b8c80 2024-05-08T18:08:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 4a242c46-5556-46a9-8432-b0ed3d6b8c80' 2024-05-08T18:08:38.745 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 4a242c46-5556-46a9-8432-b0ed3d6b8c80 2024-05-08T18:08:38.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:08:38.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCmvztmu+InLhAAdi21+SQM/mS95NI/7TQocw== 2024-05-08T18:08:38.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCmvztmu+InLhAAdi21+SQM/mS95NI/7TQocw=="}' 2024-05-08T18:08:38.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4a242c46-5556-46a9-8432-b0ed3d6b8c80 -i td/osd-backfill-space/4/new.json 2024-05-08T18:08:39.330 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:08:39.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/4/new.json 2024-05-08T18:08:39.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCmvztmu+InLhAAdi21+SQM/mS95NI/7TQocw== --osd-uuid 4a242c46-5556-46a9-8432-b0ed3d6b8c80 2024-05-08T18:08:39.396 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:39.398+0000 7fa79b2507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:39.509 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:39.510+0000 7fa79b2507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:39.511 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:39.514+0000 7fa79b2507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:39.511 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:39.514+0000 7fa79b2507c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:08:39.511 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:39.514+0000 7fa79b2507c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:08:39.511 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:39.514+0000 7fa79b2507c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:08:39.596 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:39.598+0000 7fa79b2507c0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-05-08T18:08:46.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-05-08T18:08:46.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:08:46.442 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T18:08:46.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T18:08:46.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:08:46.997 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T18:08:46.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T18:08:46.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:08:46.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:08:46.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:08:46.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:08:47.029 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:47.030+0000 7f61463c17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:47.032 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:47.034+0000 7f61463c17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:47.033 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:47.034+0000 7f61463c17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:08:47.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T18:08:47.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:08:47.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T18:08:47.451 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:08:47.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:08:47.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:08:47.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:47.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:08:47.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:47.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:47.604 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:47.606+0000 7f61463c17c0 -1 Falling back to public interface 2024-05-08T18:08:47.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:48.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:48.868 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:08:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:08:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:48.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:49.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:50.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:50.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:50.299 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:08:50.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:08:50.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:50.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:50.362 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:08:50.362+0000 7f61463c17c0 -1 osd.4 0 log_to_monitors true 2024-05-08T18:08:50.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:51.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:51.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:51.775 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:08:51.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:08:51.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:51.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:52.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:53.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:53.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:53.344 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:08:53.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:08:53.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:53.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:53.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:54.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:54.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:54.887 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:08:54.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:08:54.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:54.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:55.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:56.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:56.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:56.415 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:08:56.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:08:56.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:56.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:56.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:57.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:57.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:57.856 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:08:57.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:08:57.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:57.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:58.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:08:59.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:08:59.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:08:59.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:08:59.417 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:08:59.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:08:59.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:08:59.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:00.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:00.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:00.884 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:09:00.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:09:00.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:00.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:01.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:02.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:02.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:02.375 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:09:02.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:09:02.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:02.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:02.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:03.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:03.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:03.880 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:09:03.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:09:03.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:03.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:04.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:05.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:05.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:05.421 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:09:05.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:09:05.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:05.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:06.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:07.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:07.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:07.260 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:09:07.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:09:07.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:07.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:08.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:09.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:09.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:09.116 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:09:09.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:09:09.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:09.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:10.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:11.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:11.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:11.062 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:09:11.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:09:11.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:11.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:11.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:12.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:12.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:12.930 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:09:12.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:09:12.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:12.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:13.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:14.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:14.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:14.809 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:09:14.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:09:14.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:14.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:15.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:16.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:16.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:16.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:09:16.527 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:09:16.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:16.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:17.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:18.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:18.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:18.034 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:09:18.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:09:18.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:18.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:09:18.522 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/47472765,v1:127.0.0.1:6835/47472765] [v2:127.0.0.1:6836/47472765,v1:127.0.0.1:6837/47472765] exists,up 4a242c46-5556-46a9-8432-b0ed3d6b8c80 2024-05-08T18:09:18.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:09:18.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:09:18.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:09:18.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:09:18.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 5 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/5 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:09:18.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:09:18.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:09:18.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:09:18.526 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:09:18.526 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:09:18.526 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:09:18.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:09:18.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/5 2024-05-08T18:09:18.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:09:18.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7f22b666-8224-406c-9643-a7f6f945bed3 2024-05-08T18:09:18.529 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 7f22b666-8224-406c-9643-a7f6f945bed3 2024-05-08T18:09:18.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 7f22b666-8224-406c-9643-a7f6f945bed3' 2024-05-08T18:09:18.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:09:18.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDOvztm3Y1KIRAAQnp5sh79LOIJJZaA5JwzIw== 2024-05-08T18:09:18.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDOvztm3Y1KIRAAQnp5sh79LOIJJZaA5JwzIw=="}' 2024-05-08T18:09:18.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7f22b666-8224-406c-9643-a7f6f945bed3 -i td/osd-backfill-space/5/new.json 2024-05-08T18:09:19.073 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:09:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/5/new.json 2024-05-08T18:09:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDOvztm3Y1KIRAAQnp5sh79LOIJJZaA5JwzIw== --osd-uuid 7f22b666-8224-406c-9643-a7f6f945bed3 2024-05-08T18:09:19.130 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:19.129+0000 7f08a185f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:19.131 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:19.133+0000 7f08a185f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:19.132 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:19.133+0000 7f08a185f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:19.133 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:19.133+0000 7f08a185f7c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:09:19.133 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:19.133+0000 7f08a185f7c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:09:19.133 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:19.133+0000 7f08a185f7c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:09:19.240 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:19.241+0000 7f08a185f7c0 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2024-05-08T18:09:26.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2024-05-08T18:09:26.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:09:26.175 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T18:09:26.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T18:09:26.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:09:26.747 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T18:09:26.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T18:09:26.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:09:26.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:09:26.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:09:26.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:09:26.785 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:26.785+0000 7f7d21f457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:26.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:26.793+0000 7f7d21f457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:26.793 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:26.793+0000 7f7d21f457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:27.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T18:09:27.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:09:27.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T18:09:27.174 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:09:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:09:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:09:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:09:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:27.376 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:27.377+0000 7f7d21f457c0 -1 Falling back to public interface 2024-05-08T18:09:27.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:28.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:28.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:28.592 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:09:28.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:09:28.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:28.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:29.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:30.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:30.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:30.020 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:09:30.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:09:30.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:30.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:30.030 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:30.033+0000 7f7d21f457c0 -1 osd.5 0 log_to_monitors true 2024-05-08T18:09:30.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:31.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:31.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:31.442 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:09:31.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:09:31.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:31.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:32.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:33.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:33.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:33.058 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:09:33.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:09:33.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:33.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:33.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:34.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:34.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:34.474 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:09:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:09:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:35.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:36.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:36.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:36.044 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:09:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:09:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:36.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:37.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:37.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:37.562 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:09:37.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:09:37.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:37.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:38.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:39.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:39.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:39.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:09:39.162 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:09:39.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:39.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:39.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:40.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:40.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:40.618 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:09:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:09:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:41.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:42.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:42.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:42.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:09:42.135 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:09:42.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:42.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:42.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:43.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:43.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:43.697 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:09:43.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:09:43.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:43.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:44.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:45.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:45.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:45.209 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:09:45.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:09:45.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:45.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:45.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:46.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:46.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:46.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:09:46.744 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:09:46.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:46.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:47.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:09:48.613 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:09:48.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:48.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:49.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:50.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:50.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:50.408 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:09:50.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:09:50.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:50.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:51.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:52.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:52.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:52.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:09:52.663 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:09:52.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:52.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:53.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:54.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:54.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:54.591 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:09:54.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:09:54.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:54.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:55.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:56.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:56.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:56.035 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:09:56.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:09:56.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:56.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:56.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:09:57.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:09:57.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:09:57.516 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:09:57.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:09:57.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:09:57.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:09:57.951 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3388220334,v1:127.0.0.1:6843/3388220334] [v2:127.0.0.1:6844/3388220334,v1:127.0.0.1:6845/3388220334] exists,up 7f22b666-8224-406c-9643-a7f6f945bed3 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 6 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=6 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:09:57.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/6 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/6' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/6/journal' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:09:57.955 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:09:57.956 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:09:57.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:09:57.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:09:57.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:09:57.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:09:57.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:09:57.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/6 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=76cc65d8-828d-4708-9bec-ea05857772d8 2024-05-08T18:09:57.958 INFO:tasks.workunit.client.0.smithi117.stdout:add osd6 76cc65d8-828d-4708-9bec-ea05857772d8 2024-05-08T18:09:57.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd6 76cc65d8-828d-4708-9bec-ea05857772d8' 2024-05-08T18:09:57.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:09:57.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD1vztmmx8EOxAAoyM6mSjk5pqzu1PrmWM1bA== 2024-05-08T18:09:57.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD1vztmmx8EOxAAoyM6mSjk5pqzu1PrmWM1bA=="}' 2024-05-08T18:09:57.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 76cc65d8-828d-4708-9bec-ea05857772d8 -i td/osd-backfill-space/6/new.json 2024-05-08T18:09:58.590 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:09:58.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/6/new.json 2024-05-08T18:09:58.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 6 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/6 --osd-journal=td/osd-backfill-space/6/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD1vztmmx8EOxAAoyM6mSjk5pqzu1PrmWM1bA== --osd-uuid 76cc65d8-828d-4708-9bec-ea05857772d8 2024-05-08T18:09:58.650 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:58.648+0000 7f296768c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:58.684 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:58.684+0000 7f296768c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:58.685 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:58.684+0000 7f296768c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:09:58.686 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:58.684+0000 7f296768c7c0 -1 bluestore(td/osd-backfill-space/6/block) _read_bdev_label failed to open td/osd-backfill-space/6/block: (2) No such file or directory 2024-05-08T18:09:58.686 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:58.684+0000 7f296768c7c0 -1 bluestore(td/osd-backfill-space/6/block) _read_bdev_label failed to open td/osd-backfill-space/6/block: (2) No such file or directory 2024-05-08T18:09:58.686 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:58.684+0000 7f296768c7c0 -1 bluestore(td/osd-backfill-space/6/block) _read_bdev_label failed to open td/osd-backfill-space/6/block: (2) No such file or directory 2024-05-08T18:09:58.723 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:09:58.724+0000 7f296768c7c0 -1 bluestore(td/osd-backfill-space/6) _read_fsid unparsable uuid 2024-05-08T18:10:05.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/6/keyring 2024-05-08T18:10:05.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:10:05.973 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd6 key to auth repository 2024-05-08T18:10:05.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd6 key to auth repository 2024-05-08T18:10:05.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:10:06.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.6 2024-05-08T18:10:06.533 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.6 2024-05-08T18:10:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:10:06.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 6 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/6 --osd-journal=td/osd-backfill-space/6/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:10:06.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:10:06.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:10:06.572 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:06.572+0000 7fc2d5ee27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:06.584 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:06.584+0000 7fc2d5ee27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:06.585 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:06.584+0000 7fc2d5ee27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:06.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 6 2024-05-08T18:10:06.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:10:06.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=6 2024-05-08T18:10:06.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:10:06.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:10:06.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:06.948 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:10:06.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:10:06.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:06.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:07.156 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:07.156+0000 7fc2d5ee27c0 -1 Falling back to public interface 2024-05-08T18:10:07.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:08.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:08.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:08.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:10:08.372 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:10:08.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:08.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:08.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:09.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:09.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:09.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:10:09.811 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:10:09.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:09.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:09.894 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:09.892+0000 7fc2d5ee27c0 -1 osd.6 0 log_to_monitors true 2024-05-08T18:10:10.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:11.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:11.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:11.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:10:11.296 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:10:11.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:11.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:12.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:13.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:13.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:13.016 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:10:13.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:10:13.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:13.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:13.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:14.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:14.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:14.509 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:10:14.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:10:14.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:14.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:15.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:16.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:16.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:16.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:10:16.020 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:10:16.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:16.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:16.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:17.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:17.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:17.554 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:10:17.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:10:17.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:17.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:19.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:19.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:19.473 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:10:19.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:10:19.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:19.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:20.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:21.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:21.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:21.116 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:10:21.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:10:21.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:21.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:21.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:22.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:22.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:22.598 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:10:22.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:10:22.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:22.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:23.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:24.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:24.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:24.135 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:10:24.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:10:24.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:24.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:24.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:25.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:25.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:25.838 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:10:25.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:10:25.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:25.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:26.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:27.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:27.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:27.420 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:10:27.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:10:27.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:27.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:28.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:29.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:29.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:29.632 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:10:29.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:10:29.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:29.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:30.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:31.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:31.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:31.161 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:10:31.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:10:31.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:31.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:31.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:32.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:32.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:32.763 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:10:32.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:10:32.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:32.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:33.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:34.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:34.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:34.347 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:10:34.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:10:34.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:34.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:34.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:35.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:35.853 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:10:35.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:35.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:10:35.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:35.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:36.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:37.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:37.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:37.554 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:10:37.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:10:37.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:37.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:37.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:39.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:39.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:39.000 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:10:39.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:10:39.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:39.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2024-05-08T18:10:39.440 INFO:tasks.workunit.client.0.smithi117.stdout:osd.6 up in weight 1 up_from 35 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1392825222,v1:127.0.0.1:6851/1392825222] [v2:127.0.0.1:6852/1392825222,v1:127.0.0.1:6853/1392825222] exists,up 76cc65d8-828d-4708-9bec-ea05857772d8 2024-05-08T18:10:39.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 7 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=7 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/7 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:10:39.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/7' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/7/journal' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:10:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:10:39.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/7 2024-05-08T18:10:39.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:10:39.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=cb424077-2dc1-47c8-a674-24f010e2c501 2024-05-08T18:10:39.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd7 cb424077-2dc1-47c8-a674-24f010e2c501' 2024-05-08T18:10:39.447 INFO:tasks.workunit.client.0.smithi117.stdout:add osd7 cb424077-2dc1-47c8-a674-24f010e2c501 2024-05-08T18:10:39.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:10:39.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAfwDtm1ByCHBAAuy0uHyRY6mx9vrEjGrGQuA== 2024-05-08T18:10:39.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAfwDtm1ByCHBAAuy0uHyRY6mx9vrEjGrGQuA=="}' 2024-05-08T18:10:39.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new cb424077-2dc1-47c8-a674-24f010e2c501 -i td/osd-backfill-space/7/new.json 2024-05-08T18:10:40.002 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:10:40.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/7/new.json 2024-05-08T18:10:40.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 7 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/7 --osd-journal=td/osd-backfill-space/7/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAfwDtm1ByCHBAAuy0uHyRY6mx9vrEjGrGQuA== --osd-uuid cb424077-2dc1-47c8-a674-24f010e2c501 2024-05-08T18:10:40.052 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:40.051+0000 7f7c5c5147c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:40.222 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:40.219+0000 7f7c5c5147c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:40.224 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:40.223+0000 7f7c5c5147c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:40.223+0000 7f7c5c5147c0 -1 bluestore(td/osd-backfill-space/7/block) _read_bdev_label failed to open td/osd-backfill-space/7/block: (2) No such file or directory 2024-05-08T18:10:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:40.223+0000 7f7c5c5147c0 -1 bluestore(td/osd-backfill-space/7/block) _read_bdev_label failed to open td/osd-backfill-space/7/block: (2) No such file or directory 2024-05-08T18:10:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:40.223+0000 7f7c5c5147c0 -1 bluestore(td/osd-backfill-space/7/block) _read_bdev_label failed to open td/osd-backfill-space/7/block: (2) No such file or directory 2024-05-08T18:10:40.259 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:40.259+0000 7f7c5c5147c0 -1 bluestore(td/osd-backfill-space/7) _read_fsid unparsable uuid 2024-05-08T18:10:45.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/7/keyring 2024-05-08T18:10:45.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:10:45.853 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd7 key to auth repository 2024-05-08T18:10:45.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd7 key to auth repository 2024-05-08T18:10:45.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:10:46.450 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.7 2024-05-08T18:10:46.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.7 2024-05-08T18:10:46.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 7 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/7 --osd-journal=td/osd-backfill-space/7/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:10:46.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:10:46.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:10:46.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:10:46.488 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:46.487+0000 7f86344297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:46.501 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:46.499+0000 7f86344297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:46.502 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:46.499+0000 7f86344297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:10:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 7 2024-05-08T18:10:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:10:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=7 2024-05-08T18:10:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:10:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:10:46.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:46.852 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:10:46.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:10:46.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:46.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:47.088 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:47.087+0000 7f86344297c0 -1 Falling back to public interface 2024-05-08T18:10:47.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:48.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:48.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:48.301 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:10:48.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:10:48.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:48.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:48.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:49.583 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:10:49.583+0000 7f86344297c0 -1 osd.7 0 log_to_monitors true 2024-05-08T18:10:49.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:49.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:49.739 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:10:49.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:10:49.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:49.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:50.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:51.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:51.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:51.327 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:10:51.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:10:51.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:51.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:51.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:52.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:52.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:52.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:10:52.767 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:10:52.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:52.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:53.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:54.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:54.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:54.215 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:10:54.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:10:54.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:54.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:54.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:55.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:55.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:55.770 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:10:55.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:10:55.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:55.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:56.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:57.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:57.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:57.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:10:57.209 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:10:57.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:57.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:57.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:10:58.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:10:58.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:10:58.728 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:10:58.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:10:58.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:10:58.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:10:59.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:00.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:00.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:00.178 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:11:00.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:11:00.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:00.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:00.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:01.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:01.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:01.677 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:11:01.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:11:01.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:01.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:02.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:03.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:03.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:03.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:11:03.195 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:11:03.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:03.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:03.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:04.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:04.661 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:11:04.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:04.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:11:04.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:04.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:05.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:06.355 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:11:06.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:11:06.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:06.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:07.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:08.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:08.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:08.496 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:11:08.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:11:08.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:08.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:09.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:10.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:10.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:10.223 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:11:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:11:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:10.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:11.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:11.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:11.886 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:11:11.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:11:11.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:11.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:12.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:13.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:13.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:13.782 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:11:13.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:11:13.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:13.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2024-05-08T18:11:14.220 INFO:tasks.workunit.client.0.smithi117.stdout:osd.7 up in weight 1 up_from 40 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/4085548063,v1:127.0.0.1:6859/4085548063] [v2:127.0.0.1:6860/4085548063,v1:127.0.0.1:6861/4085548063] exists,up cb424077-2dc1-47c8-a674-24f010e2c501 2024-05-08T18:11:14.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:11:14.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:11:14.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:11:14.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:11:14.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 8 2024-05-08T18:11:14.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:11:14.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=8 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/8 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/8' 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/8/journal' 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:11:14.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:11:14.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:11:14.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:11:14.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:11:14.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:11:14.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/8 2024-05-08T18:11:14.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:11:14.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1a4df5da-565a-4d2a-8bfe-b02666d2c774 2024-05-08T18:11:14.232 INFO:tasks.workunit.client.0.smithi117.stdout:add osd8 1a4df5da-565a-4d2a-8bfe-b02666d2c774 2024-05-08T18:11:14.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd8 1a4df5da-565a-4d2a-8bfe-b02666d2c774' 2024-05-08T18:11:14.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:11:14.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBCwDtmy1GmDxAA+TXLEkaTCQnXOWdKvqcG7Q== 2024-05-08T18:11:14.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBCwDtmy1GmDxAA+TXLEkaTCQnXOWdKvqcG7Q=="}' 2024-05-08T18:11:14.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1a4df5da-565a-4d2a-8bfe-b02666d2c774 -i td/osd-backfill-space/8/new.json 2024-05-08T18:11:14.898 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:11:14.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/8/new.json 2024-05-08T18:11:14.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 8 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/8 --osd-journal=td/osd-backfill-space/8/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBCwDtmy1GmDxAA+TXLEkaTCQnXOWdKvqcG7Q== --osd-uuid 1a4df5da-565a-4d2a-8bfe-b02666d2c774 2024-05-08T18:11:14.961 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:14.959+0000 7f8d299127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:15.050 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:15.051+0000 7f8d299127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:15.052 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:15.051+0000 7f8d299127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:15.053 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:15.051+0000 7f8d299127c0 -1 bluestore(td/osd-backfill-space/8/block) _read_bdev_label failed to open td/osd-backfill-space/8/block: (2) No such file or directory 2024-05-08T18:11:15.053 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:15.051+0000 7f8d299127c0 -1 bluestore(td/osd-backfill-space/8/block) _read_bdev_label failed to open td/osd-backfill-space/8/block: (2) No such file or directory 2024-05-08T18:11:15.053 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:15.051+0000 7f8d299127c0 -1 bluestore(td/osd-backfill-space/8/block) _read_bdev_label failed to open td/osd-backfill-space/8/block: (2) No such file or directory 2024-05-08T18:11:15.148 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:15.147+0000 7f8d299127c0 -1 bluestore(td/osd-backfill-space/8) _read_fsid unparsable uuid 2024-05-08T18:11:22.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/8/keyring 2024-05-08T18:11:22.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:11:22.624 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd8 key to auth repository 2024-05-08T18:11:22.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd8 key to auth repository 2024-05-08T18:11:22.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:11:23.184 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.8 2024-05-08T18:11:23.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.8 2024-05-08T18:11:23.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 8 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/8 --osd-journal=td/osd-backfill-space/8/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:11:23.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:11:23.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:11:23.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:11:23.222 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:23.219+0000 7f75943277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:23.255 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:23.255+0000 7f75943277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:23.257 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:23.255+0000 7f75943277c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:23.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 8 2024-05-08T18:11:23.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:11:23.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=8 2024-05-08T18:11:23.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:11:23.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:11:23.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:23.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:11:23.643 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:11:23.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:23.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:23.832 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:23.831+0000 7f75943277c0 -1 Falling back to public interface 2024-05-08T18:11:24.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:25.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:25.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:25.132 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:11:25.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:11:25.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:25.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:25.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:26.504 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:26.502+0000 7f75943277c0 -1 osd.8 0 log_to_monitors true 2024-05-08T18:11:26.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:26.568 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:11:26.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:26.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:11:26.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:26.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:27.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:28.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:28.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:28.059 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:11:28.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:11:28.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:28.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:28.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:29.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:29.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:29.620 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:11:29.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:11:29.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:29.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:30.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:31.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:31.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:31.395 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:11:31.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:11:31.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:31.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:31.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:32.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:32.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:32.996 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:11:32.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:11:32.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:32.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:33.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:34.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:34.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:11:34.476 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:11:34.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:34.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:34.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:35.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:35.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:35.985 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:11:35.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:11:35.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:35.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:36.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:37.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:37.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:37.564 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:11:37.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:11:37.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:37.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:38.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:39.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:39.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:39.430 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:11:39.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:11:39.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:39.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:40.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:41.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:41.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:41.078 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:11:41.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:11:41.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:41.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:41.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:42.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:42.516 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:11:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:11:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:43.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:44.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:44.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:44.326 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:11:44.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:11:44.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:44.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:45.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:46.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:46.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:46.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:11:46.461 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:11:46.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:46.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:46.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:47.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:47.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:47.970 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:11:47.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:11:47.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:47.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:48.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:49.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:49.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:49.520 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:11:49.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:11:49.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:49.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:50.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:51.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:51.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:51.264 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:11:51.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:11:51.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:51.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:52.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:53.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:53.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:53.235 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:11:53.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:11:53.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:53.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:53.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:11:54.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:11:54.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:11:54.885 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:11:54.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:11:54.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:11:54.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2024-05-08T18:11:55.331 INFO:tasks.workunit.client.0.smithi117.stdout:osd.8 up in weight 1 up_from 45 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/2219178375,v1:127.0.0.1:6867/2219178375] [v2:127.0.0.1:6868/2219178375,v1:127.0.0.1:6869/2219178375] exists,up 1a4df5da-565a-4d2a-8bfe-b02666d2c774 2024-05-08T18:11:55.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:11:55.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:11:55.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:11:55.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:11:55.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 9 2024-05-08T18:11:55.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=9 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/9 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/9' 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/9/journal' 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:11:55.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:11:55.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/9 2024-05-08T18:11:55.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:11:55.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=896373b7-3a4a-41c0-a1b3-94b1df762710 2024-05-08T18:11:55.340 INFO:tasks.workunit.client.0.smithi117.stdout:add osd9 896373b7-3a4a-41c0-a1b3-94b1df762710 2024-05-08T18:11:55.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd9 896373b7-3a4a-41c0-a1b3-94b1df762710' 2024-05-08T18:11:55.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:11:55.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBrwDtmAceIFRAALX+I+ZVnqmzXFhKWtM9WMA== 2024-05-08T18:11:55.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBrwDtmAceIFRAALX+I+ZVnqmzXFhKWtM9WMA=="}' 2024-05-08T18:11:55.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 896373b7-3a4a-41c0-a1b3-94b1df762710 -i td/osd-backfill-space/9/new.json 2024-05-08T18:11:55.860 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:11:55.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/9/new.json 2024-05-08T18:11:55.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 9 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/9 --osd-journal=td/osd-backfill-space/9/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBrwDtmAceIFRAALX+I+ZVnqmzXFhKWtM9WMA== --osd-uuid 896373b7-3a4a-41c0-a1b3-94b1df762710 2024-05-08T18:11:55.917 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:55.918+0000 7fd6c00967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:55.946 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:55.950+0000 7fd6c00967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:55.948 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:55.950+0000 7fd6c00967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:11:55.948 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:55.950+0000 7fd6c00967c0 -1 bluestore(td/osd-backfill-space/9/block) _read_bdev_label failed to open td/osd-backfill-space/9/block: (2) No such file or directory 2024-05-08T18:11:55.948 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:55.950+0000 7fd6c00967c0 -1 bluestore(td/osd-backfill-space/9/block) _read_bdev_label failed to open td/osd-backfill-space/9/block: (2) No such file or directory 2024-05-08T18:11:55.948 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:55.950+0000 7fd6c00967c0 -1 bluestore(td/osd-backfill-space/9/block) _read_bdev_label failed to open td/osd-backfill-space/9/block: (2) No such file or directory 2024-05-08T18:11:55.985 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:11:55.986+0000 7fd6c00967c0 -1 bluestore(td/osd-backfill-space/9) _read_fsid unparsable uuid 2024-05-08T18:12:03.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/9/keyring 2024-05-08T18:12:03.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:12:03.285 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd9 key to auth repository 2024-05-08T18:12:03.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd9 key to auth repository 2024-05-08T18:12:03.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:12:03.865 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.9 2024-05-08T18:12:03.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.9 2024-05-08T18:12:03.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 9 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/9 --osd-journal=td/osd-backfill-space/9/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:12:03.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:12:03.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:12:03.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:12:03.903 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:03.906+0000 7f83c23d47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:03.917 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:03.918+0000 7f83c23d47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:03.918 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:03.922+0000 7f83c23d47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:04.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 9 2024-05-08T18:12:04.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:12:04.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=9 2024-05-08T18:12:04.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:12:04.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:12:04.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:04.283 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:12:04.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:12:04.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:04.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:04.465 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:04.466+0000 7f83c23d47c0 -1 Falling back to public interface 2024-05-08T18:12:04.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:05.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:05.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:05.690 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:12:05.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:12:05.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:05.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:06.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:07.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:07.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:07.101 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:12:07.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:12:07.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:07.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:07.102 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:07.102+0000 7f83c23d47c0 -1 osd.9 0 log_to_monitors true 2024-05-08T18:12:07.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:08.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:08.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:08.520 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:12:08.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:12:08.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:08.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:08.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:09.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:09.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:09.987 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:12:09.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:12:09.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:09.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:10.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:11.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:11.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:11.530 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:12:11.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:12:11.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:11.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:12.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:13.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:13.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:13.126 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:12:13.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:12:13.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:13.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:13.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:14.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:14.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:14.610 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:12:14.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:12:14.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:14.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:15.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:16.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:16.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:16.166 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:12:16.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:12:16.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:16.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:16.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:17.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:17.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:17.681 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:12:17.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:12:17.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:17.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:18.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:19.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:19.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:19.253 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:12:19.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:12:19.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:19.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:19.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:20.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:20.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:20.738 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:12:20.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:12:20.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:20.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:21.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:22.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:22.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:22.259 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:12:22.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:12:22.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:22.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:23.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:24.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:24.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:24.318 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:12:24.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:12:24.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:24.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:25.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:26.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:26.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:26.267 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:12:26.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:12:26.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:26.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:27.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:28.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:28.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:28.309 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:12:28.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:12:28.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:28.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:29.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:30.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:30.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:30.134 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:12:30.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:12:30.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:30.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:31.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:32.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:32.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:32.343 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:12:32.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:12:32.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:32.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:33.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:34.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:34.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:34.243 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:12:34.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:12:34.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:34.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2024-05-08T18:12:34.751 INFO:tasks.workunit.client.0.smithi117.stdout:osd.9 up in weight 1 up_from 50 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/2620540492,v1:127.0.0.1:6875/2620540492] [v2:127.0.0.1:6876/2620540492,v1:127.0.0.1:6877/2620540492] exists,up 896373b7-3a4a-41c0-a1b3-94b1df762710 2024-05-08T18:12:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:12:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:12:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:12:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:12:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 10 2024-05-08T18:12:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:12:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=10 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/10 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/10' 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/10/journal' 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:12:34.754 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:12:34.755 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:12:34.755 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:12:34.755 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:12:34.755 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:12:34.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:12:34.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:12:34.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:12:34.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:12:34.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/10 2024-05-08T18:12:34.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:12:34.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=85873a83-a218-4e00-8c75-e692f5f671c1 2024-05-08T18:12:34.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd10 85873a83-a218-4e00-8c75-e692f5f671c1' 2024-05-08T18:12:34.758 INFO:tasks.workunit.client.0.smithi117.stdout:add osd10 85873a83-a218-4e00-8c75-e692f5f671c1 2024-05-08T18:12:34.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:12:34.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCSwDtmbtqzLhAAqnZaKzk+VQQOGB77xoEhrg== 2024-05-08T18:12:34.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCSwDtmbtqzLhAAqnZaKzk+VQQOGB77xoEhrg=="}' 2024-05-08T18:12:34.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 85873a83-a218-4e00-8c75-e692f5f671c1 -i td/osd-backfill-space/10/new.json 2024-05-08T18:12:35.307 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:12:35.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/10/new.json 2024-05-08T18:12:35.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 10 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/10 --osd-journal=td/osd-backfill-space/10/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCSwDtmbtqzLhAAqnZaKzk+VQQOGB77xoEhrg== --osd-uuid 85873a83-a218-4e00-8c75-e692f5f671c1 2024-05-08T18:12:35.356 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:35.357+0000 7f2f971227c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:35.479 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:35.481+0000 7f2f971227c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:35.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:35.481+0000 7f2f971227c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:35.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:35.481+0000 7f2f971227c0 -1 bluestore(td/osd-backfill-space/10/block) _read_bdev_label failed to open td/osd-backfill-space/10/block: (2) No such file or directory 2024-05-08T18:12:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:35.481+0000 7f2f971227c0 -1 bluestore(td/osd-backfill-space/10/block) _read_bdev_label failed to open td/osd-backfill-space/10/block: (2) No such file or directory 2024-05-08T18:12:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:35.481+0000 7f2f971227c0 -1 bluestore(td/osd-backfill-space/10/block) _read_bdev_label failed to open td/osd-backfill-space/10/block: (2) No such file or directory 2024-05-08T18:12:35.618 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:35.617+0000 7f2f971227c0 -1 bluestore(td/osd-backfill-space/10) _read_fsid unparsable uuid 2024-05-08T18:12:42.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/10/keyring 2024-05-08T18:12:42.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:12:42.624 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd10 key to auth repository 2024-05-08T18:12:42.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd10 key to auth repository 2024-05-08T18:12:42.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/10/keyring auth add osd.10 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:12:43.190 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.10 2024-05-08T18:12:43.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.10 2024-05-08T18:12:43.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 10 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/10 --osd-journal=td/osd-backfill-space/10/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:12:43.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:12:43.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:12:43.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:12:43.228 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:43.229+0000 7fc36f1a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:43.272 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:43.273+0000 7fc36f1a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:43.273 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:43.273+0000 7fc36f1a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:12:43.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 10 2024-05-08T18:12:43.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:12:43.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=10 2024-05-08T18:12:43.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:12:43.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:12:43.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:43.650 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:12:43.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:12:43.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:43.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:43.840 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:43.841+0000 7fc36f1a47c0 -1 Falling back to public interface 2024-05-08T18:12:44.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:45.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:45.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:45.083 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:12:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:12:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:45.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:46.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:46.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:46.563 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:12:46.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:12:46.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:46.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:46.628 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:12:46.629+0000 7fc36f1a47c0 -1 osd.10 0 log_to_monitors true 2024-05-08T18:12:47.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:48.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:48.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:48.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:12:48.032 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:12:48.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:48.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:48.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:49.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:49.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:49.584 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:12:49.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:12:49.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:49.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:50.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:51.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:51.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:51.032 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:12:51.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:12:51.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:51.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:51.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:52.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:52.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:52.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:12:52.579 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:12:52.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:52.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:53.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:54.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:54.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:54.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:12:54.063 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:12:54.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:54.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:54.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:55.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:55.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:55.562 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:12:55.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:12:55.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:55.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:56.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:57.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:57.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:57.165 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:12:57.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:12:57.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:57.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:57.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:12:58.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:12:58.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:12:58.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:12:58.727 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:12:58.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:12:58.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:12:59.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:00.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:00.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:00.180 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:13:00.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:13:00.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:00.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:00.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:01.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:01.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:01.826 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:13:01.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:13:01.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:01.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:02.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:03.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:03.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:03.462 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:13:03.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:13:03.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:03.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:04.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:04.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:04.928 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:13:04.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:13:04.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:04.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:05.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:06.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:06.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:06.834 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:13:06.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:13:06.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:06.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:07.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:08.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:08.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:08.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:13:08.764 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:13:08.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:08.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:09.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:10.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:10.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:10.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:13:10.891 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:13:10.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:10.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:11.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:12.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:12.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:12.811 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:13:12.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:13:12.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:12.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:13.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:14.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:14.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:14.369 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:13:14.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:13:14.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:14.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2024-05-08T18:13:14.988 INFO:tasks.workunit.client.0.smithi117.stdout:osd.10 up in weight 1 up_from 54 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6882/1124481206,v1:127.0.0.1:6883/1124481206] [v2:127.0.0.1:6884/1124481206,v1:127.0.0.1:6885/1124481206] exists,up 85873a83-a218-4e00-8c75-e692f5f671c1 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 11 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=11 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/11 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:13:14.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/11' 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/11/journal' 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:13:14.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:13:14.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/11 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e377ca97-7bb3-4a3a-b263-bea4a523c1ca 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd11 e377ca97-7bb3-4a3a-b263-bea4a523c1ca' 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stdout:add osd11 e377ca97-7bb3-4a3a-b263-bea4a523c1ca 2024-05-08T18:13:14.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:13:15.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC7wDtmHHl/ARAAlnjROo5Y1JUTuzuBCy0pgA== 2024-05-08T18:13:15.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC7wDtmHHl/ARAAlnjROo5Y1JUTuzuBCy0pgA=="}' 2024-05-08T18:13:15.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e377ca97-7bb3-4a3a-b263-bea4a523c1ca -i td/osd-backfill-space/11/new.json 2024-05-08T18:13:15.663 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:13:15.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/11/new.json 2024-05-08T18:13:15.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 11 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/11 --osd-journal=td/osd-backfill-space/11/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC7wDtmHHl/ARAAlnjROo5Y1JUTuzuBCy0pgA== --osd-uuid e377ca97-7bb3-4a3a-b263-bea4a523c1ca 2024-05-08T18:13:15.720 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:15.720+0000 7f53278e37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:13:15.789 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:15.788+0000 7f53278e37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:13:15.790 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:15.792+0000 7f53278e37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:13:15.791 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:15.792+0000 7f53278e37c0 -1 bluestore(td/osd-backfill-space/11/block) _read_bdev_label failed to open td/osd-backfill-space/11/block: (2) No such file or directory 2024-05-08T18:13:15.791 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:15.792+0000 7f53278e37c0 -1 bluestore(td/osd-backfill-space/11/block) _read_bdev_label failed to open td/osd-backfill-space/11/block: (2) No such file or directory 2024-05-08T18:13:15.791 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:15.792+0000 7f53278e37c0 -1 bluestore(td/osd-backfill-space/11/block) _read_bdev_label failed to open td/osd-backfill-space/11/block: (2) No such file or directory 2024-05-08T18:13:15.938 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:15.936+0000 7f53278e37c0 -1 bluestore(td/osd-backfill-space/11) _read_fsid unparsable uuid 2024-05-08T18:13:24.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/11/keyring 2024-05-08T18:13:24.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:13:24.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd11 key to auth repository 2024-05-08T18:13:24.404 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd11 key to auth repository 2024-05-08T18:13:24.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/11/keyring auth add osd.11 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:13:24.993 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.11 2024-05-08T18:13:24.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.11 2024-05-08T18:13:24.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 11 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/11 --osd-journal=td/osd-backfill-space/11/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:13:24.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:13:24.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:13:24.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:13:25.031 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:25.032+0000 7f06f2d4a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:13:25.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:25.092+0000 7f06f2d4a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:13:25.092 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:25.092+0000 7f06f2d4a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:13:25.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 11 2024-05-08T18:13:25.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:13:25.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=11 2024-05-08T18:13:25.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:13:25.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:13:25.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:25.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:13:25.403 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:13:25.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:25.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:25.657 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:25.656+0000 7f06f2d4a7c0 -1 Falling back to public interface 2024-05-08T18:13:25.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:26.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:26.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:26.860 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:13:26.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:13:26.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:26.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:27.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:28.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:28.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:28.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:13:28.304 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:13:28.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:28.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:28.513 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:13:28.512+0000 7f06f2d4a7c0 -1 osd.11 0 log_to_monitors true 2024-05-08T18:13:28.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:29.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:29.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:29.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:13:29.813 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:13:29.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:29.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:30.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:31.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:31.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:31.743 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:13:31.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:13:31.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:31.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:32.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:33.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:33.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:33.228 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:13:33.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:13:33.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:33.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:33.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:34.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:34.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:34.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:13:34.829 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:13:34.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:34.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:35.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:36.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:36.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:36.400 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:13:36.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:13:36.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:36.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:37.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:38.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:38.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:38.112 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:13:38.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:13:38.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:38.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:38.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:39.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:39.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:39.696 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:13:39.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:13:39.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:39.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:40.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:41.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:41.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:41.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:13:41.465 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:13:41.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:41.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:42.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:43.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:43.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:43.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:13:43.048 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:13:43.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:43.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:43.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:44.604 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:13:44.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:13:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:44.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:45.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:46.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:46.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:46.065 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:13:46.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:13:46.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:46.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:46.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:47.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:47.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:47.733 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:13:47.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:13:47.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:47.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:48.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:49.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:49.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:49.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:13:49.203 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:13:49.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:49.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:50.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:51.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:51.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:51.040 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:13:51.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:13:51.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:51.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:51.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:52.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:52.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:52.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:13:52.822 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:13:52.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:52.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:53.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:54.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:54.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:54.852 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:13:54.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:13:54.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:54.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:55.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:56.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:56.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:56.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:13:56.731 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:13:56.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:56.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:57.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:13:58.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:13:58.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:13:58.410 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:13:58.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:13:58.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:13:58.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:13:59.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:00.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:00.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:00.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T18:14:00.439 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T18:14:00.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:00.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:14:00.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:01.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:01.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:01.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T18:14:01.869 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T18:14:01.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:01.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.11 up' 2024-05-08T18:14:02.315 INFO:tasks.workunit.client.0.smithi117.stdout:osd.11 up in weight 1 up_from 59 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6890/2438963677,v1:127.0.0.1:6891/2438963677] [v2:127.0.0.1:6892/2438963677,v1:127.0.0.1:6893/2438963677] exists,up e377ca97-7bb3-4a3a-b263-bea4a523c1ca 2024-05-08T18:14:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:14:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 12 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=12 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/12 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:14:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/12' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/12/journal' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:14:02.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/12 2024-05-08T18:14:02.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:14:02.321 INFO:tasks.workunit.client.0.smithi117.stdout:add osd12 7608e1f0-59ce-4127-9872-b3821fe17033 2024-05-08T18:14:02.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7608e1f0-59ce-4127-9872-b3821fe17033 2024-05-08T18:14:02.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd12 7608e1f0-59ce-4127-9872-b3821fe17033' 2024-05-08T18:14:02.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:14:02.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDqwDtm52GyFBAAFfBFkSjuvUiP9RgkoXGtKQ== 2024-05-08T18:14:02.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDqwDtm52GyFBAAFfBFkSjuvUiP9RgkoXGtKQ=="}' 2024-05-08T18:14:02.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7608e1f0-59ce-4127-9872-b3821fe17033 -i td/osd-backfill-space/12/new.json 2024-05-08T18:14:03.175 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:14:03.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/12/new.json 2024-05-08T18:14:03.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 12 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/12 --osd-journal=td/osd-backfill-space/12/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDqwDtm52GyFBAAFfBFkSjuvUiP9RgkoXGtKQ== --osd-uuid 7608e1f0-59ce-4127-9872-b3821fe17033 2024-05-08T18:14:03.230 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:03.228+0000 7ff4e5b4b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:03.265 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:03.264+0000 7ff4e5b4b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:03.267 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:03.268+0000 7ff4e5b4b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:03.267 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:03.268+0000 7ff4e5b4b7c0 -1 bluestore(td/osd-backfill-space/12/block) _read_bdev_label failed to open td/osd-backfill-space/12/block: (2) No such file or directory 2024-05-08T18:14:03.267 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:03.268+0000 7ff4e5b4b7c0 -1 bluestore(td/osd-backfill-space/12/block) _read_bdev_label failed to open td/osd-backfill-space/12/block: (2) No such file or directory 2024-05-08T18:14:03.267 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:03.268+0000 7ff4e5b4b7c0 -1 bluestore(td/osd-backfill-space/12/block) _read_bdev_label failed to open td/osd-backfill-space/12/block: (2) No such file or directory 2024-05-08T18:14:03.382 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:03.380+0000 7ff4e5b4b7c0 -1 bluestore(td/osd-backfill-space/12) _read_fsid unparsable uuid 2024-05-08T18:14:11.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/12/keyring 2024-05-08T18:14:11.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:14:11.924 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd12 key to auth repository 2024-05-08T18:14:11.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd12 key to auth repository 2024-05-08T18:14:11.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/12/keyring auth add osd.12 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:14:12.493 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.12 2024-05-08T18:14:12.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.12 2024-05-08T18:14:12.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:14:12.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:14:12.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:14:12.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 12 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/12 --osd-journal=td/osd-backfill-space/12/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:14:12.532 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:12.531+0000 7f7317b1f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:12.552 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:12.551+0000 7f7317b1f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:12.553 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:12.551+0000 7f7317b1f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:12.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 12 2024-05-08T18:14:12.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:14:12.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=12 2024-05-08T18:14:12.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:14:12.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:14:12.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:12.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:14:12.944 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:14:12.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:12.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:13.112 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:13.111+0000 7f7317b1f7c0 -1 Falling back to public interface 2024-05-08T18:14:13.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:14.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:14.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:14.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:14:14.378 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:14:14.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:14.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:14.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:15.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:15.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:15.809 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:14:15.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:14:15.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:15.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:16.038 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:16.035+0000 7f7317b1f7c0 -1 osd.12 0 log_to_monitors true 2024-05-08T18:14:16.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:17.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:17.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:17.347 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:14:17.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:14:17.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:17.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:17.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:18.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:18.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:18.813 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:14:18.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:14:18.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:18.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:19.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:20.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:20.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:20.524 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:14:20.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:14:20.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:20.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:20.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:21.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:21.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:21.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:14:21.962 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:14:21.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:21.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:22.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:23.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:23.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:23.619 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:14:23.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:14:23.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:23.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:24.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:25.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:25.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:25.347 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:14:25.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:14:25.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:25.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:25.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:26.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:26.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:26.826 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:14:26.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:14:26.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:26.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:28.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:28.279 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:14:28.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:28.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:14:28.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:28.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:29.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:30.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:30.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:30.063 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:14:30.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:14:30.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:30.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:30.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:31.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:31.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:31.629 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:14:31.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:14:31.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:31.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:32.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:33.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:33.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:33.069 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:14:33.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:14:33.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:33.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:33.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:34.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:34.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:34.542 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:14:34.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:14:34.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:34.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:35.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:36.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:36.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:36.299 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:14:36.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:14:36.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:36.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:37.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:38.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:38.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:38.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:14:38.181 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:14:38.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:38.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:38.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:39.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:39.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:39.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:14:39.738 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:14:39.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:39.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:41.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:42.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:42.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:42.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:14:42.028 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:14:42.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:42.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:42.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:43.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:43.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:43.729 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:14:43.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:14:43.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:43.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:45.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:46.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:46.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:46.185 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:14:46.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:14:46.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:46.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:46.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:47.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:47.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:47.718 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T18:14:47.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T18:14:47.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:47.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:48.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:14:49.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:14:49.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:14:49.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T18:14:49.218 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T18:14:49.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:14:49.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.12 up' 2024-05-08T18:14:49.665 INFO:tasks.workunit.client.0.smithi117.stdout:osd.12 up in weight 1 up_from 64 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6898/3777764818,v1:127.0.0.1:6899/3777764818] [v2:127.0.0.1:6900/3777764818,v1:127.0.0.1:6901/3777764818] exists,up 7608e1f0-59ce-4127-9872-b3821fe17033 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 13 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=13 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/13 2024-05-08T18:14:49.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/13' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/13/journal' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:14:49.670 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:14:49.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/13 2024-05-08T18:14:49.672 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:14:49.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ff98625b-d5b5-4832-8391-a1de34518bc0 2024-05-08T18:14:49.672 INFO:tasks.workunit.client.0.smithi117.stdout:add osd13 ff98625b-d5b5-4832-8391-a1de34518bc0 2024-05-08T18:14:49.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd13 ff98625b-d5b5-4832-8391-a1de34518bc0' 2024-05-08T18:14:49.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:14:49.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAZwTtmd5HZKRAAcO6RnuoRF64wEamxOiiB7w== 2024-05-08T18:14:49.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAZwTtmd5HZKRAAcO6RnuoRF64wEamxOiiB7w=="}' 2024-05-08T18:14:49.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ff98625b-d5b5-4832-8391-a1de34518bc0 -i td/osd-backfill-space/13/new.json 2024-05-08T18:14:50.367 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:14:50.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/13/new.json 2024-05-08T18:14:50.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 13 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/13 --osd-journal=td/osd-backfill-space/13/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAZwTtmd5HZKRAAcO6RnuoRF64wEamxOiiB7w== --osd-uuid ff98625b-d5b5-4832-8391-a1de34518bc0 2024-05-08T18:14:50.428 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:50.427+0000 7f63a5b257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:50.465 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:50.463+0000 7f63a5b257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:50.467 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:50.467+0000 7f63a5b257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:14:50.467 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:50.467+0000 7f63a5b257c0 -1 bluestore(td/osd-backfill-space/13/block) _read_bdev_label failed to open td/osd-backfill-space/13/block: (2) No such file or directory 2024-05-08T18:14:50.467 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:50.467+0000 7f63a5b257c0 -1 bluestore(td/osd-backfill-space/13/block) _read_bdev_label failed to open td/osd-backfill-space/13/block: (2) No such file or directory 2024-05-08T18:14:50.467 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:50.467+0000 7f63a5b257c0 -1 bluestore(td/osd-backfill-space/13/block) _read_bdev_label failed to open td/osd-backfill-space/13/block: (2) No such file or directory 2024-05-08T18:14:50.504 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:14:50.503+0000 7f63a5b257c0 -1 bluestore(td/osd-backfill-space/13) _read_fsid unparsable uuid 2024-05-08T18:14:59.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/13/keyring 2024-05-08T18:14:59.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:14:59.328 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd13 key to auth repository 2024-05-08T18:14:59.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd13 key to auth repository 2024-05-08T18:14:59.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/13/keyring auth add osd.13 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:14:59.988 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.13 2024-05-08T18:14:59.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.13 2024-05-08T18:14:59.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 13 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/13 --osd-journal=td/osd-backfill-space/13/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:14:59.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:14:59.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:14:59.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:15:00.027 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:00.027+0000 7fe0e67a67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:00.068 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:00.067+0000 7fe0e67a67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:00.069 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:00.067+0000 7fe0e67a67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 13 2024-05-08T18:15:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:15:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=13 2024-05-08T18:15:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:15:00.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:15:00.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:00.411 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:15:00.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:15:00.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:00.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:00.633 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:00.631+0000 7fe0e67a67c0 -1 Falling back to public interface 2024-05-08T18:15:00.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:01.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:01.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:01.847 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:15:01.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:15:01.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:01.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:02.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:03.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:03.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:03.342 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:15:03.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:15:03.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:03.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:03.393 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:03.390+0000 7fe0e67a67c0 -1 osd.13 0 log_to_monitors true 2024-05-08T18:15:03.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:04.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:04.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:04.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:15:04.841 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:15:04.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:04.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:05.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:06.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:06.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:06.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:15:06.320 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:15:06.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:06.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:07.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:08.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:08.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:08.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:15:08.042 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:15:08.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:08.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:08.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:09.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:09.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:09.722 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:15:09.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:15:09.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:09.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:10.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:11.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:11.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:11.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:15:11.236 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:15:11.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:11.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:11.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:12.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:12.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:12.883 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:15:12.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:15:12.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:12.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:13.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:14.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:14.455 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:15:14.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:14.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:15:14.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:14.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:15.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:16.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:16.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:16.010 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:15:16.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:15:16.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:16.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:16.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:17.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:17.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:17.633 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:15:17.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:15:17.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:17.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:18.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:19.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:19.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:19.123 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:15:19.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:15:19.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:19.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:19.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:15:20.607 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:15:20.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:20.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:21.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:22.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:22.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:22.120 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:15:22.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:15:22.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:22.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:23.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:24.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:24.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:24.128 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:15:24.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:15:24.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:24.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:25.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:26.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:26.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:26.559 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:15:26.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:15:26.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:26.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:27.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:28.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:28.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:28.549 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:15:28.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:15:28.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:28.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:29.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:30.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:30.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:30.333 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:15:30.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:15:30.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:30.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:31.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:32.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:32.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:32.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:15:32.671 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:15:32.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:32.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:33.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:34.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:34.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:34.656 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:15:34.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:15:34.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:34.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:35.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:36.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:36.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:36.267 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T18:15:36.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T18:15:36.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:36.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.13 up' 2024-05-08T18:15:36.821 INFO:tasks.workunit.client.0.smithi117.stdout:osd.13 up in weight 1 up_from 69 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6906/3097330890,v1:127.0.0.1:6907/3097330890] [v2:127.0.0.1:6908/3097330890,v1:127.0.0.1:6909/3097330890] exists,up ff98625b-d5b5-4832-8391-a1de34518bc0 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 14 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=14 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/14 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:15:36.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/14' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/14/journal' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:15:36.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:15:36.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/14 2024-05-08T18:15:36.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:15:36.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=77082b5c-98c3-4241-aeb5-ee4db3cfc045 2024-05-08T18:15:36.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd14 77082b5c-98c3-4241-aeb5-ee4db3cfc045' 2024-05-08T18:15:36.828 INFO:tasks.workunit.client.0.smithi117.stdout:add osd14 77082b5c-98c3-4241-aeb5-ee4db3cfc045 2024-05-08T18:15:36.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:15:36.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBIwTtm9n8hMxAAGamy9QgbdnyHpZIO02Ob0A== 2024-05-08T18:15:36.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBIwTtm9n8hMxAAGamy9QgbdnyHpZIO02Ob0A=="}' 2024-05-08T18:15:36.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 77082b5c-98c3-4241-aeb5-ee4db3cfc045 -i td/osd-backfill-space/14/new.json 2024-05-08T18:15:37.473 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:15:37.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/14/new.json 2024-05-08T18:15:37.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 14 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/14 --osd-journal=td/osd-backfill-space/14/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBIwTtm9n8hMxAAGamy9QgbdnyHpZIO02Ob0A== --osd-uuid 77082b5c-98c3-4241-aeb5-ee4db3cfc045 2024-05-08T18:15:37.536 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:37.538+0000 7f819663e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:37.602 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:37.602+0000 7f819663e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:37.604 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:37.606+0000 7f819663e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:37.604 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:37.606+0000 7f819663e7c0 -1 bluestore(td/osd-backfill-space/14/block) _read_bdev_label failed to open td/osd-backfill-space/14/block: (2) No such file or directory 2024-05-08T18:15:37.604 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:37.606+0000 7f819663e7c0 -1 bluestore(td/osd-backfill-space/14/block) _read_bdev_label failed to open td/osd-backfill-space/14/block: (2) No such file or directory 2024-05-08T18:15:37.604 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:37.606+0000 7f819663e7c0 -1 bluestore(td/osd-backfill-space/14/block) _read_bdev_label failed to open td/osd-backfill-space/14/block: (2) No such file or directory 2024-05-08T18:15:37.649 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:37.650+0000 7f819663e7c0 -1 bluestore(td/osd-backfill-space/14) _read_fsid unparsable uuid 2024-05-08T18:15:45.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/14/keyring 2024-05-08T18:15:45.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:15:45.849 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd14 key to auth repository 2024-05-08T18:15:45.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd14 key to auth repository 2024-05-08T18:15:45.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/14/keyring auth add osd.14 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:15:46.465 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.14 2024-05-08T18:15:46.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.14 2024-05-08T18:15:46.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 14 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/14 --osd-journal=td/osd-backfill-space/14/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:15:46.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:15:46.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:15:46.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:15:46.503 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:46.506+0000 7fe883cab7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:46.539 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:46.542+0000 7fe883cab7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:46.540 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:46.542+0000 7fe883cab7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:15:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 14 2024-05-08T18:15:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:15:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=14 2024-05-08T18:15:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:15:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:15:46.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:46.923 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:15:46.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:15:46.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:46.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:47.135 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:47.138+0000 7fe883cab7c0 -1 Falling back to public interface 2024-05-08T18:15:47.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:48.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:48.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:48.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:15:48.336 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:15:48.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:48.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:48.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:49.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:49.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:49.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:15:49.756 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:15:49.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:49.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:49.870 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:15:49.874+0000 7fe883cab7c0 -1 osd.14 0 log_to_monitors true 2024-05-08T18:15:50.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:51.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:51.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:51.296 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:15:51.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:15:51.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:51.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:51.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:52.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:52.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:52.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:15:52.802 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:15:52.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:52.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:53.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:54.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:54.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:54.337 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:15:54.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:15:54.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:54.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:54.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:55.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:55.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:55.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:15:55.803 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:15:55.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:55.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:56.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:57.503 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:15:57.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:15:57.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:57.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:57.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:15:58.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:15:58.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:15:58.948 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:15:58.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:15:58.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:15:58.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:15:59.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:00.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:00.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:00.411 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:16:00.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:16:00.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:00.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:01.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:02.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:02.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:02.081 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:16:02.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:16:02.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:02.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:02.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:03.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:03.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:03.544 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:16:03.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:16:03.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:03.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:04.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:05.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:05.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:05.237 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:16:05.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:16:05.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:05.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:05.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:06.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:06.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:06.711 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:16:06.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:16:06.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:06.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:07.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:08.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:08.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:08.901 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:16:08.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:16:08.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:08.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:09.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:10.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:10.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:10.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:16:10.935 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:16:10.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:10.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:11.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:12.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:12.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:12.704 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:16:12.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:16:12.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:12.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:13.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:14.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:14.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:14.576 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:16:14.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:16:14.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:14.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:16.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:16.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:16.506 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:16:16.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:16:16.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:16.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:17.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:18.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:18.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:18.649 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:16:18.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:16:18.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:18.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:19.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:20.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:20.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:20.491 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:16:20.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:16:20.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:20.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.14 up' 2024-05-08T18:16:20.949 INFO:tasks.workunit.client.0.smithi117.stdout:osd.14 up in weight 1 up_from 74 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6914/736526520,v1:127.0.0.1:6915/736526520] [v2:127.0.0.1:6916/736526520,v1:127.0.0.1:6917/736526520] exists,up 77082b5c-98c3-4241-aeb5-ee4db3cfc045 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 15 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=15 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:16:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/15 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/15' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/15/journal' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:16:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:16:20.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:16:20.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:16:20.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/15 2024-05-08T18:16:20.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:16:20.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5363d3ef-cbdf-4f8a-a2ed-bb1ca5ae4522 2024-05-08T18:16:20.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd15 5363d3ef-cbdf-4f8a-a2ed-bb1ca5ae4522' 2024-05-08T18:16:20.956 INFO:tasks.workunit.client.0.smithi117.stdout:add osd15 5363d3ef-cbdf-4f8a-a2ed-bb1ca5ae4522 2024-05-08T18:16:20.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:16:20.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB0wTtm7FF+OhAAcie5etgEka5z613yz/yH/Q== 2024-05-08T18:16:20.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB0wTtm7FF+OhAAcie5etgEka5z613yz/yH/Q=="}' 2024-05-08T18:16:20.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5363d3ef-cbdf-4f8a-a2ed-bb1ca5ae4522 -i td/osd-backfill-space/15/new.json 2024-05-08T18:16:21.671 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:16:21.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/15/new.json 2024-05-08T18:16:21.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 15 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/15 --osd-journal=td/osd-backfill-space/15/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB0wTtm7FF+OhAAcie5etgEka5z613yz/yH/Q== --osd-uuid 5363d3ef-cbdf-4f8a-a2ed-bb1ca5ae4522 2024-05-08T18:16:21.726 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:21.725+0000 7fddeb3d97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:16:21.728 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:21.729+0000 7fddeb3d97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:16:21.729 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:21.729+0000 7fddeb3d97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:16:21.729 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:21.729+0000 7fddeb3d97c0 -1 bluestore(td/osd-backfill-space/15/block) _read_bdev_label failed to open td/osd-backfill-space/15/block: (2) No such file or directory 2024-05-08T18:16:21.730 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:21.729+0000 7fddeb3d97c0 -1 bluestore(td/osd-backfill-space/15/block) _read_bdev_label failed to open td/osd-backfill-space/15/block: (2) No such file or directory 2024-05-08T18:16:21.730 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:21.729+0000 7fddeb3d97c0 -1 bluestore(td/osd-backfill-space/15/block) _read_bdev_label failed to open td/osd-backfill-space/15/block: (2) No such file or directory 2024-05-08T18:16:22.116 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:22.117+0000 7fddeb3d97c0 -1 bluestore(td/osd-backfill-space/15) _read_fsid unparsable uuid 2024-05-08T18:16:29.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/15/keyring 2024-05-08T18:16:29.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:16:29.802 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd15 key to auth repository 2024-05-08T18:16:29.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd15 key to auth repository 2024-05-08T18:16:29.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/15/keyring auth add osd.15 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:16:30.409 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.15 2024-05-08T18:16:30.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.15 2024-05-08T18:16:30.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:16:30.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 15 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/15 --osd-journal=td/osd-backfill-space/15/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:16:30.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:16:30.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:16:30.448 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:30.449+0000 7f457d9787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:16:30.480 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:30.481+0000 7f457d9787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:16:30.481 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:30.481+0000 7f457d9787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:16:30.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 15 2024-05-08T18:16:30.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:16:30.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=15 2024-05-08T18:16:30.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:16:30.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:16:30.824 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:16:30.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:30.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:16:30.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:30.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:31.032 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:31.033+0000 7f457d9787c0 -1 Falling back to public interface 2024-05-08T18:16:31.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:32.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:32.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:32.272 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:16:32.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:16:32.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:32.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:32.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:33.647 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:16:33.649+0000 7f457d9787c0 -1 osd.15 0 log_to_monitors true 2024-05-08T18:16:33.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:33.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:33.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:16:33.692 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:16:33.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:33.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:34.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:35.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:35.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:35.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:16:35.138 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:16:35.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:35.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:35.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:36.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:36.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:36.615 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:16:36.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:16:36.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:36.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:37.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:38.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:38.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:38.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:16:38.327 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:16:38.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:38.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:38.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:39.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:39.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:39.871 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:16:39.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:16:39.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:39.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:40.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:41.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:41.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:41.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:16:41.480 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:16:41.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:41.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:42.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:43.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:43.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:43.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:16:43.106 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:16:43.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:43.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:43.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:44.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:44.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:44.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:16:44.561 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:16:44.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:44.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:45.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:46.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:46.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:46.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:16:46.077 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:16:46.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:46.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:46.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:47.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:47.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:47.583 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:16:47.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:16:47.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:47.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:48.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:49.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:49.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:49.222 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:16:49.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:16:49.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:49.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:49.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:50.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:50.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:50.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:16:50.764 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:16:50.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:50.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:51.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:52.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:52.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:52.196 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:16:52.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:16:52.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:52.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:52.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:53.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:53.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:53.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:16:53.792 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:16:53.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:53.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:55.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:56.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:56.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:56.077 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:16:56.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:16:56.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:56.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:57.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:58.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:58.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:58.022 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:16:58.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:16:58.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:58.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:16:58.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:16:59.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:16:59.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:16:59.879 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:16:59.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:16:59.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:16:59.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:17:01.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:02.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:02.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:02.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:17:02.219 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:17:02.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:02.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:17:02.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:03.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:03.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:03.659 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:17:03.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:17:03.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:03.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.15 up' 2024-05-08T18:17:04.260 INFO:tasks.workunit.client.0.smithi117.stdout:osd.15 up in weight 1 up_from 79 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6922/3969394108,v1:127.0.0.1:6923/3969394108] [v2:127.0.0.1:6924/3969394108,v1:127.0.0.1:6925/3969394108] exists,up 5363d3ef-cbdf-4f8a-a2ed-bb1ca5ae4522 2024-05-08T18:17:04.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 16 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=16 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/16 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:17:04.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/16' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/16/journal' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:17:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:17:04.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/16 2024-05-08T18:17:04.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:17:04.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9622052b-cb3b-4f3a-a34c-71785a6d5b98 2024-05-08T18:17:04.266 INFO:tasks.workunit.client.0.smithi117.stdout:add osd16 9622052b-cb3b-4f3a-a34c-71785a6d5b98 2024-05-08T18:17:04.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd16 9622052b-cb3b-4f3a-a34c-71785a6d5b98' 2024-05-08T18:17:04.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:17:04.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCgwTtm9tZRERAAO1vE4HBVDhtfFL6QmY0Qcw== 2024-05-08T18:17:04.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCgwTtm9tZRERAAO1vE4HBVDhtfFL6QmY0Qcw=="}' 2024-05-08T18:17:04.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9622052b-cb3b-4f3a-a34c-71785a6d5b98 -i td/osd-backfill-space/16/new.json 2024-05-08T18:17:05.236 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:17:05.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/16/new.json 2024-05-08T18:17:05.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 16 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/16 --osd-journal=td/osd-backfill-space/16/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCgwTtm9tZRERAAO1vE4HBVDhtfFL6QmY0Qcw== --osd-uuid 9622052b-cb3b-4f3a-a34c-71785a6d5b98 2024-05-08T18:17:05.296 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:05.296+0000 7f8686c097c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:05.299 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:05.300+0000 7f8686c097c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:05.300 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:05.300+0000 7f8686c097c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:05.300 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:05.300+0000 7f8686c097c0 -1 bluestore(td/osd-backfill-space/16/block) _read_bdev_label failed to open td/osd-backfill-space/16/block: (2) No such file or directory 2024-05-08T18:17:05.300 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:05.300+0000 7f8686c097c0 -1 bluestore(td/osd-backfill-space/16/block) _read_bdev_label failed to open td/osd-backfill-space/16/block: (2) No such file or directory 2024-05-08T18:17:05.300 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:05.300+0000 7f8686c097c0 -1 bluestore(td/osd-backfill-space/16/block) _read_bdev_label failed to open td/osd-backfill-space/16/block: (2) No such file or directory 2024-05-08T18:17:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:05.416+0000 7f8686c097c0 -1 bluestore(td/osd-backfill-space/16) _read_fsid unparsable uuid 2024-05-08T18:17:13.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/16/keyring 2024-05-08T18:17:13.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:17:13.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd16 key to auth repository 2024-05-08T18:17:13.487 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd16 key to auth repository 2024-05-08T18:17:13.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/16/keyring auth add osd.16 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:17:14.050 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.16 2024-05-08T18:17:14.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.16 2024-05-08T18:17:14.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 16 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/16 --osd-journal=td/osd-backfill-space/16/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:17:14.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:17:14.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:17:14.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:17:14.090 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:14.092+0000 7fe949f837c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:14.117 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:14.116+0000 7fe949f837c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:14.118 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:14.120+0000 7fe949f837c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:14.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 16 2024-05-08T18:17:14.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:17:14.521 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:17:14.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=16 2024-05-08T18:17:14.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:17:14.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:17:14.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:14.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:17:14.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:14.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:14.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:14.700+0000 7fe949f837c0 -1 Falling back to public interface 2024-05-08T18:17:14.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:15.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:15.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:15.926 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:17:15.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:17:15.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:15.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:16.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:17.308 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:17.308+0000 7fe949f837c0 -1 osd.16 0 log_to_monitors true 2024-05-08T18:17:17.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:17.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:17.353 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:17:17.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:17:17.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:17.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:18.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:19.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:19.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:19.190 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:17:19.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:17:19.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:19.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:19.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:20.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:20.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:20.719 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:17:20.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:17:20.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:20.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:21.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:22.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:22.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:22.342 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:17:22.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:17:22.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:22.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:22.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:23.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:23.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:23.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:17:23.944 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:17:23.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:23.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:24.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:25.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:25.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:25.502 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:17:25.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:17:25.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:25.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:25.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:26.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:26.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:26.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:17:26.995 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:17:26.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:26.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:27.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:28.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:28.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:28.519 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:17:28.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:17:28.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:28.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:29.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:30.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:30.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:30.044 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:17:30.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:17:30.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:30.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:30.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:31.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:31.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:31.734 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:17:31.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:17:31.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:31.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:32.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:33.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:33.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:33.364 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:17:33.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:17:33.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:33.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:34.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:35.226 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:17:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:17:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:35.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:36.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:36.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:36.812 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:17:36.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:17:36.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:36.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:37.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:38.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:38.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:38.638 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:17:38.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:17:38.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:38.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:39.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:40.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:40.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:40.559 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:17:40.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:17:40.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:40.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:41.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:42.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:42.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:42.448 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:17:42.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:17:42.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:42.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:42.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:43.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:43.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:43.992 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:17:43.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:17:43.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:43.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:44.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:45.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:45.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:45.852 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:17:45.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:17:45.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:45.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:46.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:47.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:47.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:47.366 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:17:47.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:17:47.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:47.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.16 up' 2024-05-08T18:17:47.831 INFO:tasks.workunit.client.0.smithi117.stdout:osd.16 up in weight 1 up_from 84 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6930/1297962792,v1:127.0.0.1:6931/1297962792] [v2:127.0.0.1:6932/1297962792,v1:127.0.0.1:6933/1297962792] exists,up 9622052b-cb3b-4f3a-a34c-71785a6d5b98 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 17 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=17 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/17 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:17:47.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/17' 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/17/journal' 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:17:47.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:17:47.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/17 2024-05-08T18:17:47.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:17:47.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=d5e27316-6662-4802-9a58-987cf181e5af 2024-05-08T18:17:47.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd17 d5e27316-6662-4802-9a58-987cf181e5af' 2024-05-08T18:17:47.838 INFO:tasks.workunit.client.0.smithi117.stdout:add osd17 d5e27316-6662-4802-9a58-987cf181e5af 2024-05-08T18:17:47.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:17:47.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDLwTtmQ5JQMxAACcBcF9DwE8xTgKsUkh9uVA== 2024-05-08T18:17:47.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDLwTtmQ5JQMxAACcBcF9DwE8xTgKsUkh9uVA=="}' 2024-05-08T18:17:47.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new d5e27316-6662-4802-9a58-987cf181e5af -i td/osd-backfill-space/17/new.json 2024-05-08T18:17:48.754 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:17:48.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/17/new.json 2024-05-08T18:17:48.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 17 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/17 --osd-journal=td/osd-backfill-space/17/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDLwTtmQ5JQMxAACcBcF9DwE8xTgKsUkh9uVA== --osd-uuid d5e27316-6662-4802-9a58-987cf181e5af 2024-05-08T18:17:48.807 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:48.808+0000 7f4d795bb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:48.894 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:48.892+0000 7f4d795bb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:48.895 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:48.896+0000 7f4d795bb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:48.896 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:48.896+0000 7f4d795bb7c0 -1 bluestore(td/osd-backfill-space/17/block) _read_bdev_label failed to open td/osd-backfill-space/17/block: (2) No such file or directory 2024-05-08T18:17:48.896 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:48.896+0000 7f4d795bb7c0 -1 bluestore(td/osd-backfill-space/17/block) _read_bdev_label failed to open td/osd-backfill-space/17/block: (2) No such file or directory 2024-05-08T18:17:48.896 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:48.896+0000 7f4d795bb7c0 -1 bluestore(td/osd-backfill-space/17/block) _read_bdev_label failed to open td/osd-backfill-space/17/block: (2) No such file or directory 2024-05-08T18:17:48.939 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:48.940+0000 7f4d795bb7c0 -1 bluestore(td/osd-backfill-space/17) _read_fsid unparsable uuid 2024-05-08T18:17:57.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/17/keyring 2024-05-08T18:17:57.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:17:57.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd17 key to auth repository 2024-05-08T18:17:57.129 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd17 key to auth repository 2024-05-08T18:17:57.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/17/keyring auth add osd.17 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:17:57.709 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.17 2024-05-08T18:17:57.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.17 2024-05-08T18:17:57.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:17:57.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:17:57.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 17 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/17 --osd-journal=td/osd-backfill-space/17/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:17:57.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:17:57.747 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:57.747+0000 7f67210787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:57.783 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:57.783+0000 7f67210787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:57.784 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:57.783+0000 7f67210787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:17:58.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 17 2024-05-08T18:17:58.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:17:58.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=17 2024-05-08T18:17:58.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:17:58.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:17:58.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:58.152 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:17:58.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:17:58.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:58.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:17:58.352 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:17:58.351+0000 7f67210787c0 -1 Falling back to public interface 2024-05-08T18:17:58.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:17:59.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:17:59.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:17:59.622 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:17:59.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:17:59.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:17:59.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:00.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:00.604 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:00.603+0000 7f67210787c0 -1 osd.17 0 log_to_monitors true 2024-05-08T18:18:01.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:01.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:01.081 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:18:01.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:18:01.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:01.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:01.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:02.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:02.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:02.881 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:18:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:18:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:03.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:04.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:04.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:04.355 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:18:04.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:18:04.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:04.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:04.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:05.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:05.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:05.924 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:18:05.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:18:05.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:05.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:06.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:07.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:07.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:07.504 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:18:07.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:18:07.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:07.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:07.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:08.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:08.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:08.990 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:18:08.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:18:08.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:08.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:09.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:10.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:10.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:10.428 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:18:10.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:18:10.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:10.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:10.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:11.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:11.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:11.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:18:11.960 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:18:11.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:11.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:12.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:13.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:13.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:13.522 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:18:13.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:18:13.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:13.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:13.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:14.998 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:18:14.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:14.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:14.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:18:14.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:14.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:15.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:16.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:16.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:16.437 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:18:16.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:18:16.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:16.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:16.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:17.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:17.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:17.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:18:17.974 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:18:17.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:17.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:18.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:19.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:19.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:19.931 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:18:19.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:18:19.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:19.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:21.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:22.087 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:18:22.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:18:22.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:22.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:23.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:24.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:24.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:24.358 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:18:24.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:18:24.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:24.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:25.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:26.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:26.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:26.032 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:18:26.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:18:26.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:26.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:26.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:27.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:27.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:27.754 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:18:27.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:18:27.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:27.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:28.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:29.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:29.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:29.326 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:18:29.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:18:29.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:29.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:29.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:30.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:30.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:30.759 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:18:30.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:18:30.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:30.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.17 up' 2024-05-08T18:18:31.218 INFO:tasks.workunit.client.0.smithi117.stdout:osd.17 up in weight 1 up_from 89 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6938/1884924961,v1:127.0.0.1:6939/1884924961] [v2:127.0.0.1:6940/1884924961,v1:127.0.0.1:6941/1884924961] exists,up d5e27316-6662-4802-9a58-987cf181e5af 2024-05-08T18:18:31.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 18 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=18 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/18 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:18:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/18' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/18/journal' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:18:31.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:18:31.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/18 2024-05-08T18:18:31.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:18:31.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2101c811-b1d1-440f-aea0-bf0778663814 2024-05-08T18:18:31.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd18 2101c811-b1d1-440f-aea0-bf0778663814' 2024-05-08T18:18:31.225 INFO:tasks.workunit.client.0.smithi117.stdout:add osd18 2101c811-b1d1-440f-aea0-bf0778663814 2024-05-08T18:18:31.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:18:31.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD3wTtmR38pDxAAYj2Eh/Dn9WnW5P1QFe6aKw== 2024-05-08T18:18:31.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD3wTtmR38pDxAAYj2Eh/Dn9WnW5P1QFe6aKw=="}' 2024-05-08T18:18:31.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2101c811-b1d1-440f-aea0-bf0778663814 -i td/osd-backfill-space/18/new.json 2024-05-08T18:18:32.102 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:18:32.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/18/new.json 2024-05-08T18:18:32.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 18 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/18 --osd-journal=td/osd-backfill-space/18/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD3wTtmR38pDxAAYj2Eh/Dn9WnW5P1QFe6aKw== --osd-uuid 2101c811-b1d1-440f-aea0-bf0778663814 2024-05-08T18:18:32.157 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:32.155+0000 7f95aae067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:18:32.266 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:32.267+0000 7f95aae067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:18:32.268 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:32.267+0000 7f95aae067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:18:32.269 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:32.267+0000 7f95aae067c0 -1 bluestore(td/osd-backfill-space/18/block) _read_bdev_label failed to open td/osd-backfill-space/18/block: (2) No such file or directory 2024-05-08T18:18:32.269 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:32.267+0000 7f95aae067c0 -1 bluestore(td/osd-backfill-space/18/block) _read_bdev_label failed to open td/osd-backfill-space/18/block: (2) No such file or directory 2024-05-08T18:18:32.269 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:32.267+0000 7f95aae067c0 -1 bluestore(td/osd-backfill-space/18/block) _read_bdev_label failed to open td/osd-backfill-space/18/block: (2) No such file or directory 2024-05-08T18:18:32.446 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:32.443+0000 7f95aae067c0 -1 bluestore(td/osd-backfill-space/18) _read_fsid unparsable uuid 2024-05-08T18:18:40.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/18/keyring 2024-05-08T18:18:40.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:18:40.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd18 key to auth repository 2024-05-08T18:18:40.505 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd18 key to auth repository 2024-05-08T18:18:40.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/18/keyring auth add osd.18 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:18:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.18 2024-05-08T18:18:41.085 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.18 2024-05-08T18:18:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:18:41.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:18:41.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:18:41.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 18 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/18 --osd-journal=td/osd-backfill-space/18/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:18:41.123 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:41.123+0000 7f5d98bd87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:18:41.200 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:41.199+0000 7f5d98bd87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:18:41.202 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:41.199+0000 7f5d98bd87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:18:41.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 18 2024-05-08T18:18:41.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:18:41.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=18 2024-05-08T18:18:41.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:18:41.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:18:41.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:41.510 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:18:41.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:18:41.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:41.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:41.793 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:41.791+0000 7f5d98bd87c0 -1 Falling back to public interface 2024-05-08T18:18:42.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:43.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:43.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:43.014 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:18:43.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:18:43.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:43.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:43.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:44.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:44.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:44.452 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:18:44.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:18:44.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:44.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:44.617 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:18:44.615+0000 7f5d98bd87c0 -1 osd.18 0 log_to_monitors true 2024-05-08T18:18:45.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:46.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:46.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:46.052 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:18:46.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:18:46.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:46.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:46.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:47.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:47.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:47.921 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:18:47.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:18:47.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:47.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:48.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:49.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:49.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:49.607 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:18:49.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:18:49.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:49.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:50.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:51.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:51.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:51.224 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:18:51.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:18:51.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:51.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:51.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:52.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:52.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:52.925 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:18:52.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:18:52.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:52.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:53.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:54.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:54.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:54.405 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:18:54.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:18:54.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:54.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:54.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:55.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:55.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:55.917 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:18:55.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:18:55.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:55.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:56.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:57.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:57.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:57.509 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:18:57.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:18:57.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:57.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:58.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:18:59.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:18:59.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:18:59.010 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:18:59.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:18:59.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:18:59.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:18:59.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:00.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:00.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:00.545 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:19:00.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:19:00.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:00.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:01.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:02.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:02.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:02.037 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:19:02.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:19:02.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:02.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:02.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:03.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:03.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:03.779 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:19:03.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:19:03.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:03.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:04.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:05.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:05.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:05.883 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:19:05.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:19:05.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:05.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:06.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:07.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:07.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:07.508 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:19:07.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:19:07.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:07.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:08.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:09.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:09.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:09.435 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:19:09.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:19:09.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:09.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:10.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:11.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:11.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:11.039 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:19:11.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:19:11.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:11.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:11.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:12.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:12.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:12.612 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:19:12.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:19:12.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:12.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:13.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:14.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:14.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:14.441 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T18:19:14.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T18:19:14.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:14.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:14.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:15.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:15.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:15.920 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T18:19:15.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T18:19:15.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:15.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.18 up' 2024-05-08T18:19:16.507 INFO:tasks.workunit.client.0.smithi117.stdout:osd.18 up in weight 1 up_from 94 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6946/422580419,v1:127.0.0.1:6947/422580419] [v2:127.0.0.1:6948/422580419,v1:127.0.0.1:6949/422580419] exists,up 2101c811-b1d1-440f-aea0-bf0778663814 2024-05-08T18:19:16.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:19:16.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:19:16.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:19:16.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 19 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=19 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/19 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/19' 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/19/journal' 2024-05-08T18:19:16.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:19:16.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:19:16.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:19:16.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/19 2024-05-08T18:19:16.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:19:16.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=eb6c7da5-729b-4a3e-bb25-dc2e55b95c21 2024-05-08T18:19:16.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd19 eb6c7da5-729b-4a3e-bb25-dc2e55b95c21' 2024-05-08T18:19:16.514 INFO:tasks.workunit.client.0.smithi117.stdout:add osd19 eb6c7da5-729b-4a3e-bb25-dc2e55b95c21 2024-05-08T18:19:16.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:19:16.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAkwjtmvowGIBAA0YzArOSYoAYSzeJd4r2ZWQ== 2024-05-08T18:19:16.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAkwjtmvowGIBAA0YzArOSYoAYSzeJd4r2ZWQ=="}' 2024-05-08T18:19:16.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new eb6c7da5-729b-4a3e-bb25-dc2e55b95c21 -i td/osd-backfill-space/19/new.json 2024-05-08T18:19:17.154 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:19:17.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/19/new.json 2024-05-08T18:19:17.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 19 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/19 --osd-journal=td/osd-backfill-space/19/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAkwjtmvowGIBAA0YzArOSYoAYSzeJd4r2ZWQ== --osd-uuid eb6c7da5-729b-4a3e-bb25-dc2e55b95c21 2024-05-08T18:19:17.208 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:17.210+0000 7faf32e677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:19:17.385 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:17.386+0000 7faf32e677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:19:17.387 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:17.390+0000 7faf32e677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:19:17.387 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:17.390+0000 7faf32e677c0 -1 bluestore(td/osd-backfill-space/19/block) _read_bdev_label failed to open td/osd-backfill-space/19/block: (2) No such file or directory 2024-05-08T18:19:17.387 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:17.390+0000 7faf32e677c0 -1 bluestore(td/osd-backfill-space/19/block) _read_bdev_label failed to open td/osd-backfill-space/19/block: (2) No such file or directory 2024-05-08T18:19:17.387 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:17.390+0000 7faf32e677c0 -1 bluestore(td/osd-backfill-space/19/block) _read_bdev_label failed to open td/osd-backfill-space/19/block: (2) No such file or directory 2024-05-08T18:19:17.505 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:17.506+0000 7faf32e677c0 -1 bluestore(td/osd-backfill-space/19) _read_fsid unparsable uuid 2024-05-08T18:19:25.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/19/keyring 2024-05-08T18:19:25.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:19:25.392 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd19 key to auth repository 2024-05-08T18:19:25.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd19 key to auth repository 2024-05-08T18:19:25.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/19/keyring auth add osd.19 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:19:25.951 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.19 2024-05-08T18:19:25.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.19 2024-05-08T18:19:25.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 19 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/19 --osd-journal=td/osd-backfill-space/19/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:19:25.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:19:25.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:19:25.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:19:25.989 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:25.990+0000 7fa17caa67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:19:25.991 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:25.994+0000 7fa17caa67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:19:25.993 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:25.994+0000 7fa17caa67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:19:26.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 19 2024-05-08T18:19:26.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:19:26.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=19 2024-05-08T18:19:26.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:19:26.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:19:26.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:26.463 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:19:26.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:19:26.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:26.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:26.552 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:26.554+0000 7fa17caa67c0 -1 Falling back to public interface 2024-05-08T18:19:26.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:27.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:27.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:27.881 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:19:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:19:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:28.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:29.203 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:19:29.206+0000 7fa17caa67c0 -1 osd.19 0 log_to_monitors true 2024-05-08T18:19:29.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:29.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:29.330 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:19:29.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:19:29.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:29.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:29.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:30.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:30.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:30.899 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:19:30.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:19:30.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:30.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:31.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:32.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:32.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:32.564 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:19:32.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:19:32.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:32.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:33.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:34.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:34.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:34.393 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:19:34.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:19:34.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:34.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:34.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:35.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:35.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:35.906 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:19:35.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:19:35.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:35.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:36.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:37.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:37.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:37.591 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:19:37.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:19:37.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:37.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:38.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:39.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:39.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:39.304 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:19:39.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:19:39.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:39.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:39.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:40.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:40.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:40.742 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:19:40.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:19:40.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:40.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:41.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:42.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:42.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:42.326 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:19:42.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:19:42.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:42.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:42.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:43.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:43.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:43.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:19:43.884 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:19:43.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:43.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:44.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:45.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:45.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:45.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:19:45.325 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:19:45.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:45.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:46.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:47.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:47.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:47.004 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:19:47.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:19:47.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:47.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:47.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:48.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:48.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:48.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:19:48.916 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:19:48.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:48.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:49.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:50.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:50.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:50.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:19:50.650 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:19:50.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:50.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:51.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:52.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:52.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:52.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:19:52.754 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:19:52.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:52.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:53.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:54.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:54.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:54.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:19:54.642 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:19:54.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:54.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:55.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:56.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:56.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:56.890 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T18:19:56.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T18:19:56.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:56.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:57.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:19:58.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:19:58.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:19:58.331 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T18:19:58.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T18:19:58.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:19:58.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.19 up' 2024-05-08T18:19:58.850 INFO:tasks.workunit.client.0.smithi117.stdout:osd.19 up in weight 1 up_from 99 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6954/4005066653,v1:127.0.0.1:6955/4005066653] [v2:127.0.0.1:6956/4005066653,v1:127.0.0.1:6957/4005066653] exists,up eb6c7da5-729b-4a3e-bb25-dc2e55b95c21 2024-05-08T18:19:58.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:19:58.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:19:58.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:19:58.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:205: TEST_backfill_test_multi: ceph osd set-backfillfull-ratio .85 2024-05-08T18:19:59.668 INFO:tasks.workunit.client.0.smithi117.stderr:osd set-backfillfull-ratio 0.85 2024-05-08T18:19:59.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:19:59.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:19:59.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test1 1 1 2024-05-08T18:19:59.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test1 1 1 2024-05-08T18:20:00.828 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' already exists 2024-05-08T18:20:00.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:20:01.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2024-05-08T18:20:03.121 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T18:20:03.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:03.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test2 1 1 2024-05-08T18:20:03.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test2 1 1 2024-05-08T18:20:04.153 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' already exists 2024-05-08T18:20:04.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:20:05.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2024-05-08T18:20:06.519 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 1 2024-05-08T18:20:06.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:06.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test3 1 1 2024-05-08T18:20:06.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test3 1 1 2024-05-08T18:20:09.185 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test3' already exists 2024-05-08T18:20:09.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:20:10.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test3 size 1 --yes-i-really-mean-it 2024-05-08T18:20:12.113 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 3 size to 1 2024-05-08T18:20:12.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:12.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test4 1 1 2024-05-08T18:20:12.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test4 1 1 2024-05-08T18:20:13.053 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test4' already exists 2024-05-08T18:20:13.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:20:14.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test4 size 1 --yes-i-really-mean-it 2024-05-08T18:20:15.319 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 4 size to 1 2024-05-08T18:20:15.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:15.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test5 1 1 2024-05-08T18:20:15.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test5 1 1 2024-05-08T18:20:16.638 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test5' already exists 2024-05-08T18:20:16.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:20:17.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test5 size 1 --yes-i-really-mean-it 2024-05-08T18:20:20.020 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 5 size to 1 2024-05-08T18:20:20.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:20.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test6 1 1 2024-05-08T18:20:20.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test6 1 1 2024-05-08T18:20:21.957 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test6' already exists 2024-05-08T18:20:21.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:20:22.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test6 size 1 --yes-i-really-mean-it 2024-05-08T18:20:23.969 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 6 size to 1 2024-05-08T18:20:23.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:23.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test7 1 1 2024-05-08T18:20:23.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test7 1 1 2024-05-08T18:20:26.105 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test7' already exists 2024-05-08T18:20:26.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:20:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test7 size 1 --yes-i-really-mean-it 2024-05-08T18:20:28.361 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 7 size to 1 2024-05-08T18:20:28.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:28.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test8 1 1 2024-05-08T18:20:28.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test8 1 1 2024-05-08T18:20:30.886 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test8' already exists 2024-05-08T18:20:30.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:20:31.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test8 size 1 --yes-i-really-mean-it 2024-05-08T18:20:33.311 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 8 size to 1 2024-05-08T18:20:33.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:213: TEST_backfill_test_multi: wait_for_clean 2024-05-08T18:20:33.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T18:20:33.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T18:20:33.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T18:20:33.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T18:20:33.333 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:20:33.333 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:20:33.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:20:33.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:20:33.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:20:33.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T18:20:33.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T18:20:33.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T18:20:33.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T18:20:33.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:20:33.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:5 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:6 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:7 2024-05-08T18:20:33.902 INFO:tasks.workunit.client.0.smithi117.stderr:8 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:9 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:10 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:11 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:12 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:13 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:14 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:15 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:16 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:17 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:18 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:19' 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:20:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:33.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:20:34.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836654 2024-05-08T18:20:34.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836654 2024-05-08T18:20:34.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654' 2024-05-08T18:20:34.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:34.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:20:34.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673127 2024-05-08T18:20:34.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673127 2024-05-08T18:20:34.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127' 2024-05-08T18:20:34.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:34.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:20:34.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509600 2024-05-08T18:20:34.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509600 2024-05-08T18:20:34.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600' 2024-05-08T18:20:34.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:34.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:20:34.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899346069 2024-05-08T18:20:34.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899346069 2024-05-08T18:20:34.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069' 2024-05-08T18:20:34.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:34.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:20:35.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182543 2024-05-08T18:20:35.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182543 2024-05-08T18:20:35.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543' 2024-05-08T18:20:35.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:35.245 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T18:20:35.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849019016 2024-05-08T18:20:35.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849019016 2024-05-08T18:20:35.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016' 2024-05-08T18:20:35.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:35.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2024-05-08T18:20:35.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=150323855485 2024-05-08T18:20:35.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 150323855485 2024-05-08T18:20:35.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485' 2024-05-08T18:20:35.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:35.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2024-05-08T18:20:35.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=171798691963 2024-05-08T18:20:35.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 171798691963 2024-05-08T18:20:35.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963' 2024-05-08T18:20:35.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:35.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2024-05-08T18:20:35.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=193273528431 2024-05-08T18:20:35.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 193273528431 2024-05-08T18:20:35.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431' 2024-05-08T18:20:35.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:35.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2024-05-08T18:20:36.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=214748364906 2024-05-08T18:20:36.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 214748364906 2024-05-08T18:20:36.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906' 2024-05-08T18:20:36.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:36.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2024-05-08T18:20:36.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=231928234083 2024-05-08T18:20:36.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 231928234083 2024-05-08T18:20:36.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083' 2024-05-08T18:20:36.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:36.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2024-05-08T18:20:36.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=253403070552 2024-05-08T18:20:36.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 253403070552 2024-05-08T18:20:36.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552' 2024-05-08T18:20:36.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:36.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2024-05-08T18:20:36.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=274877907021 2024-05-08T18:20:36.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 274877907021 2024-05-08T18:20:36.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552 12-274877907021' 2024-05-08T18:20:36.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:36.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2024-05-08T18:20:36.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=296352743491 2024-05-08T18:20:36.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 296352743491 2024-05-08T18:20:36.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552 12-274877907021 13-296352743491' 2024-05-08T18:20:36.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:36.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2024-05-08T18:20:36.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=317827579963 2024-05-08T18:20:36.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 317827579963 2024-05-08T18:20:36.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552 12-274877907021 13-296352743491 14-317827579963' 2024-05-08T18:20:36.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:36.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2024-05-08T18:20:37.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=339302416436 2024-05-08T18:20:37.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 339302416436 2024-05-08T18:20:37.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552 12-274877907021 13-296352743491 14-317827579963 15-339302416436' 2024-05-08T18:20:37.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:37.134 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2024-05-08T18:20:37.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=360777252905 2024-05-08T18:20:37.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 360777252905 2024-05-08T18:20:37.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552 12-274877907021 13-296352743491 14-317827579963 15-339302416436 16-360777252905' 2024-05-08T18:20:37.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:37.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2024-05-08T18:20:37.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=382252089380 2024-05-08T18:20:37.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 382252089380 2024-05-08T18:20:37.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552 12-274877907021 13-296352743491 14-317827579963 15-339302416436 16-360777252905 17-382252089380' 2024-05-08T18:20:37.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:37.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2024-05-08T18:20:37.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=403726925849 2024-05-08T18:20:37.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 403726925849 2024-05-08T18:20:37.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552 12-274877907021 13-296352743491 14-317827579963 15-339302416436 16-360777252905 17-382252089380 18-403726925849' 2024-05-08T18:20:37.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:20:37.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2024-05-08T18:20:37.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=425201762318 2024-05-08T18:20:37.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 425201762318 2024-05-08T18:20:37.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836654 1-42949673127 2-64424509600 3-85899346069 4-107374182543 5-128849019016 6-150323855485 7-171798691963 8-193273528431 9-214748364906 10-231928234083 11-253403070552 12-274877907021 13-296352743491 14-317827579963 15-339302416436 16-360777252905 17-382252089380 18-403726925849 19-425201762318' 2024-05-08T18:20:37.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:37.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836654 2024-05-08T18:20:37.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:37.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:20:37.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836654 2024-05-08T18:20:37.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:37.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836654 2024-05-08T18:20:37.807 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836654 2024-05-08T18:20:37.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836654' 2024-05-08T18:20:37.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:20:38.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836655 -lt 21474836654 2024-05-08T18:20:38.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:38.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673127 2024-05-08T18:20:38.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:38.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:20:38.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673127 2024-05-08T18:20:38.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:38.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673127 2024-05-08T18:20:38.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673127' 2024-05-08T18:20:38.238 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673127 2024-05-08T18:20:38.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:20:38.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673128 -lt 42949673127 2024-05-08T18:20:38.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:38.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509600 2024-05-08T18:20:38.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:38.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:20:38.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509600 2024-05-08T18:20:38.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:38.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509600 2024-05-08T18:20:38.677 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509600 2024-05-08T18:20:38.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509600' 2024-05-08T18:20:38.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:20:39.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509601 -lt 64424509600 2024-05-08T18:20:39.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:39.085 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899346069 2024-05-08T18:20:39.086 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:39.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:20:39.088 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899346069 2024-05-08T18:20:39.088 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:39.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899346069 2024-05-08T18:20:39.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899346069' 2024-05-08T18:20:39.090 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899346069 2024-05-08T18:20:39.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:20:39.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899346069 -lt 85899346069 2024-05-08T18:20:39.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:39.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:39.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182543 2024-05-08T18:20:39.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:20:39.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182543 2024-05-08T18:20:39.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:39.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182543 2024-05-08T18:20:39.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182543' 2024-05-08T18:20:39.534 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182543 2024-05-08T18:20:39.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:20:40.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182544 -lt 107374182543 2024-05-08T18:20:40.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:40.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849019016 2024-05-08T18:20:40.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:40.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T18:20:40.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849019016 2024-05-08T18:20:40.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:40.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849019016 2024-05-08T18:20:40.370 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849019016 2024-05-08T18:20:40.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849019016' 2024-05-08T18:20:40.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T18:20:40.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849019017 -lt 128849019016 2024-05-08T18:20:40.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:40.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 6-150323855485 2024-05-08T18:20:40.816 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:40.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=6 2024-05-08T18:20:40.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 6-150323855485 2024-05-08T18:20:40.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:40.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=150323855485 2024-05-08T18:20:40.820 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.6 seq 150323855485 2024-05-08T18:20:40.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.6 seq 150323855485' 2024-05-08T18:20:40.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 6 2024-05-08T18:20:41.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 150323855486 -lt 150323855485 2024-05-08T18:20:41.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:41.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 7-171798691963 2024-05-08T18:20:41.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:41.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=7 2024-05-08T18:20:41.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 7-171798691963 2024-05-08T18:20:41.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:41.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=171798691963 2024-05-08T18:20:41.258 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.7 seq 171798691963 2024-05-08T18:20:41.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.7 seq 171798691963' 2024-05-08T18:20:41.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 7 2024-05-08T18:20:41.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 171798691964 -lt 171798691963 2024-05-08T18:20:41.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:41.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 8-193273528431 2024-05-08T18:20:41.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:41.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=8 2024-05-08T18:20:41.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 8-193273528431 2024-05-08T18:20:41.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:41.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=193273528431 2024-05-08T18:20:41.681 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.8 seq 193273528431 2024-05-08T18:20:41.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.8 seq 193273528431' 2024-05-08T18:20:41.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 8 2024-05-08T18:20:42.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 193273528432 -lt 193273528431 2024-05-08T18:20:42.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:42.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 9-214748364906 2024-05-08T18:20:42.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:42.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=9 2024-05-08T18:20:42.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 9-214748364906 2024-05-08T18:20:42.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=214748364906 2024-05-08T18:20:42.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.9 seq 214748364906' 2024-05-08T18:20:42.120 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.9 seq 214748364906 2024-05-08T18:20:42.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 9 2024-05-08T18:20:42.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 214748364907 -lt 214748364906 2024-05-08T18:20:42.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:42.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 10-231928234083 2024-05-08T18:20:42.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:42.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=10 2024-05-08T18:20:42.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 10-231928234083 2024-05-08T18:20:42.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:42.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=231928234083 2024-05-08T18:20:42.586 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.10 seq 231928234083 2024-05-08T18:20:42.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.10 seq 231928234083' 2024-05-08T18:20:42.586 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 10 2024-05-08T18:20:43.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 231928234084 -lt 231928234083 2024-05-08T18:20:43.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:43.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:43.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 11-253403070552 2024-05-08T18:20:43.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=11 2024-05-08T18:20:43.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:43.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 11-253403070552 2024-05-08T18:20:43.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=253403070552 2024-05-08T18:20:43.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.11 seq 253403070552' 2024-05-08T18:20:43.017 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.11 seq 253403070552 2024-05-08T18:20:43.017 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 11 2024-05-08T18:20:43.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 253403070553 -lt 253403070552 2024-05-08T18:20:43.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:43.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 12-274877907021 2024-05-08T18:20:43.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:43.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=12 2024-05-08T18:20:43.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:43.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 12-274877907021 2024-05-08T18:20:43.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=274877907021 2024-05-08T18:20:43.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.12 seq 274877907021' 2024-05-08T18:20:43.453 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.12 seq 274877907021 2024-05-08T18:20:43.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 12 2024-05-08T18:20:43.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 274877907022 -lt 274877907021 2024-05-08T18:20:43.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:43.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:43.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 13-296352743491 2024-05-08T18:20:43.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=13 2024-05-08T18:20:43.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 13-296352743491 2024-05-08T18:20:43.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:43.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=296352743491 2024-05-08T18:20:43.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.13 seq 296352743491' 2024-05-08T18:20:43.905 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.13 seq 296352743491 2024-05-08T18:20:43.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 13 2024-05-08T18:20:44.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 296352743492 -lt 296352743491 2024-05-08T18:20:44.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:44.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 14-317827579963 2024-05-08T18:20:44.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:44.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=14 2024-05-08T18:20:44.324 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:44.324 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 14-317827579963 2024-05-08T18:20:44.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=317827579963 2024-05-08T18:20:44.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.14 seq 317827579963' 2024-05-08T18:20:44.326 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.14 seq 317827579963 2024-05-08T18:20:44.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 14 2024-05-08T18:20:44.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 317827579964 -lt 317827579963 2024-05-08T18:20:44.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:44.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 15-339302416436 2024-05-08T18:20:44.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:44.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=15 2024-05-08T18:20:44.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 15-339302416436 2024-05-08T18:20:44.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:44.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=339302416436 2024-05-08T18:20:44.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.15 seq 339302416436' 2024-05-08T18:20:44.754 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.15 seq 339302416436 2024-05-08T18:20:44.754 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 15 2024-05-08T18:20:45.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 339302416438 -lt 339302416436 2024-05-08T18:20:45.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:45.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 16-360777252905 2024-05-08T18:20:45.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:45.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=16 2024-05-08T18:20:45.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 16-360777252905 2024-05-08T18:20:45.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:45.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=360777252905 2024-05-08T18:20:45.195 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.16 seq 360777252905 2024-05-08T18:20:45.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.16 seq 360777252905' 2024-05-08T18:20:45.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 16 2024-05-08T18:20:45.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 360777252906 -lt 360777252905 2024-05-08T18:20:45.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:45.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 17-382252089380 2024-05-08T18:20:45.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:45.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=17 2024-05-08T18:20:45.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 17-382252089380 2024-05-08T18:20:45.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:45.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=382252089380 2024-05-08T18:20:45.621 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.17 seq 382252089380 2024-05-08T18:20:45.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.17 seq 382252089380' 2024-05-08T18:20:45.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 17 2024-05-08T18:20:46.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 382252089381 -lt 382252089380 2024-05-08T18:20:46.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:46.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 18-403726925849 2024-05-08T18:20:46.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:46.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=18 2024-05-08T18:20:46.036 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 18-403726925849 2024-05-08T18:20:46.036 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:46.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=403726925849 2024-05-08T18:20:46.038 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.18 seq 403726925849 2024-05-08T18:20:46.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.18 seq 403726925849' 2024-05-08T18:20:46.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 18 2024-05-08T18:20:46.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 403726925850 -lt 403726925849 2024-05-08T18:20:46.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:20:46.463 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 19-425201762318 2024-05-08T18:20:46.463 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:20:46.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=19 2024-05-08T18:20:46.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 19-425201762318 2024-05-08T18:20:46.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:20:46.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=425201762318 2024-05-08T18:20:46.467 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.19 seq 425201762318 2024-05-08T18:20:46.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.19 seq 425201762318' 2024-05-08T18:20:46.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 19 2024-05-08T18:20:46.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 425201762320 -lt 425201762318 2024-05-08T18:20:46.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T18:20:46.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:20:46.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:20:47.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 == 0 2024-05-08T18:20:47.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:20:47.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:20:47.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:20:47.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:20:47.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:20:47.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:20:47.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:20:47.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=8 2024-05-08T18:20:47.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:20:47.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:20:47.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:20:48.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 8 = 8 2024-05-08T18:20:48.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T18:20:48.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T18:20:48.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:215: TEST_backfill_test_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2024-05-08T18:20:48.440 INFO:tasks.workunit.client.0.smithi117.stderr:4+0 records in 2024-05-08T18:20:48.440 INFO:tasks.workunit.client.0.smithi117.stderr:4+0 records out 2024-05-08T18:20:48.441 INFO:tasks.workunit.client.0.smithi117.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000133309 s, 30.7 MB/s 2024-05-08T18:20:48.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: seq 1 600 2024-05-08T18:20:48.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:48.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:48.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:48.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:20:48.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:48.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:20:48.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:48.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:20:48.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:48.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:20:48.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:48.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:20:49.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:20:49.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:20:49.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:20:49.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:49.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:49.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:20:49.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:20:49.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:20:49.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:20:49.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:20:49.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:49.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:20:50.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:50.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:20:50.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:50.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:20:50.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:50.397 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:50.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:50.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:20:50.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:50.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:20:50.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:50.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:20:50.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:50.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:20:50.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:50.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:20:50.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:50.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:20:51.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:51.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:20:51.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:51.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:20:51.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:51.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:51.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:51.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:20:51.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:51.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:20:51.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:51.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:20:51.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:51.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:20:51.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:51.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:20:51.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:51.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:20:52.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:20:52.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:20:52.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:52.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:52.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:20:52.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:20:52.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:20:52.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:20:52.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:20:52.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:20:52.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:52.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:20:53.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:20:53.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:53.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:53.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:20:53.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:20:53.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:20:53.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:20:53.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:20:53.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:20:53.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:20:53.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:53.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:20:54.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:54.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:54.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:20:54.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:20:54.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:20:54.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:20:54.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:20:54.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:20:54.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:20:54.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:20:54.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:54.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:54.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:54.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:20:55.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:55.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:20:55.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:55.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:20:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:20:55.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:55.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:20:55.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:55.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:20:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:55.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:20:55.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:55.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:20:55.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:55.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:55.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:55.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:20:56.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:20:56.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:20:56.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:20:56.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:20:56.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:20:56.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:20:56.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:20:56.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:56.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:56.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:20:56.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:56.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:20:57.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:20:57.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:20:57.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:20:57.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:20:57.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:20:57.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:20:57.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:57.715 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:57.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:20:57.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:20:57.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:57.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:20:58.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:58.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:20:58.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:58.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:20:58.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:58.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:20:58.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:58.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:20:58.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:58.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:20:58.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:58.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:58.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:58.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:20:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:20:58.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:58.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:20:59.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:20:59.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:20:59.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:20:59.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:20:59.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:20:59.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:20:59.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:20:59.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:20:59.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:20:59.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:20:59.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:20:59.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:21:00.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:00.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:21:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:00.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:21:00.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:00.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:21:00.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:00.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:21:00.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:00.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:00.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:00.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:21:00.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:00.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:21:00.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:00.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:21:00.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:00.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:21:01.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:21:01.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:21:01.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:21:01.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:21:01.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:01.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:01.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:21:01.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:21:01.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:21:01.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:21:01.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:01.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:21:02.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:02.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:21:02.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:02.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:21:02.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:02.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:21:02.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:02.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:02.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:02.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:21:02.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:02.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:21:02.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:02.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:21:02.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:02.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:21:02.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:02.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:21:03.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:21:03.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:21:03.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:21:03.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:03.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:03.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:21:03.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:21:03.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:21:03.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:21:03.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:21:03.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:03.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:21:04.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:04.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:21:04.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:04.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:21:04.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:04.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:04.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:04.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:21:04.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:04.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:21:04.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:04.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:21:04.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:04.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:21:04.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:04.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:21:04.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:04.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:21:05.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:21:05.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:21:05.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:05.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:21:05.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:21:05.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:21:05.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:21:05.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:21:05.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:21:05.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:21:05.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:05.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:21:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:06.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:06.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:06.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:21:06.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:06.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:21:06.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:06.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:21:06.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:06.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:21:06.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:06.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:21:06.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:06.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:21:06.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:06.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:21:06.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:06.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:21:07.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:07.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:21:07.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:21:07.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:21:07.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:21:07.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:21:07.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:21:07.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:21:07.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:21:07.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:07.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:07.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:21:07.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:07.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:21:08.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:08.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:21:08.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:08.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:21:08.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:08.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:21:08.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:08.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:21:08.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:08.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:21:08.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:08.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:21:08.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:08.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:08.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:08.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:21:08.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:08.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:21:09.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:09.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:21:09.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:09.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:21:09.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:09.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:21:09.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:09.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:21:09.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:09.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:21:09.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:09.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:21:09.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:09.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:09.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:09.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:21:09.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:09.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:21:10.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:10.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:21:10.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:10.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:21:10.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:10.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:21:10.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:10.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:21:10.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:10.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:21:10.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:10.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:21:11.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:11.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:11.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:11.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:21:11.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:11.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:21:11.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:11.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:21:11.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:11.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:21:11.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:11.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:21:11.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:11.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:21:11.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:11.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:21:12.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:12.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:21:12.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:12.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:12.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:12.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:21:12.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:12.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:21:12.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:12.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:21:12.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:12.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:21:12.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:12.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:21:12.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:12.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:21:12.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:12.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:21:13.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:21:13.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:13.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:13.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:21:13.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:21:13.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:21:13.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:21:13.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:21:13.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:21:13.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:21:13.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:13.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:21:14.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:14.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:14.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:21:14.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:21:14.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:21:14.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:21:14.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:21:14.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:21:14.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:21:14.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:21:14.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:14.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:14.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:14.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:21:15.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:21:15.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:21:15.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:21:15.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:21:15.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:21:15.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:21:15.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:21:15.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:15.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:15.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:21:15.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:15.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:21:16.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:16.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:21:16.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:16.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:21:16.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:16.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:21:16.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:16.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:21:16.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:16.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:21:16.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:16.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:21:16.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:16.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:16.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:16.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:21:16.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:16.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:21:17.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:21:17.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:21:17.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:21:17.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:21:17.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:21:17.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:21:17.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:17.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:17.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:21:17.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:21:17.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:17.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:21:18.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:18.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:21:18.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:18.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:21:18.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:18.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:21:18.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:18.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:21:18.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:18.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:21:18.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:18.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:18.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:18.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:21:18.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:18.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:21:18.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:18.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:21:19.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:21:19.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:21:19.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:21:19.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:21:19.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:21:19.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:19.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:19.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:21:19.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:21:19.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:21:19.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:19.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:21:20.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:21:20.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:21:20.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:21:20.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:21:20.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:20.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:20.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:21:20.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:21:20.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:21:20.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:21:20.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:20.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:21:21.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:21.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:21:21.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:21.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:21:21.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:21.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:21:21.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:21.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:21.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:21.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:21:21.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:21.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:21:21.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:21.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:21:21.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:21.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:21:22.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:21:22.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:21:22.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:21:22.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:21:22.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:22.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:22.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:21:22.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:21:22.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:21:22.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:21:22.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:22.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:21:23.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:21:23.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:21:23.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:21:23.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:23.424 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:21:23.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:21:23.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:21:23.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:21:23.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:21:23.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:23.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:21:24.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:24.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:21:24.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:24.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:21:24.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:24.362 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:24.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:24.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:21:24.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:24.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:21:24.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:24.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:21:24.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:24.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:21:24.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:24.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:21:24.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:24.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:21:25.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:21:25.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:21:25.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:25.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:25.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:21:25.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:21:25.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:21:25.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:21:25.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:21:25.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:21:25.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:25.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:21:26.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:26.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:21:26.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:26.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:26.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:26.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:21:26.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:26.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:21:26.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:26.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:21:26.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:26.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:21:26.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:26.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:21:26.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:26.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:21:26.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:26.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:21:27.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:21:27.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:27.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:27.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:21:27.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:21:27.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:21:27.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:21:27.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:21:27.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:21:27.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:21:27.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:27.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:21:28.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:28.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:28.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:21:28.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:21:28.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:21:28.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:21:28.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:21:28.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:21:28.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:21:28.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:21:28.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:28.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:28.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:28.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:21:29.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:21:29.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:21:29.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:21:29.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:21:29.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:21:29.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:21:29.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:21:29.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:29.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:29.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:21:29.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:29.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:21:30.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:21:30.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:21:30.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:21:30.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:21:30.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:21:30.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:21:30.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:30.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:30.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:21:30.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:21:30.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:30.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:21:31.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:31.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:21:31.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:31.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:21:31.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:31.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:21:31.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:31.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:21:31.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:31.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:21:31.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:31.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:31.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:31.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:21:31.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:31.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:21:31.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:31.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:21:32.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:21:32.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:21:32.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:21:32.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:21:32.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:21:32.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:32.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:32.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:21:32.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:21:32.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:21:32.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:32.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:21:33.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:33.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:21:33.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:33.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:21:33.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:33.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:21:33.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:33.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:21:33.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:33.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:33.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:33.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:21:33.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:33.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:21:33.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:33.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:21:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:33.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:21:34.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:21:34.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:21:34.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:21:34.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:21:34.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:34.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:34.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:21:34.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:21:34.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:21:34.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:21:34.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:34.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:21:35.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:21:35.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:21:35.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:21:35.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:35.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:35.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:21:35.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:21:35.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:21:35.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:21:35.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:21:35.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:35.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:21:36.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:21:36.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:21:36.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:36.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:36.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:21:36.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:21:36.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:21:36.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:21:36.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:21:36.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:21:36.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:36.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:21:37.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:37.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:21:37.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:37.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:37.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:37.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:21:37.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:37.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:21:37.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:37.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:21:37.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:37.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:21:37.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:37.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:21:37.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:37.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:21:37.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:37.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:21:38.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:21:38.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:38.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:38.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:21:38.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:21:38.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:21:38.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:21:38.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:21:38.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:21:38.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:21:38.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:38.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:21:39.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:39.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:39.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:21:39.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:21:39.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:21:39.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:21:39.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:21:39.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:21:39.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:21:39.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:21:39.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:39.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:39.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:39.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:21:40.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:40.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:21:40.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:40.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:21:40.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:40.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:21:40.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:40.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:21:40.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:40.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:21:40.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:40.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:21:40.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:40.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:21:40.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:40.920 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:40.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:40.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:21:41.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:41.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:21:41.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:41.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:21:41.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:41.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:21:41.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:41.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:21:41.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:41.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:21:41.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:41.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:21:41.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:41.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:21:41.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:41.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:41.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:41.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:21:42.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:42.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:21:42.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:42.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:21:42.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:42.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:21:42.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:42.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:21:42.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:42.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:21:43.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:43.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:21:43.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:43.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:21:43.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:43.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:43.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:43.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:21:43.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:43.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:21:43.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:43.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:21:43.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:43.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:21:43.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:43.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:21:43.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:43.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:21:44.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:21:44.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:21:44.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:44.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:44.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:21:44.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:21:44.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:21:44.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:21:44.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:21:44.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:21:44.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:44.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:21:45.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:21:45.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:45.206 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:45.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:21:45.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:21:45.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:21:45.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:21:45.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:21:45.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:21:45.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:21:45.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:45.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:21:46.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:46.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:46.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:46.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:21:46.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:46.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:21:46.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:46.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:21:46.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:46.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:21:46.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:46.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:21:46.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:46.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:21:46.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:46.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:21:46.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:46.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:21:47.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:47.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:47.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:21:47.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:21:47.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:21:47.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:21:47.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:21:47.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:21:47.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:21:47.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:21:47.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:47.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:47.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:47.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:21:48.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:48.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:21:48.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:48.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:21:48.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:48.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:21:48.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:48.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:21:48.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:48.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:21:48.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:48.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:21:48.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:48.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:21:48.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:48.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:48.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:48.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:21:49.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:21:49.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:21:49.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:21:49.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:21:49.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:21:49.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:21:49.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:21:49.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:49.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:49.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:21:49.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:49.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:21:50.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:21:50.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:21:50.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:21:50.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:21:50.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:21:50.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:21:50.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:50.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:50.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:21:50.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:21:50.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:50.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:21:51.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:21:51.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:21:51.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:21:51.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:21:51.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:21:51.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:51.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:51.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:21:51.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:21:51.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:21:51.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:51.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:21:52.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:52.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:21:52.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:52.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:21:52.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:52.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:21:52.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:52.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:21:52.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:52.574 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:52.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:52.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:21:52.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:52.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:21:52.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:52.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:21:52.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:52.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:21:53.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:21:53.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:21:53.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:21:53.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:21:53.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:53.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:53.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:21:53.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:21:53.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:21:53.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:21:53.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:53.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:21:54.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:21:54.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:21:54.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:21:54.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:54.410 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:54.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:21:54.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:21:54.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:21:54.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:21:54.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:21:54.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:54.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:21:55.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:55.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:21:55.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:55.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:21:55.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:55.288 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:55.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:55.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:21:55.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:55.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:21:55.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:55.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:21:55.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:55.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:21:55.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:55.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:21:55.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:55.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:21:56.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:21:56.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:21:56.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:56.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:56.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:21:56.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:21:56.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:21:56.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:21:56.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:21:56.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:21:56.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:56.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:21:57.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:21:57.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:57.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:57.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:21:57.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:21:57.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:21:57.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:21:57.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:21:57.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:21:57.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:21:57.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:57.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:21:58.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:58.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:58.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:21:58.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:21:58.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:21:58.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:21:58.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:21:58.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:21:58.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:21:58.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:21:58.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:58.979 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:58.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:58.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:21:59.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:21:59.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:21:59.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:21:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:21:59.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:21:59.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:21:59.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:21:59.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:21:59.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:21:59.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:21:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:21:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:22:00.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:22:00.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:22:00.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:22:00.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:22:00.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:22:00.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:22:00.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:00.730 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:00.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:22:00.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:22:00.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:00.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:22:01.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:22:01.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:22:01.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:22:01.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:22:01.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:22:01.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:01.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:01.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:22:01.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:22:01.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:22:01.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:01.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:22:02.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:22:02.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:22:02.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:22:02.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:22:02.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:02.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:02.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:22:02.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:22:02.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:22:02.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:22:02.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:02.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:22:03.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:22:03.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:22:03.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:22:03.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:03.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:03.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:22:03.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:22:03.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:22:03.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:22:03.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:22:03.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:03.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:22:04.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:22:04.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:22:04.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:04.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:04.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:22:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:22:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:22:04.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:22:04.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:22:04.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:22:04.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:04.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:22:05.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:22:05.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:05.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:05.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:22:05.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:22:05.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:22:05.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:22:05.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:22:05.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:22:05.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:22:05.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:05.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:22:06.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:06.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:06.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:22:06.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:22:06.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:22:06.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:22:06.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:22:06.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:22:06.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:22:06.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:22:06.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:06.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:06.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:06.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:22:07.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:07.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:22:07.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:07.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:22:07.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:07.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:22:07.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:07.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:22:07.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:07.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:22:07.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:07.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:22:07.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:07.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:22:07.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:07.871 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:07.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:07.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:22:08.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:22:08.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:22:08.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:22:08.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:22:08.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:22:08.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:22:08.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:22:08.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:08.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:08.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:22:08.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:22:08.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:08.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:22:09.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:22:09.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:22:09.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:22:09.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:22:09.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:22:09.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:09.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:09.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:22:09.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:22:09.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:22:09.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:09.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:22:10.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:22:10.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:22:10.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:22:10.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:22:10.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:10.524 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:10.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:22:10.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:22:10.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:22:10.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:22:10.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:10.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:22:11.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:22:11.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:22:11.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:22:11.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:11.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:11.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:22:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:22:11.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:22:11.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:22:11.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:22:11.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:22:11.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:11.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:22:12.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:22:12.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:12.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:12.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:22:12.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:22:12.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:22:12.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:22:12.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:22:12.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:22:12.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:22:12.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:22:12.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:12.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:12.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:12.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:22:13.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:13.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:22:13.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:13.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:22:13.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:13.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:22:13.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:13.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:22:14.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:22:14.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:22:14.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:22:14.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:14.366 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:14.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:22:14.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:22:14.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:22:14.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:22:14.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:22:14.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:22:14.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:14.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:22:15.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:22:15.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:15.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:15.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:22:15.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:22:15.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:22:15.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:22:15.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:22:15.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:22:15.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:22:15.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:15.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:22:16.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:16.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:16.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:22:16.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:22:16.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:22:16.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:22:16.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:22:16.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:22:16.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:22:16.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:22:16.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:16.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:16.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:22:16.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:16.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:22:17.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:22:17.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:22:17.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:22:17.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:22:17.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:22:17.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:22:17.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:17.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:17.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:22:17.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:22:17.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:22:17.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:17.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:22:18.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:22:18.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:22:18.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:22:18.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:22:18.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:18.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:18.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:22:18.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:22:18.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:22:18.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:22:18.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:18.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:22:19.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:22:19.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:22:19.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:22:19.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:19.430 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:19.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:22:19.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:22:19.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:22:19.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:22:19.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:22:19.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:19.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:22:20.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:22:20.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:22:20.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:20.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:20.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:22:20.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:22:20.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:22:20.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:22:20.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:22:20.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:22:20.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:22:20.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:20.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:22:21.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:21.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:21.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:22:21.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:22:21.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:22:21.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:22:21.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:22:21.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:22:21.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:22:21.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:22:21.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:21.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:21.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:22:21.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:21.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:22:22.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:22:22.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:22:22.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:22:22.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:22:22.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:22:22.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:22:22.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:22.706 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:22.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:22:22.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:22:22.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:22:22.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:22.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:22:23.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:22:23.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:22:23.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:22:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:22:23.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:23.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:23.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:22:23.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:22:23.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:22:23.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:22:23.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:23.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:22:24.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:22:24.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:22:24.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:22:24.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:24.389 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:24.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:22:24.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:22:24.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:22:24.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:22:24.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:22:24.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:22:24.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:24.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:22:25.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:22:25.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:25.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:25.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:22:25.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:22:25.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:22:25.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:22:25.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:22:25.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:22:25.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:22:25.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:25.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:22:26.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:26.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:26.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:22:26.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:22:26.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:22:26.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:22:26.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:22:26.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:22:26.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:22:26.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:22:26.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:26.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:26.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:22:26.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:26.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:22:27.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:22:27.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:22:27.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:22:27.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:22:27.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:22:27.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:22:27.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:27.586 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:27.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:22:27.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:22:27.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:22:27.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:22:27.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:27.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:22:28.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:22:28.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:22:28.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:22:28.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:28.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:28.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:22:28.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:22:28.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:22:28.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:22:28.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:22:28.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:28.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:22:29.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:22:29.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:22:29.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:29.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:29.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:22:29.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:22:29.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:22:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:22:29.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:22:29.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:22:29.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:22:29.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:22:29.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:29.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:29.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:29.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:22:30.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:22:30.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:22:30.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:22:30.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:22:30.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:22:30.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:22:30.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:22:30.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:30.810 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:30.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:22:30.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:30.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:22:31.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:22:31.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:22:31.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:22:31.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:22:31.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:22:31.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:22:31.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:31.580 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:31.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:22:31.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:22:31.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:22:31.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:22:31.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:31.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:22:32.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:22:32.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:22:32.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:22:32.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:32.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:32.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:22:32.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:22:32.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:22:32.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:22:32.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:22:32.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:22:32.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:32.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:22:33.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:22:33.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:33.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:33.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:22:33.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:22:33.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:22:33.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:22:33.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:22:33.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:22:33.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:22:33.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:22:33.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:33.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:33.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:22:33.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:33.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:22:34.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:22:34.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:22:34.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:22:34.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:22:34.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:22:34.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:22:34.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:34.768 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:34.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:22:34.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:22:34.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:34.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:22:35.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:22:35.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:22:35.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:22:35.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:22:35.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:22:35.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:35.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:22:35.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:22:35.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:22:35.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:22:35.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:35.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:22:36.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:22:36.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:22:36.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:22:36.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:36.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:36.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:22:36.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:22:36.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:22:36.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:22:36.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:22:36.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:22:36.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:22:36.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:36.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:22:37.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:37.088 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:37.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:22:37.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:22:37.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:22:37.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:22:37.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:22:37.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:22:37.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:22:37.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:22:37.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:37.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:37.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:22:37.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:37.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:22:38.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:22:38.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:22:38.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:22:38.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:22:38.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:22:38.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:22:38.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:38.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:38.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:22:38.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:22:38.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:22:38.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:38.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:22:39.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:22:39.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:22:39.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:22:39.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:22:39.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:39.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:39.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:22:39.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:22:39.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:22:39.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:22:39.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:22:39.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:39.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:22:40.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:22:40.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:22:40.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:40.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:40.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:22:40.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:22:40.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:22:40.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:22:40.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:22:40.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:22:40.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:22:40.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:22:40.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:40.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:22:41.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:22:41.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:22:41.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:22:41.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:22:41.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:22:41.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:22:41.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:22:41.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:41.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:41.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:22:41.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:22:41.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:41.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:22:42.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:22:42.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:22:42.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:22:42.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:22:42.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:22:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:42.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:22:42.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:22:42.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:22:42.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:22:42.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:22:42.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:42.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:22:43.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:22:43.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:22:43.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:43.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:43.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:22:43.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:22:43.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:22:43.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:22:43.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:22:43.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:22:43.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:22:43.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:43.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:22:44.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:44.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:44.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:44.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:22:44.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:44.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:22:44.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:44.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:22:45.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:22:45.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:22:45.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:22:45.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:22:45.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:22:45.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:45.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:45.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:22:45.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:22:45.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:22:45.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:22:45.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:45.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:22:46.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:22:46.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:22:46.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:22:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:46.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:46.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:22:46.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:22:46.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:22:46.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:22:46.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:22:46.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:22:46.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:46.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:22:47.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:22:47.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:47.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:47.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:22:47.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:22:47.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:22:47.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:22:47.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:22:47.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:22:47.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:22:47.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:22:47.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:47.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:47.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:22:47.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:47.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:22:48.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:22:48.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:22:48.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:22:48.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:22:48.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:22:48.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:22:48.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:48.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:48.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:22:48.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:22:48.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:48.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:22:49.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:22:49.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:22:49.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:22:49.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:22:49.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:22:49.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:49.470 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:49.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:22:49.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:22:49.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:22:49.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:22:49.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:22:49.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:49.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:22:50.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:22:50.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:22:50.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:50.191 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:50.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:22:50.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:22:50.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:22:50.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:22:50.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:22:50.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:22:50.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:22:50.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:50.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:22:51.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:51.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:51.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:22:51.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:22:51.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:22:51.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:22:51.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:22:51.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:22:51.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:22:51.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:22:51.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:51.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:51.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:22:51.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:51.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:22:52.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:22:52.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:22:52.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:22:52.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:22:52.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:22:52.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:22:52.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:52.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:52.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:22:52.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:22:52.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:22:52.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:22:52.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:52.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:22:53.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:22:53.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:22:53.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:22:53.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:53.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:53.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:22:53.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:22:53.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:22:53.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:22:53.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:22:53.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:22:53.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:53.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:22:54.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:22:54.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:54.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:22:54.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:22:54.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:22:54.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:22:54.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:22:54.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:22:54.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:22:54.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:22:54.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:54.937 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:54.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:54.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:22:55.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:22:55.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:22:55.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:22:55.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:22:55.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:22:55.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:22:55.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:22:55.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:55.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:55.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:22:55.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:22:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:22:56.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:22:56.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:22:56.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:22:56.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:22:56.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:22:56.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:56.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:56.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:22:56.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:22:56.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:22:56.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:22:56.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:22:56.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:56.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:22:57.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:22:57.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:22:57.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:57.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:57.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:22:57.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:22:57.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:22:57.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:22:57.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:22:57.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:22:57.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:22:57.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:57.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:22:58.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:58.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:58.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:22:58.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:22:58.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:22:58.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:22:58.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:22:58.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:22:58.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:22:58.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:22:58.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:58.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:58.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:22:58.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:58.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:22:59.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:22:59.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:22:59.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:22:59.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:22:59.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:22:59.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:22:59.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:22:59.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:22:59.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:22:59.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:22:59.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:22:59.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:22:59.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:22:59.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:23:00.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:23:00.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:23:00.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:23:00.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:00.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:00.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:23:00.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:23:00.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:23:00.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:23:00.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:23:00.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:00.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:23:01.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:23:01.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:23:01.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:01.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:01.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:23:01.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:23:01.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:23:01.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:23:01.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:23:01.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:23:01.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:23:01.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:01.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:23:02.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:02.010 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:02.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:23:02.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:23:02.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:23:02.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:23:02.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:23:02.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:23:02.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:23:02.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:23:02.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:02.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:02.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:23:02.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:23:02.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:02.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:23:03.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:23:03.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:23:03.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:23:03.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:23:03.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:23:03.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:03.541 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:03.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:23:03.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:23:03.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:23:03.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:23:03.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:03.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:23:04.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:23:04.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:23:04.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:23:04.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:04.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:04.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:23:04.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:23:04.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:23:04.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:23:04.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:23:04.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:23:04.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:04.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:23:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:23:05.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:05.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:05.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:23:05.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:23:05.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:23:05.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:23:05.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:23:05.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:23:05.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:23:05.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:23:05.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:05.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:05.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:05.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:23:06.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:23:06.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:23:06.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:23:06.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:23:06.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:23:06.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:23:06.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:23:06.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:06.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:06.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:23:06.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:23:06.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:06.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:23:07.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:23:07.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:23:07.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:23:07.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:23:07.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:23:07.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:07.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:07.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:23:07.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:23:07.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:23:07.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:23:07.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:23:07.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:07.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:23:08.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:23:08.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:23:08.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:08.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:08.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:23:08.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:23:08.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:23:08.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:23:08.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:23:08.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:23:08.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:23:08.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:23:08.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:08.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:08.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:08.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:23:09.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:23:09.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:23:09.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:23:09.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:23:09.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:23:09.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:23:09.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:23:09.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:09.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:09.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:23:09.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:23:09.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:09.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:23:10.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:23:10.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:23:10.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:23:10.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:23:10.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:23:10.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:10.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:10.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:23:10.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:23:10.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:23:10.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:10.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:23:11.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:23:11.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:23:11.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:23:11.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:23:11.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:11.376 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:11.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:23:11.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:23:11.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:23:11.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:23:11.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:23:11.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:23:11.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:11.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:23:12.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:23:12.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:12.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:12.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:23:12.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:23:12.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:23:12.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:23:12.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:23:12.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:23:12.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:23:12.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:23:12.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:12.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:12.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:12.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:23:13.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:23:13.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:23:13.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:23:13.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:23:13.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:23:13.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:23:13.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:23:13.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:13.685 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:13.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:23:13.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:23:13.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:23:13.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:13.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:23:14.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:23:14.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:23:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:23:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:23:14.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:14.507 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:14.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:23:14.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:23:14.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:23:14.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:23:14.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:23:14.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:14.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:23:15.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:23:15.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:23:15.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:15.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:15.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:23:15.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:23:15.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:23:15.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:23:15.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:23:15.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:23:15.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:15.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:23:16.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:16.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:23:16.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:16.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:16.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:16.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:23:16.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:16.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:23:16.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:16.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:23:16.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:16.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:23:17.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:23:17.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:23:17.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:23:17.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:23:17.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:17.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:17.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:23:17.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:23:17.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:23:17.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:23:17.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:23:17.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:23:17.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:17.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:23:18.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:23:18.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:18.122 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:18.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:23:18.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:23:18.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:23:18.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:23:18.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:23:18.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:23:18.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:23:18.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:23:18.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:18.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:18.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:23:18.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:18.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:23:19.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:23:19.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:23:19.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:23:19.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:23:19.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:23:19.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:23:19.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:19.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:19.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:23:19.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:23:19.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:23:19.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:19.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:23:20.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:23:20.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:23:20.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:23:20.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:23:20.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:20.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:20.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:23:20.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:23:20.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:23:20.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:23:20.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:23:20.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:23:20.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:20.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:23:21.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:23:21.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:21.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:21.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:23:21.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:23:21.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:23:21.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:23:21.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:23:21.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:23:21.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:23:21.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:23:21.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:21.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:21.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:21.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:23:22.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:23:22.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:23:22.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:23:22.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:23:22.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:23:22.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:23:22.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:23:22.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:22.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:22.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:23:22.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:23:22.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:22.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:23:23.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:23:23.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:23:23.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:23:23.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:23:23.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:23:23.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:23.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:23.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:23:23.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:23:23.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:23:23.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:23:23.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:23:23.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:23:23.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:23.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:23:24.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:23:24.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:24.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:24.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:23:24.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:23:24.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:23:24.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:23:24.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:23:24.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:23:24.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:23:24.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:23:24.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:24.943 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:24.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:24.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:23:25.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:23:25.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:23:25.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:23:25.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:23:25.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:23:25.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:23:25.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:23:25.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:25.659 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:25.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:23:25.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:25.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:23:26.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:23:26.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:23:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:23:26.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:23:26.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:23:26.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:23:26.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:26.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:26.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:23:26.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:23:26.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:23:26.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:23:26.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:23:26.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:26.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:23:27.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:23:27.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:23:27.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:27.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:27.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:23:27.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:23:27.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:23:27.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:23:27.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:23:27.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:23:27.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:23:27.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:27.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:27.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:27.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:23:28.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:23:28.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:23:28.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:23:28.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:23:28.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:23:28.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:23:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:23:28.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:28.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:28.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:23:28.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:23:28.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:23:28.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:28.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:23:29.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:23:29.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:23:29.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:23:29.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:23:29.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:29.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:29.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:23:29.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:23:29.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:23:29.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:23:29.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:23:29.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:23:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:23:30.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:23:30.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:30.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:30.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:23:30.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:23:30.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:23:30.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:23:30.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:23:30.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:23:30.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:23:30.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:23:30.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:30.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:30.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:23:30.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:30.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:23:31.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:23:31.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:23:31.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:23:31.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:23:31.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:23:31.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:23:31.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:31.581 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:31.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:23:31.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:23:31.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:23:31.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:31.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:23:32.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:23:32.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:23:32.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:23:32.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:23:32.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:32.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:32.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:23:32.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:23:32.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:23:32.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:23:32.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:23:32.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:23:32.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:32.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:23:33.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:23:33.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:33.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:33.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:23:33.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:23:33.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:23:33.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:23:33.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:23:33.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:23:33.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:23:33.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:23:33.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:33.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:33.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:23:33.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:33.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:23:34.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:23:34.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:23:34.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:23:34.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:23:34.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:23:34.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:23:34.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:34.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:34.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:23:34.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:23:34.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:23:34.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:23:34.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:23:34.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:34.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:23:35.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:23:35.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:23:35.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:35.188 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:35.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:23:35.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:23:35.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:23:35.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:23:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:23:35.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:23:35.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:23:35.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:23:35.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:35.909 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:23:35.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:35.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:23:36.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:23:36.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:23:36.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:23:36.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:23:36.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:23:36.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:23:36.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:36.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:36.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:23:36.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:23:36.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:23:36.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:36.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:23:37.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:23:37.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:23:37.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:23:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:23:37.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:37.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:37.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:23:37.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:23:37.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:23:37.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:23:37.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:23:37.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:37.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:23:37.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:23:38.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:23:38.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:38.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:38.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:23:38.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:23:38.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:23:38.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:23:38.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:23:38.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:23:38.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:23:38.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:23:38.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:38.895 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:38.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:23:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:23:39.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:23:39.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:23:39.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:23:39.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:23:39.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:23:39.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:23:39.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:39.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:39.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:23:39.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:23:39.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:23:39.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:23:39.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:23:39.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:39.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:23:40.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:23:40.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:23:40.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:40.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:40.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:23:40.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:23:40.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:23:40.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:23:40.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:23:40.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:23:40.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:23:40.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:23:40.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:40.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:40.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:40.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:23:41.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:23:41.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:23:41.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:23:41.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:23:41.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:23:41.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:23:41.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:23:41.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:41.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:41.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:23:41.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:23:41.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:23:41.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:23:41.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:41.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:23:42.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:23:42.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:23:42.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:23:42.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:42.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:42.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:23:42.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:23:42.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:23:42.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:23:42.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:23:42.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:23:42.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:23:42.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:42.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:23:43.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:43.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:43.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:23:43.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:23:43.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:23:43.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:23:43.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:23:43.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:23:43.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:23:43.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:23:43.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:43.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:43.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:23:43.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:23:43.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:43.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:23:44.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:23:44.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:23:44.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:23:44.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:23:44.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:23:44.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:44.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:44.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:23:44.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:23:44.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:23:44.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:23:44.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:23:44.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:23:44.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:44.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:23:45.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:23:45.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:45.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:45.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:23:45.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:23:45.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:23:45.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:23:45.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:23:45.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:23:45.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:23:45.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:23:45.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:45.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:45.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:23:45.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:23:45.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:45.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:23:46.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:23:46.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:23:46.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:23:46.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:23:46.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:23:46.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:46.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:46.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:23:46.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:23:46.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:23:46.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:23:46.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:23:46.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:46.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:23:47.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:47.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:23:47.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:47.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:23:47.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:47.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:47.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:47.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:23:47.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:47.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:23:47.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:47.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:23:47.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:47.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:23:48.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:23:48.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:23:48.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:23:48.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:23:48.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:48.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:48.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:23:48.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:23:48.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:23:48.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:23:48.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:23:48.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:23:48.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:48.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:23:49.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:23:49.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:49.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:49.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:23:49.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:23:49.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:23:49.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:23:49.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:23:49.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:23:49.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:23:49.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:23:49.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:49.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:49.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:23:49.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:49.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:23:50.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:23:50.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:23:50.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:23:50.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:23:50.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:23:50.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:23:50.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:50.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:50.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:23:50.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:23:50.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:23:50.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:23:50.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:50.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:23:51.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:23:51.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:23:51.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:23:51.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:51.280 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:51.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:23:51.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:23:51.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:23:51.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:23:51.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:23:51.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:23:51.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:23:51.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:23:51.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:51.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:51.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:51.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:23:52.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:23:52.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:23:52.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:23:52.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:23:52.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:23:52.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:23:52.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:23:52.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:52.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:52.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:23:52.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:23:52.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:52.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:23:53.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:23:53.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:23:53.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:23:53.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:23:53.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:23:53.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:53.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:53.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:23:53.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:23:53.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:23:53.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:23:53.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:23:53.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:23:53.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:23:53.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:53.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:23:54.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:54.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:54.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:23:54.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:23:54.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:23:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:23:54.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:23:54.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:23:54.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:23:54.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:23:54.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:54.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:54.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:23:54.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:54.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:23:55.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:23:55.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:23:55.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:23:55.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:23:55.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:23:55.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:23:55.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:55.579 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:55.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:23:55.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:23:55.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:23:55.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:23:55.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:55.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:23:56.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:23:56.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:23:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:23:56.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:56.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:56.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:23:56.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:23:56.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:23:56.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:23:56.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:23:56.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:23:56.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:23:56.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:23:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:56.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:56.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:56.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:23:57.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:23:57.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:23:57.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:23:57.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:23:57.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:23:57.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:23:57.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:23:57.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:57.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:57.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:23:57.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:23:57.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:23:57.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:23:57.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:57.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:23:58.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:23:58.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:23:58.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:23:58.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:58.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:58.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:23:58.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:23:58.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:23:58.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:23:58.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:23:58.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:23:58.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:58.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:23:59.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:23:59.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:59.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:59.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:23:59.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:23:59.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:23:59.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:23:59.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:23:59.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:23:59.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:23:59.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:23:59.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:23:59.890 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:23:59.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:23:59.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:23:59.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:24:00.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:24:00.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:24:00.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:24:00.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:24:00.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:24:00.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:24:00.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:00.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:00.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:24:00.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:24:00.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:24:00.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:24:00.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:00.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:24:01.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:24:01.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:24:01.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:24:01.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:01.344 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:01.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:24:01.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:24:01.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:24:01.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:24:01.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:24:01.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:24:01.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:24:01.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:24:01.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:01.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:01.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:01.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:24:02.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:24:02.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:24:02.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:24:02.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:24:02.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:24:02.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:24:02.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:24:02.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:02.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:02.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:24:02.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:24:02.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:24:02.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:02.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:24:03.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:24:03.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:24:03.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:24:03.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:24:03.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:03.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:03.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:24:03.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:24:03.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:24:03.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:24:03.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:24:03.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:24:03.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:03.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:24:04.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:24:04.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:04.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:04.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:24:04.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:24:04.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:24:04.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:24:04.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:24:04.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:24:04.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:24:04.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:24:04.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:04.870 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:04.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:24:04.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:04.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:24:05.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:24:05.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:24:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:24:05.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:24:05.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:24:05.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:24:05.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:05.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:05.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:24:05.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:24:05.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:24:05.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:24:05.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:24:05.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:05.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:24:06.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:24:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:24:06.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:06.191 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:06.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:24:06.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:24:06.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:24:06.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:24:06.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:24:06.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:24:06.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:24:06.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:24:06.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:06.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:06.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:24:06.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:06.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:24:07.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:24:07.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:24:07.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:24:07.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:24:07.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:24:07.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:24:07.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:07.598 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:07.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:24:07.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:24:07.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:24:07.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:24:07.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:07.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:24:08.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:24:08.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:24:08.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:24:08.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:08.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:08.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:24:08.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:24:08.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:24:08.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:24:08.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:24:08.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:24:08.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:24:08.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:08.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:24:09.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:09.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:09.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:24:09.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:24:09.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:24:09.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:24:09.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:24:09.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:24:09.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:24:09.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:24:09.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:09.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:09.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:24:09.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:24:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:24:09.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:09.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:24:10.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:24:10.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:24:10.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:24:10.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:24:10.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:10.463 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:10.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:24:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:24:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:24:10.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:24:10.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:24:10.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:10.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:24:11.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:24:11.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:24:11.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:11.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:24:11.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:24:11.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:24:11.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:24:11.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:24:11.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:24:11.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:24:11.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:24:11.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:11.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:11.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:24:11.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:11.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:24:12.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:24:12.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:24:12.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:24:12.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:24:12.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:24:12.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:24:12.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:12.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:12.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:24:12.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:24:12.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:12.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:24:13.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:24:13.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:24:13.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:24:13.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:24:13.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:24:13.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:13.563 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:13.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:24:13.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:24:13.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:24:13.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:24:13.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:13.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:24:14.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:24:14.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:24:14.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:24:14.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:14.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:14.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:24:14.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:24:14.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:24:14.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:24:14.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:24:14.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:24:14.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:24:14.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:24:14.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:14.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:14.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:14.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:24:15.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:24:15.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:24:15.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:24:15.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:24:15.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:24:15.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:24:15.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:24:15.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:15.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:15.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:24:15.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:24:15.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:24:15.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:15.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:24:16.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:24:16.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:24:16.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:24:16.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:24:16.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:16.463 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:16.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:24:16.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:24:16.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:24:16.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:24:16.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:24:16.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:16.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:24:17.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:24:17.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:24:17.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:17.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:17.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:24:17.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:24:17.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:24:17.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:24:17.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:24:17.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:24:17.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:24:17.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:24:17.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:17.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:17.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:24:17.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:17.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:24:18.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:18.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:24:18.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:18.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:24:18.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:18.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:24:18.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:18.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:24:18.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:18.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:24:18.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:18.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:24:18.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:18.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:18.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:18.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:24:19.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:24:19.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:24:19.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:24:19.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:24:19.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:24:19.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:24:19.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:24:19.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:19.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:19.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:24:19.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:24:19.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:19.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:24:20.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:24:20.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:24:20.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:24:20.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:24:20.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:24:20.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:20.477 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:20.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:24:20.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:24:20.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:24:20.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:24:20.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:24:20.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:20.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:24:21.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:24:21.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:24:21.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:21.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:21.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:24:21.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:24:21.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:24:21.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:24:21.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:24:21.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:24:21.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:24:21.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:24:21.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:21.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:21.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:21.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:24:21.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:24:22.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:24:22.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:24:22.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:24:22.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:24:22.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:24:22.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:24:22.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:22.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:22.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:24:22.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:24:22.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:24:22.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:22.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:24:23.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:24:23.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:24:23.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:24:23.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:24:23.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:23.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:23.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:24:23.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:24:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:24:23.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:24:23.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:24:23.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:24:23.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:24:23.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:23.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:24:24.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:24.075 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:24.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:24:24.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:24:24.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:24:24.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:24:24.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:24:24.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:24:24.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:24:24.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:24:24.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:24.809 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:24.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:24:24.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:24:24.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:24.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:24:25.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:24:25.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:24:25.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:24:25.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:24:25.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:24:25.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:25.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:25.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:24:25.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:24:25.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:24:25.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:24:25.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:24:25.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:25.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:24:26.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:24:26.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:24:26.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:26.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:26.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:24:26.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:24:26.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:24:26.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:24:26.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:24:26.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:24:26.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:24:26.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:24:26.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:26.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:26.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:26.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:24:27.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:24:27.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:24:27.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:24:27.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:24:27.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:24:27.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:24:27.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:24:27.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:27.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:27.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:24:27.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:24:27.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:24:27.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:27.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:24:28.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:24:28.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:24:28.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:24:28.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:24:28.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:28.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:28.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:24:28.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:24:28.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:24:28.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:24:28.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:24:28.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:24:28.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:28.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:24:29.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:24:29.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:29.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:29.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:24:29.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:24:29.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:24:29.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:24:29.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:24:29.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:24:29.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:24:29.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:24:29.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:29.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:29.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:24:29.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:29.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:24:30.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:24:30.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:24:30.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:24:30.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:24:30.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:24:30.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:24:30.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:30.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:30.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:24:30.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:24:30.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:24:30.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:24:30.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:30.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:24:31.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:24:31.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:24:31.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:24:31.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:31.304 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:31.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:24:31.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:24:31.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:24:31.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:24:31.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:24:31.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:24:31.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:24:31.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:31.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:24:32.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:32.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:32.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:24:32.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:24:32.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:24:32.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:24:32.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:24:32.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:24:32.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:24:32.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:24:32.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:32.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:32.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:24:32.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:24:32.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:32.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:24:33.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:24:33.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:24:33.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:24:33.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:24:33.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:24:33.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:33.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:33.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:24:33.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:24:33.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:24:33.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:24:33.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:24:33.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:33.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:24:34.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:24:34.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:24:34.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:34.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:34.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:24:34.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:24:34.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:24:34.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:24:34.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:24:34.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:24:34.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:24:34.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:24:34.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:34.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:34.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:34.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:24:35.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:24:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:24:35.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:24:35.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:24:35.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:24:35.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:24:35.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:24:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:35.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:24:35.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:24:35.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:24:35.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:24:35.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:35.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:24:36.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:24:36.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:24:36.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:24:36.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:36.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:36.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:24:36.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:24:36.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:24:36.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:24:36.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:24:36.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:24:36.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:24:36.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:36.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:24:37.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:37.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:37.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:24:37.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:24:37.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:24:37.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:24:37.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:24:37.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:24:37.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:24:37.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:24:37.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:37.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:37.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:24:37.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:24:37.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:37.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:24:38.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:24:38.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:24:38.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:24:38.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:24:38.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:24:38.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:38.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:38.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:24:38.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:24:38.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:24:38.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:24:38.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:24:38.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:38.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:24:39.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:24:39.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:24:39.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:39.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:39.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:24:39.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:24:39.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:24:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:24:39.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:24:39.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:24:39.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:24:39.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:39.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:24:40.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:40.023 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:40.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:24:40.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:24:40.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:24:40.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:24:40.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:24:40.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:24:40.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:24:40.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:24:40.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:40.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:40.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:24:40.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:24:40.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:40.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:24:41.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:24:41.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:24:41.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:24:41.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:24:41.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:24:41.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:41.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:41.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:24:41.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:24:41.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:24:41.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:24:41.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:24:41.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:41.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:24:42.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:24:42.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:24:42.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:42.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:42.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:24:42.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:24:42.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:24:42.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:24:42.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:24:42.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:24:42.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:24:42.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:24:42.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:42.943 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:42.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:42.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:24:43.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:24:43.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:24:43.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:24:43.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:24:43.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:24:43.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:24:43.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:24:43.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:43.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:43.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:24:43.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:24:43.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:24:43.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:43.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:24:44.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:24:44.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:24:44.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:24:44.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:24:44.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:44.432 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:44.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:24:44.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:24:44.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:24:44.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:24:44.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:24:44.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:24:44.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:44.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:24:45.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:24:45.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:45.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:45.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:24:45.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:24:45.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:24:45.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:24:45.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:24:45.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:24:45.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:24:45.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:24:45.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:45.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:45.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:24:45.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:45.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:24:46.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:24:46.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:24:46.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:24:46.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:24:46.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:24:46.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:24:46.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:46.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:46.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:24:46.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:24:46.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:24:46.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:24:46.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:46.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:24:47.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:24:47.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:24:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:24:47.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:47.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:47.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:24:47.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:24:47.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:24:47.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:24:47.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:24:47.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:24:47.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:24:47.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:47.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:24:48.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:48.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:48.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:24:48.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:24:48.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:24:48.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:24:48.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:24:48.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:24:48.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:24:48.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:24:48.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:48.765 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:48.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:24:48.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:24:48.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:48.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:24:49.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:49.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:24:49.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:49.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:24:49.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:49.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:24:49.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:49.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:24:49.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:49.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:24:49.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:49.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:49.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:49.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:24:49.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:49.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:24:49.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:49.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:24:50.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:50.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:24:50.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:50.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:24:50.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:50.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:24:50.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:50.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:24:50.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:50.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:24:50.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:50.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:50.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:50.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:24:51.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:24:51.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:24:51.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:24:51.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:24:51.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:24:51.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:24:51.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:24:51.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:51.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:51.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:24:51.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:24:51.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:24:51.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:51.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:24:52.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:24:52.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:24:52.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:24:52.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:24:52.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:52.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:52.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:24:52.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:24:52.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:24:52.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:24:52.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:24:52.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:24:52.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:52.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:24:53.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:24:53.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:53.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:53.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:24:53.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:24:53.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:24:53.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:24:53.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:24:53.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:24:53.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:24:53.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:24:53.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:53.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:53.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:24:53.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:24:53.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:53.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:24:54.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:24:54.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:24:54.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:24:54.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:24:54.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:24:54.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:54.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:54.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:24:54.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:24:54.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:24:54.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:24:54.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:24:54.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:54.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:24:55.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:24:55.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:24:55.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:55.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:55.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:24:55.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:24:55.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:24:55.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:24:55.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:24:55.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:24:55.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:24:55.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:55.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:24:56.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:56.001 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:56.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:24:56.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:24:56.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:24:56.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:24:56.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:24:56.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:24:56.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:24:56.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:24:56.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:56.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:56.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:24:56.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:24:56.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:24:56.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:56.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:24:57.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:24:57.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:24:57.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:24:57.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:24:57.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:57.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:24:57.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:24:57.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:24:57.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:24:57.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:24:57.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:24:57.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:57.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:24:58.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:24:58.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:58.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:58.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:24:58.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:24:58.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:24:58.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:24:58.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:24:58.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:24:58.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:24:58.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:24:58.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:58.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:58.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:24:58.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:58.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:24:59.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:24:59.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:24:59.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:24:59.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:24:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:24:59.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:24:59.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:24:59.556 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:24:59.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:24:59.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:24:59.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:24:59.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:24:59.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:24:59.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:25:00.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:25:00.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:25:00.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:25:00.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:00.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:00.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:25:00.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:25:00.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:25:00.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:25:00.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:25:00.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:25:00.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:00.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:25:01.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:25:01.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:01.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:01.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:25:01.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:25:01.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:25:01.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:25:01.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:25:01.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:25:01.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:25:01.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:25:01.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:01.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:01.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:25:01.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:01.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:25:02.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:25:02.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:25:02.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:25:02.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:25:02.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:25:02.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:25:02.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:02.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:02.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:25:02.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:25:02.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:25:02.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:25:02.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:25:02.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:02.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:25:03.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:25:03.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:25:03.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:03.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:03.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:25:03.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:25:03.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:25:03.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:25:03.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:25:03.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:25:03.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:25:03.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:25:03.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:03.943 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:03.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:03.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:25:04.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:25:04.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:25:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:25:04.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:25:04.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:25:04.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:25:04.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:25:04.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:04.721 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:04.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:25:04.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:25:04.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:25:04.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:04.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:25:05.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:25:05.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:25:05.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:25:05.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:25:05.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:05.406 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:05.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:25:05.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:25:05.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:25:05.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:25:05.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:25:05.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:25:05.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:05.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:25:06.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:25:06.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:06.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:06.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:25:06.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:25:06.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:25:06.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:25:06.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:25:06.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:25:06.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:25:06.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:25:06.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:06.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:06.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:06.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:25:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:25:07.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:25:07.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:25:07.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:25:07.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:25:07.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:25:07.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:25:07.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:07.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:07.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:25:07.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:25:07.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:07.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:25:08.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:25:08.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:25:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:25:08.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:25:08.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:25:08.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:08.470 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:08.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:25:08.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:25:08.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:25:08.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:25:08.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:25:08.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:25:08.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:08.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:25:09.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:25:09.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:09.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:09.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:25:09.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:25:09.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:25:09.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:25:09.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:25:09.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:25:09.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:25:09.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:25:09.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:09.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:09.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:25:09.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:09.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:25:10.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:25:10.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:25:10.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:25:10.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:25:10.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:25:10.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:25:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:10.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:25:10.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:25:10.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:25:10.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:10.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:25:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:25:11.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:25:11.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:25:11.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:25:11.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:11.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:11.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:25:11.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:25:11.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:25:11.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:25:11.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:25:11.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:25:11.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:25:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:25:12.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:12.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:12.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:25:12.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:25:12.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:25:12.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:25:12.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:25:12.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:25:12.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:25:12.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:25:12.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:12.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:12.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:25:12.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:12.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:25:13.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:25:13.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:25:13.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:25:13.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:25:13.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:25:13.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:25:13.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:13.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:13.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:25:13.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:25:13.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:25:13.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:25:13.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:25:13.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:25:13.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:13.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:25:14.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:25:14.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:14.168 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:14.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:25:14.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:25:14.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:25:14.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:25:14.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:25:14.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:25:14.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:25:14.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:25:14.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:14.887 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:14.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:25:14.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:14.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:25:15.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:25:15.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:25:15.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:25:15.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:25:15.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:25:15.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:25:15.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:15.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:15.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:25:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:25:15.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:25:15.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:25:15.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:15.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:25:16.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:25:16.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:25:16.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:25:16.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:16.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:16.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:25:16.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:25:16.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:25:16.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:25:16.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:25:16.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:25:16.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:16.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:25:17.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:25:17.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:17.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:17.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:25:17.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:25:17.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:25:17.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:25:17.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:25:17.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:25:17.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:25:17.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:25:17.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:17.733 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:17.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:25:17.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:25:17.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:17.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:25:18.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:25:18.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:25:18.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:25:18.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:25:18.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:25:18.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:18.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:18.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:25:18.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:25:18.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:25:18.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:25:18.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:25:18.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:18.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:25:19.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:25:19.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:25:19.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:19.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:19.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:25:19.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:25:19.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:25:19.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:25:19.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:25:19.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:25:19.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:25:19.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:25:19.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:19.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:19.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:19.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:25:20.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:25:20.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:25:20.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:25:20.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:25:20.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:25:20.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:25:20.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:25:20.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:20.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:20.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:25:20.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:25:20.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:25:20.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:20.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:25:21.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:21.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:25:21.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:21.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:25:21.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:21.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:25:21.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:21.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:25:22.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:22.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:22.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:25:22.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:25:22.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:25:22.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:25:22.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:25:22.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:25:22.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:25:22.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:25:22.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:22.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:22.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:25:22.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:25:22.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:22.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:25:23.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:25:23.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:25:23.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:25:23.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:25:23.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:25:23.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:23.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:23.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:25:23.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:25:23.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:25:23.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:25:23.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:25:23.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:25:23.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:23.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:25:24.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:25:24.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:24.107 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:24.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:25:24.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:25:24.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:25:24.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:25:24.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:25:24.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:25:24.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:25:24.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:25:24.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:24.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:24.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:25:24.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:24.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:25:25.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:25:25.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:25:25.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:25:25.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:25:25.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:25:25.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:25:25.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:25.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:25.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:25:25.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:25:25.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:25:25.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:25.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:25:26.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:25:26.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:25:26.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:25:26.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:25:26.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:26.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:26.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:25:26.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:25:26.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:25:26.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:25:26.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:25:26.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:25:26.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:26.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:25:27.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:25:27.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:27.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:27.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:25:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:25:27.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:25:27.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:25:27.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:25:27.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:25:27.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:25:27.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:25:27.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:27.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:27.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:25:27.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:27.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:25:28.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:25:28.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:25:28.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:25:28.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:25:28.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:25:28.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:25:28.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:28.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:28.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:25:28.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:25:28.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:25:28.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:25:28.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:28.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:25:29.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:25:29.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:25:29.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:25:29.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:29.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:29.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:25:29.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:25:29.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:25:29.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:25:29.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:25:29.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:25:29.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:25:29.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:29.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:25:30.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:30.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:30.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:25:30.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:25:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:25:30.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:25:30.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:25:30.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:25:30.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:25:30.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:25:30.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:30.776 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:30.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:25:30.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:25:30.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:30.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:25:31.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:25:31.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:25:31.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:25:31.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:25:31.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:25:31.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:31.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:31.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:25:31.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:25:31.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:25:31.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:25:31.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:25:31.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:25:31.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:31.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:25:32.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:25:32.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:32.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:32.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:25:32.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:25:32.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:25:32.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:25:32.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:25:32.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:25:32.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:25:32.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:25:32.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:32.895 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:32.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:25:32.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:32.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:25:33.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:25:33.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:25:33.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:25:33.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:25:33.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:25:33.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:25:33.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:33.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:33.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:25:33.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:25:33.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:25:33.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:25:33.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:33.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:25:34.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:25:34.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:25:34.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:25:34.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:34.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:34.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:25:34.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:25:34.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:25:34.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:25:34.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:25:34.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:25:34.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:34.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:25:35.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:25:35.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:35.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:35.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:25:35.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:25:35.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:25:35.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:25:35.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:25:35.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:25:35.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:25:35.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:25:35.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:35.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:35.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:25:35.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:35.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:25:36.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:25:36.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:25:36.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:25:36.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:25:36.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:25:36.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:25:36.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:36.569 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:36.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:25:36.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:25:36.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:25:36.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:25:36.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:36.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:25:37.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:25:37.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:25:37.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:25:37.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:37.288 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:37.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:25:37.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:25:37.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:25:37.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:25:37.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:25:37.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:25:37.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:25:37.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:37.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:25:38.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:38.024 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:38.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:25:38.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:25:38.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:25:38.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:25:38.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:25:38.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:25:38.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:25:38.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:25:38.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:38.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:38.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:25:38.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:25:38.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:38.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:25:39.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:25:39.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:25:39.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:25:39.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:25:39.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:25:39.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:39.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:39.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:25:39.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:25:39.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:25:39.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:25:39.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:25:39.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:39.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:25:40.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:25:40.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:25:40.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:40.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:40.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:25:40.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:25:40.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:25:40.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:25:40.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:25:40.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:25:40.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:25:40.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:25:40.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:40.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:40.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:40.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:25:41.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:25:41.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:25:41.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:25:41.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:25:41.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:25:41.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:25:41.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:25:41.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:41.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:41.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:25:41.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:25:41.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:41.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:25:41.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:25:42.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:25:42.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:25:42.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:25:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:25:42.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:42.484 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:42.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:25:42.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:25:42.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:25:42.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:25:42.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:25:42.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:42.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:25:43.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:25:43.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:25:43.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:43.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:43.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:25:43.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:25:43.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:25:43.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:25:43.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:25:43.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:25:43.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:25:43.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:25:43.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:43.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:43.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:43.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:25:44.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:25:44.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:25:44.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:25:44.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:25:44.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:25:44.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:25:44.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:25:44.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:44.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:44.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:25:44.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:25:44.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:25:44.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:25:44.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:44.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:25:45.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:25:45.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:25:45.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:25:45.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:45.337 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:45.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:25:45.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:25:45.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:25:45.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:25:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:25:45.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:25:45.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:25:45.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:45.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:25:46.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:46.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:46.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:25:46.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:25:46.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:25:46.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:25:46.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:25:46.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:25:46.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:25:46.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:25:46.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:46.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:46.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:25:46.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:25:46.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:46.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:25:47.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:25:47.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:25:47.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:25:47.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:25:47.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:25:47.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:47.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:47.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:25:47.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:25:47.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:25:47.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:25:47.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:25:47.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:47.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:25:48.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:25:48.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:25:48.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:48.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:48.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:25:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:25:48.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:25:48.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:25:48.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:25:48.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:25:48.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:25:48.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:25:48.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:48.920 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:48.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:48.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:25:49.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:25:49.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:25:49.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:25:49.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:25:49.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:25:49.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:25:49.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:25:49.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:49.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:49.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:25:49.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:25:49.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:25:49.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:49.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:25:50.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:25:50.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:25:50.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:25:50.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:25:50.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:50.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:50.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:25:50.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:25:50.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:25:50.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:25:50.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:25:50.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:25:50.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:50.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:25:51.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:25:51.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:51.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:51.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:25:51.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:25:51.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:25:51.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:25:51.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:25:51.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:25:51.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:25:51.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:25:51.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:51.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:51.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:25:51.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:51.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:25:52.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:52.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:25:52.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:52.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:25:52.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:52.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:25:52.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:52.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:25:52.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:52.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:25:52.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:52.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:25:53.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:53.285 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:53.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:25:53.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:25:53.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:25:53.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:25:53.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:25:53.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:25:53.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:25:53.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:25:53.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:53.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:53.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:53.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:25:54.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:25:54.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:25:54.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:25:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:25:54.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:25:54.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:25:54.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:25:54.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:54.700 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:54.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:25:54.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:25:54.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:25:54.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:54.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:25:55.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:25:55.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:25:55.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:25:55.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:25:55.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:55.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:25:55.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:25:55.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:25:55.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:25:55.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:25:55.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:25:55.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:55.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:25:56.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:25:56.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:56.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:56.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:25:56.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:25:56.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:25:56.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:25:56.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:25:56.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:25:56.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:25:56.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:25:56.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:56.858 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:56.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:25:56.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:56.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:25:57.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:25:57.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:25:57.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:25:57.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:25:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:25:57.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:25:57.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:57.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:57.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:25:57.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:25:57.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:25:57.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:25:57.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:25:57.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:57.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:25:58.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:25:58.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:25:58.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:58.230 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:58.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:25:58.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:25:58.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:25:58.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:25:58.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:25:58.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:25:58.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:25:58.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:58.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:25:59.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:59.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:59.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:25:59.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:25:59.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:25:59.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:25:59.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:25:59.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:25:59.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:25:59.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:25:59.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:25:59.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:25:59.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:25:59.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:25:59.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:25:59.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:26:00.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:26:00.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:26:00.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:26:00.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:26:00.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:26:00.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:00.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:00.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:26:00.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:26:00.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:26:00.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:26:00.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:26:00.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:00.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:26:01.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:26:01.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:26:01.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:01.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:01.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:26:01.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:26:01.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:26:01.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:26:01.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:26:01.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:26:01.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:26:01.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:26:01.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:01.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:01.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:01.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:26:02.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:26:02.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:26:02.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:26:02.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:26:02.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:26:02.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:26:02.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:26:02.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:02.641 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:02.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:26:02.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:26:02.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:26:02.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:26:02.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:02.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:26:03.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:26:03.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:26:03.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:26:03.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:03.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:03.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:26:03.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:26:03.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:26:03.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:26:03.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:26:03.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:26:03.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:26:03.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:03.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:26:04.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:04.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:04.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:26:04.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:26:04.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:26:04.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:26:04.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:26:04.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:26:04.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:26:04.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:26:04.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:04.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:04.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:26:04.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:26:04.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:04.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:26:05.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:26:05.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:26:05.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:26:05.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:26:05.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:26:05.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:05.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:05.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:26:05.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:26:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:26:05.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:26:05.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:26:05.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:26:05.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:05.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:26:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:26:06.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:06.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:06.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:26:06.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:26:06.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:26:06.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:26:06.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:26:06.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:26:06.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:26:06.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:26:06.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:06.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:06.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:26:06.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:06.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:26:07.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:26:07.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:26:07.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:26:07.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:26:07.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:26:07.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:26:07.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:07.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:07.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:26:07.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:26:07.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:26:07.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:26:07.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:26:07.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:07.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:26:08.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:26:08.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:26:08.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:08.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:08.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:26:08.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:26:08.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:26:08.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:26:08.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:26:08.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:26:08.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:26:08.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:26:08.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:08.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:08.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:08.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:26:09.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:26:09.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:26:09.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:26:09.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:26:09.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:26:09.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:26:09.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:09.653 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:09.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:26:09.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:26:09.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:26:09.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:09.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:26:10.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:26:10.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:26:10.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:26:10.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:26:10.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:10.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:10.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:26:10.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:26:10.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:26:10.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:26:10.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:26:10.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:26:10.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:10.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:26:11.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:26:11.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:11.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:11.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:26:11.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:26:11.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:26:11.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:26:11.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:26:11.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:26:11.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:26:11.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:26:11.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:11.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:11.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:26:11.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:11.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:26:12.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:26:12.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:26:12.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:26:12.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:26:12.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:26:12.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:26:12.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:12.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:12.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:26:12.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:26:12.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:26:12.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:26:12.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:26:12.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:12.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:26:13.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:26:13.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:26:13.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:13.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:13.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:26:13.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:26:13.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:26:13.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:26:13.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:26:13.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:26:13.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:26:13.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:13.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:26:14.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:14.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:14.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:26:14.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:26:14.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:26:14.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:26:14.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:26:14.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:26:14.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:26:14.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:26:14.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:14.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:14.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:26:14.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:26:14.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:14.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:26:15.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:26:15.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:26:15.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:26:15.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:26:15.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:26:15.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:15.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:15.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:26:15.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:26:15.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:26:15.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:26:15.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:26:15.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:26:15.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:15.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:26:16.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:26:16.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:16.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:16.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:26:16.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:26:16.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:26:16.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:26:16.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:26:16.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:26:16.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:26:16.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:26:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:16.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:16.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:26:16.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:16.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:26:17.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:26:17.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:26:17.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:26:17.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:26:17.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:26:17.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:26:17.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:17.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:17.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:26:17.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:26:17.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:26:17.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:26:17.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:17.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:26:18.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:26:18.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:26:18.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:26:18.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:18.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:18.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:26:18.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:26:18.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:26:18.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:26:18.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:26:18.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:26:18.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:26:18.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:18.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:26:19.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:19.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:19.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:26:19.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:26:19.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:26:19.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:26:19.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:26:19.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:26:19.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:26:19.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:26:19.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:19.771 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:19.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:26:19.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:19.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:26:20.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:26:20.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:26:20.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:26:20.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:26:20.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:26:20.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:26:20.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:20.581 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:20.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:26:20.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:26:20.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:26:20.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:26:20.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:20.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:26:21.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:26:21.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:26:21.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:26:21.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:21.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:21.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:26:21.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:26:21.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:26:21.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:26:21.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:26:21.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:26:21.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:26:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:26:21.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:21.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:21.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:21.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:26:22.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:26:22.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:26:22.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:26:22.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:26:22.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:26:22.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:26:22.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:26:22.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:22.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:22.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:26:22.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:26:22.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:22.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:26:23.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:26:23.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:26:23.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:26:23.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:26:23.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:26:23.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:23.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:23.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:26:23.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:26:23.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:26:23.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:26:23.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:26:23.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:23.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:26:24.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:24.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:26:24.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:24.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:26:25.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:25.008 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:25.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:26:25.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:26:25.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:26:25.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:26:25.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:26:25.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:26:25.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:26:25.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:26:25.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:25.701 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:25.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:26:25.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:26:25.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:26:25.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:25.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:26:26.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:26:26.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:26:26.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:26:26.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:26:26.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:26.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:26.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:26:26.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:26:26.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:26:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:26:26.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:26:26.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:26:26.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:26.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:26:27.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:26:27.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:27.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:27.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:26:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:26:27.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:26:27.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:26:27.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:26:27.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:26:27.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:26:27.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:26:27.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:27.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:27.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:26:27.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:27.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:26:28.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:26:28.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:26:28.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:26:28.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:26:28.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:26:28.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:26:28.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:28.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:28.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:26:28.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:26:28.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:26:28.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:26:28.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:28.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:26:29.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:26:29.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:26:29.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:26:29.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:29.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:29.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:26:29.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:26:29.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:26:29.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:26:29.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:26:29.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:26:29.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:26:29.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:26:29.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:29.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:29.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:29.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:26:30.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:26:30.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:26:30.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:26:30.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:26:30.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:26:30.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:26:30.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:26:30.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:30.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:30.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:26:30.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:26:30.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:26:30.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:30.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:26:31.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:26:31.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:26:31.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:26:31.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:26:31.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:31.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:31.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:26:31.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:26:31.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:26:31.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:26:31.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:26:31.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:26:31.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:31.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:26:32.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:26:32.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:32.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:32.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:26:32.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:26:32.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:26:32.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:26:32.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:26:32.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:26:32.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:26:32.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:26:32.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:32.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:32.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:26:32.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:26:32.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:32.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:26:33.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:26:33.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:26:33.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:26:33.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:26:33.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:26:33.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:33.484 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:33.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:26:33.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:26:33.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:26:33.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:26:33.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:26:33.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:33.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:26:34.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:26:34.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:26:34.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:34.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:34.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:26:34.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:26:34.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:26:34.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:26:34.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:26:34.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:26:34.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:26:34.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:34.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:26:35.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:35.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:35.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:26:35.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:26:35.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:26:35.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:26:35.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:26:35.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:26:35.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:26:35.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:26:35.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:35.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:35.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:26:35.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:26:35.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:35.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:26:36.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:26:36.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:26:36.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:26:36.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:26:36.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:26:36.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:36.511 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:36.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:26:36.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:26:36.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:26:36.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:26:36.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:26:36.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:36.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:26:37.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:26:37.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:26:37.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:37.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:37.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:26:37.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:26:37.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:26:37.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:26:37.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:26:37.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:26:37.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:26:37.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:26:37.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:37.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:37.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:37.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:26:38.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:26:38.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:26:38.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:26:38.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:26:38.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:26:38.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:26:38.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:26:38.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:38.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:38.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:26:38.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:26:38.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:26:38.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:38.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:26:39.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:26:39.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:26:39.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:26:39.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:26:39.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:39.390 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:39.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:26:39.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:26:39.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:26:39.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:26:39.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:26:39.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:26:39.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:39.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:26:40.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:26:40.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:40.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:40.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:26:40.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:26:40.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:26:40.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:26:40.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:26:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:26:40.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:26:40.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:26:40.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:40.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:40.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:40.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:26:41.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:26:41.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:26:41.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:26:41.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:26:41.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:26:41.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:26:41.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:26:41.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:41.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:41.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:26:41.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:26:41.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:26:41.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:26:41.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:41.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:26:42.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:26:42.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:26:42.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:26:42.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:42.344 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:42.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:26:42.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:26:42.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:26:42.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:26:42.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:26:42.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:26:42.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:26:42.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:42.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:26:43.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:43.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:43.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:26:43.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:26:43.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:26:43.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:26:43.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:26:43.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:26:43.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:26:43.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:26:43.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:43.755 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:43.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:26:43.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:26:43.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:43.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:26:44.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:26:44.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:26:44.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:26:44.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:26:44.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:26:44.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:44.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:44.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:26:44.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:26:44.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:26:44.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:26:44.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:26:44.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:26:44.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:44.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:26:45.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:26:45.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:45.172 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:45.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:26:45.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:26:45.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:26:45.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:26:45.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:26:45.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:26:45.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:26:45.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:26:45.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:45.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:45.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:26:45.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:45.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:26:46.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:26:46.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:26:46.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:26:46.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:26:46.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:26:46.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:26:46.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:46.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:46.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:26:46.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:26:46.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:26:46.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:26:46.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:46.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:26:47.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:26:47.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:26:47.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:26:47.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:47.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:47.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:26:47.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:26:47.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:26:47.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:26:47.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:26:47.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:26:47.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:26:47.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:47.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:26:48.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:48.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:48.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:26:48.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:26:48.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:26:48.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:26:48.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:26:48.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:26:48.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:26:48.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:26:48.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:48.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:48.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:26:48.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:26:48.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:48.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:26:49.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:26:49.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:26:49.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:26:49.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:26:49.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:26:49.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:49.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:49.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:26:49.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:26:49.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:26:49.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:26:49.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:26:49.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:26:49.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:49.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:26:50.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:26:50.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:50.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:50.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:26:50.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:26:50.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:26:50.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:26:50.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:26:50.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:26:50.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:26:50.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:26:50.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:50.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:50.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:26:50.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:50.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:26:51.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:26:51.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:26:51.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:26:51.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:26:51.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:26:51.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:26:51.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:51.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:26:51.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:26:51.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:26:51.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:26:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:51.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:26:52.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:26:52.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:26:52.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:26:52.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:52.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:52.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:26:52.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:26:52.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:26:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:26:52.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:26:52.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:26:52.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:26:52.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:52.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:26:53.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:53.065 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:53.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:26:53.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:26:53.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:26:53.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:26:53.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:26:53.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:26:53.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:26:53.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:26:53.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:53.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:53.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:26:53.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:26:53.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:26:53.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:53.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:26:54.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:26:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:26:54.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:26:54.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:26:54.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:54.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:54.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:26:54.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:26:54.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:26:54.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:26:54.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:26:54.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:26:54.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:54.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:26:55.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:55.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:26:55.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:55.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:55.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:55.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:26:55.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:55.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:26:55.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:55.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:26:55.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:55.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:26:55.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:55.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:26:56.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:56.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:26:56.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:56.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:26:56.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:56.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:26:56.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:56.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:56.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:56.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:26:56.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:56.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:26:56.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:56.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:26:56.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:56.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:26:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:26:57.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:26:57.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:26:57.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:26:57.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:57.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:57.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:26:57.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:26:57.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:26:57.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:26:57.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:26:57.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:26:57.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:26:57.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:26:57.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:57.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:57.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:57.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:26:58.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:26:58.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:26:58.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:26:58.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:26:58.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:26:58.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:26:58.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:26:58.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:58.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:58.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:26:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:26:58.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:26:58.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:58.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:26:59.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:26:59.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:26:59.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:26:59.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:26:59.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:26:59.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:26:59.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:26:59.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:26:59.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:26:59.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:26:59.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:26:59.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:26:59.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:26:59.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:27:00.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:27:00.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:00.126 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:00.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:27:00.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:27:00.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:27:00.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:27:00.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:27:00.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:27:00.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:27:00.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:27:00.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:00.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:00.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:27:00.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:00.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:27:01.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:27:01.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:27:01.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:27:01.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:27:01.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:27:01.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:27:01.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:01.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:01.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:27:01.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:27:01.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:27:01.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:01.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:27:02.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:27:02.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:27:02.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:27:02.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:27:02.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:02.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:02.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:27:02.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:27:02.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:27:02.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:27:02.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:27:02.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:27:02.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:27:02.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:02.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:27:03.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:03.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:03.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:27:03.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:27:03.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:27:03.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:27:03.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:27:03.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:27:03.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:27:03.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:27:03.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:03.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:03.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:27:03.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:27:03.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:27:03.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:03.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:27:04.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:27:04.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:27:04.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:27:04.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:27:04.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:04.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:04.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:27:04.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:27:04.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:27:04.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:27:04.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:27:04.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:27:04.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:04.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:27:05.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:27:05.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:05.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:05.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:27:05.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:27:05.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:27:05.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:27:05.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:27:05.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:27:05.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:27:05.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:27:05.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:05.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:05.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:27:05.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:05.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:27:06.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:27:06.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:27:06.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:27:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:27:06.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:27:06.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:27:06.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:06.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:06.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:27:06.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:27:06.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:27:06.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:27:06.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:06.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:27:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:27:07.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:27:07.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:27:07.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:07.329 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:07.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:27:07.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:27:07.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:27:07.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:27:07.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:27:07.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:27:07.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:27:07.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:07.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:27:08.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:08.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:08.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:27:08.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:27:08.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:27:08.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:27:08.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:27:08.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:27:08.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:27:08.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:27:08.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:08.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:08.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:27:08.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:08.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:27:08.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:27:09.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:27:09.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:27:09.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:27:09.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:27:09.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:27:09.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:09.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:09.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:27:09.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:27:09.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:27:09.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:27:09.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:27:09.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:09.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:27:10.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:27:10.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:27:10.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:10.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:10.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:27:10.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:27:10.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:27:10.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:27:10.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:27:10.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:27:10.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:27:10.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:27:10.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:10.996 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:10.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:10.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:27:11.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:27:11.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:27:11.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:27:11.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:27:11.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:27:11.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:27:11.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:27:11.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:11.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:11.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:27:11.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:27:11.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:27:11.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:11.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:27:12.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:27:12.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:27:12.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:27:12.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:27:12.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:12.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:12.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:27:12.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:27:12.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:27:12.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:27:12.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:27:12.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:27:12.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:12.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:27:13.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:27:13.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:13.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:13.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:27:13.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:27:13.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:27:13.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:27:13.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:27:13.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:27:13.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:27:13.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:27:13.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:13.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:13.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:27:13.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:13.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:27:14.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:27:14.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:27:14.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:27:14.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:27:14.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:27:14.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:27:14.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:14.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:14.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:27:14.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:27:14.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:27:14.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:27:14.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:14.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:27:15.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:27:15.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:27:15.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:27:15.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:15.253 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:15.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:27:15.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:27:15.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:27:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:27:15.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:27:15.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:27:15.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:27:15.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:27:15.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:15.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:15.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:15.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:27:16.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:27:16.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:27:16.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:27:16.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:27:16.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:27:16.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:27:16.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:27:16.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:16.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:16.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:27:16.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:27:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:27:16.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:16.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:27:17.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:27:17.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:27:17.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:27:17.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:27:17.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:17.404 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:17.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:27:17.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:27:17.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:27:17.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:27:17.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:27:17.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:27:17.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:17.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:27:18.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:27:18.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:27:18.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:27:18.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:27:18.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:27:18.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:27:18.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:27:18.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:27:18.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:18.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:18.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:27:18.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:18.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:27:19.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:27:19.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:27:19.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:27:19.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:27:19.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:27:19.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:27:19.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:19.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:19.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:27:19.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:27:19.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:27:19.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:27:19.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:19.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:27:20.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:27:20.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:27:20.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:27:20.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:20.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:20.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:27:20.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:27:20.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:27:20.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:27:20.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:27:20.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:27:20.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:27:20.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:27:20.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:20.953 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:20.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:27:21.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:27:21.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:27:21.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:27:21.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:27:21.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:27:21.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:27:21.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:27:21.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:21.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:21.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:27:21.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:27:21.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:27:21.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:27:21.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:21.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:27:22.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:27:22.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:27:22.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:27:22.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:22.351 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:22.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:27:22.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:27:22.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:27:22.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:27:22.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:27:22.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:27:22.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:27:22.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:22.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:27:23.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:23.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:23.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:27:23.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:27:23.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:27:23.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:27:23.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:27:23.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:27:23.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:27:23.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:27:23.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:23.732 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:23.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:27:23.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:27:23.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:27:23.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:23.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:27:24.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:27:24.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:27:24.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:27:24.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:27:24.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:24.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:24.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:27:24.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:27:24.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:27:24.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:27:24.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:27:24.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:27:24.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:24.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:27:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:27:25.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:25.138 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:25.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:27:25.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:27:25.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:27:25.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:27:25.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:27:25.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:27:25.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:27:25.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:27:25.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:25.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:25.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:27:25.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:25.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:27:26.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:27:26.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:27:26.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:27:26.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:27:26.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:27:26.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:27:26.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:26.587 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:26.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:27:26.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:27:26.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:27:26.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:27:26.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:26.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:27:27.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:27.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:27:27.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:27.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:27:27.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:27.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:27:27.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:27.874 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:27.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:27.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:27:27.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:27.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:27:28.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:27:28.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:27:28.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:27:28.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:27:28.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:27:28.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:27:28.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:28.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:28.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:27:28.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:27:28.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:27:28.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:27:28.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:28.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:27:29.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:27:29.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:27:29.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:27:29.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:29.279 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:29.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:27:29.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:27:29.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:27:29.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:27:29.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:27:29.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:27:29.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:27:29.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:27:29.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:29.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:29.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:29.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:27:30.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:27:30.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:27:30.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:27:30.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:27:30.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:27:30.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:27:30.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:27:30.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:30.718 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:30.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:27:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:27:30.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:27:30.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:30.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:27:31.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:27:31.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:27:31.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:27:31.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:27:31.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:31.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:31.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:27:31.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:27:31.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:27:31.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:27:31.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:27:31.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:27:31.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:31.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:27:32.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:27:32.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:32.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:27:32.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:27:32.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:27:32.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:27:32.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:27:32.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:27:32.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:27:32.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:27:32.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:32.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:32.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:32.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:27:33.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:27:33.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:27:33.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:27:33.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:27:33.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:27:33.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:27:33.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:27:33.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:33.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:33.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:27:33.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:27:33.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:27:33.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:33.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:27:34.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:27:34.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:27:34.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:27:34.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:27:34.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:34.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:34.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:27:34.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:27:34.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:27:34.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:27:34.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:27:34.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:27:34.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:34.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:27:35.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:27:35.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:35.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:35.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:27:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:27:35.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:27:35.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:27:35.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:27:35.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:27:35.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:27:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:27:35.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:35.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:35.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:27:35.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:27:35.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:35.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:27:36.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:27:36.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:27:36.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:27:36.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:27:36.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:27:36.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:36.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:36.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:27:36.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:27:36.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:27:36.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:27:36.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:27:36.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:27:36.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:36.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:27:37.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:27:37.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:37.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:37.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:27:37.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:27:37.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:27:37.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:27:37.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:27:37.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:27:37.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:27:37.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:27:37.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:37.879 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:37.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:37.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:27:38.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:27:38.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:27:38.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:27:38.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:27:38.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:27:38.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:27:38.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:27:38.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:38.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:38.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:27:38.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:27:38.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:27:38.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:27:38.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:38.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:27:39.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:27:39.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:27:39.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:27:39.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:39.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:39.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:27:39.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:27:39.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:27:39.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:27:39.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:27:39.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:27:39.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:27:39.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:27:39.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:39.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:39.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:39.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:27:40.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:27:40.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:27:40.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:27:40.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:27:40.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:27:40.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:27:40.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:27:40.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:40.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:40.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:27:40.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:27:40.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:27:40.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:40.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:27:41.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:27:41.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:27:41.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:27:41.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:27:41.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:41.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:41.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:27:41.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:27:41.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:27:41.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:27:41.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:27:41.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:27:41.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:41.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:27:42.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:27:42.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:42.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:42.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:27:42.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:27:42.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:27:42.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:27:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:27:42.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:27:42.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:27:42.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:27:42.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:42.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:42.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:27:42.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:42.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:27:43.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:27:43.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:27:43.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:27:43.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:27:43.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:27:43.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:27:43.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:43.563 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:43.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:27:43.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:27:43.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:27:43.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:27:43.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:43.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:27:44.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:27:44.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:27:44.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:27:44.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:44.290 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:44.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:27:44.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:27:44.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:27:44.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:27:44.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:27:44.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:27:44.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:27:44.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:44.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:27:45.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:45.010 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:45.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:27:45.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:27:45.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:27:45.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:27:45.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:27:45.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:27:45.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:27:45.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:27:45.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:45.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:45.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:27:45.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:27:45.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:27:45.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:45.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:27:46.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:27:46.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:27:46.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:27:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:27:46.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:46.492 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:46.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:27:46.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:27:46.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:27:46.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:27:46.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:27:46.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:27:46.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:46.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:27:47.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:27:47.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:47.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:47.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:27:47.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:27:47.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:27:47.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:27:47.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:27:47.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:27:47.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:27:47.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:27:47.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:47.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:47.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:27:47.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:47.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:27:48.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:27:48.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:27:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:27:48.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:27:48.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:27:48.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:27:48.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:48.691 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:48.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:27:48.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:27:48.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:27:48.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:48.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:27:49.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:27:49.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:27:49.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:27:49.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:27:49.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:49.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:49.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:27:49.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:27:49.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:27:49.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:27:49.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:27:49.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:27:49.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:27:49.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:49.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:27:50.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:50.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:50.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:27:50.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:27:50.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:27:50.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:27:50.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:27:50.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:27:50.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:27:50.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:27:50.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:50.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:50.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:27:50.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:27:50.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:50.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:27:51.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:27:51.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:27:51.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:27:51.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:27:51.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:27:51.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:51.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:51.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:27:51.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:27:51.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:27:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:27:51.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:27:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:27:52.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:27:52.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:27:52.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:52.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:52.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:27:52.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:27:52.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:27:52.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:27:52.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:27:52.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:27:52.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:27:52.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:27:52.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:52.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:52.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:52.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:27:53.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:27:53.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:27:53.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:27:53.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:27:53.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:27:53.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:27:53.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:27:53.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:53.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:53.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:27:53.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:27:53.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:27:53.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:53.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:27:54.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:27:54.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:27:54.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:27:54.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:27:54.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:54.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:54.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:27:54.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:27:54.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:27:54.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:27:54.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:27:54.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:27:54.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:54.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:27:55.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:27:55.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:55.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:55.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:27:55.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:27:55.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:27:55.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:27:55.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:27:55.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:27:55.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:27:55.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:27:55.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:55.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:55.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:27:55.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:55.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:27:56.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:27:56.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:27:56.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:27:56.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:27:56.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:27:56.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:27:56.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:56.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:56.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:27:56.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:27:56.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:27:56.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:27:56.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:56.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:27:57.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:27:57.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:27:57.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:27:57.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:57.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:57.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:27:57.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:27:57.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:27:57.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:27:57.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:27:57.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:27:57.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:27:57.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:57.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:27:58.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:58.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:58.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:58.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:27:58.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:58.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:27:58.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:58.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:27:58.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:58.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:27:58.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:58.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:27:59.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:27:59.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:27:59.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:27:59.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:27:59.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:27:59.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:27:59.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:27:59.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:27:59.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:27:59.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:27:59.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:27:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:27:59.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:27:59.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:28:00.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:00.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:00.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:28:00.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:28:00.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:28:00.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:28:00.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:28:00.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:28:00.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:28:00.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:28:00.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:00.773 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:00.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:28:00.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:28:00.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:00.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:28:01.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:28:01.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:28:01.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:28:01.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:28:01.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:28:01.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:01.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:01.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:28:01.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:28:01.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:28:01.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:28:01.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:28:01.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:01.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:28:02.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:28:02.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:28:02.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:02.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:02.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:28:02.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:28:02.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:28:02.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:28:02.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:28:02.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:28:02.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:28:02.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:28:02.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:02.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:02.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:02.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:28:03.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:28:03.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:28:03.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:28:03.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:28:03.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:28:03.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:28:03.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:28:03.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:03.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:03.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:28:03.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:28:03.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:28:03.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:28:03.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:03.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:28:04.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:28:04.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:28:04.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:28:04.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:04.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:28:04.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:28:04.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:28:04.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:28:04.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:28:04.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:28:04.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:04.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:28:05.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:28:05.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:05.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:05.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:28:05.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:28:05.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:28:05.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:28:05.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:28:05.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:28:05.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:28:05.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:28:05.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:05.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:05.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:28:05.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:28:05.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:05.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:28:06.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:28:06.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:28:06.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:28:06.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:28:06.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:28:06.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:06.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:06.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:28:06.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:28:06.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:28:06.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:28:06.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:28:06.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:28:06.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:06.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:28:07.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:28:07.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:07.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:07.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:28:07.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:28:07.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:28:07.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:28:07.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:28:07.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:28:07.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:28:07.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:28:07.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:07.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:07.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:28:07.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:07.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:28:08.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:28:08.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:28:08.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:28:08.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:28:08.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:28:08.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:28:08.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:08.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:08.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:28:08.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:28:08.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:28:08.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:28:08.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:28:08.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:08.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:28:09.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:28:09.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:28:09.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:09.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:09.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:28:09.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:28:09.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:28:09.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:28:09.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:28:09.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:28:09.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:28:09.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:28:09.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:09.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:09.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:09.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:28:10.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:28:10.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:28:10.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:28:10.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:28:10.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:28:10.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:28:10.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:28:10.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:10.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:10.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:28:10.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:28:10.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:28:10.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:10.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:28:11.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:28:11.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:28:11.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:28:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:28:11.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:11.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:11.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:28:11.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:28:11.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:28:11.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:28:11.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:28:11.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:28:11.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:28:11.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:11.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:28:12.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:12.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:12.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:28:12.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:28:12.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:28:12.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:28:12.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:28:12.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:28:12.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:28:12.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:28:12.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:12.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:12.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:28:12.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:28:12.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:12.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:28:13.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:28:13.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:28:13.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:28:13.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:28:13.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:28:13.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:13.507 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:13.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:28:13.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:28:13.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:28:13.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:28:13.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:28:13.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:13.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:28:14.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:28:14.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:28:14.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:14.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:14.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:28:14.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:28:14.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:28:14.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:28:14.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:28:14.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:28:14.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:28:14.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:28:14.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:14.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:14.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:14.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:28:15.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:28:15.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:28:15.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:28:15.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:28:15.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:28:15.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:28:15.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:28:15.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:15.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:15.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:28:15.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:28:15.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:28:15.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:28:15.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:15.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:28:16.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:28:16.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:28:16.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:28:16.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:16.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:16.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:28:16.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:28:16.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:28:16.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:28:16.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:28:16.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:28:16.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:28:16.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:16.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:28:17.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:17.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:17.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:28:17.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:28:17.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:28:17.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:28:17.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:28:17.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:28:17.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:28:17.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:28:17.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:17.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:17.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:28:17.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:28:17.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:17.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:28:18.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:28:18.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:28:18.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:28:18.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:28:18.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:28:18.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:18.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:18.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:28:18.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:28:18.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:28:18.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:28:18.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:28:18.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:18.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:28:19.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:28:19.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:28:19.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:19.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:19.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:28:19.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:28:19.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:28:19.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:28:19.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:28:19.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:28:19.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:28:19.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:28:19.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:19.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:19.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:19.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:28:20.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:28:20.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:28:20.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:28:20.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:28:20.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:28:20.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:28:20.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:28:20.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:20.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:20.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:28:20.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:28:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:28:20.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:20.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:28:21.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:28:21.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:28:21.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:28:21.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:28:21.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:21.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:21.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:28:21.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:28:21.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:28:21.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:28:21.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:28:21.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:28:21.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:21.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:28:22.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:28:22.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:22.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:22.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:28:22.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:28:22.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:28:22.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:28:22.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:28:22.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:28:22.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:28:22.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:22.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:28:23.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:23.024 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:23.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:28:23.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:28:23.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:28:23.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:28:23.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:28:23.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:28:23.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:28:23.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:28:23.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:23.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:23.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:28:23.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:28:23.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:28:23.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:23.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:28:24.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:28:24.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:28:24.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:28:24.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:28:24.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:24.472 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:24.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:28:24.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:28:24.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:28:24.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:28:24.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:28:24.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:28:24.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:24.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:28:25.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:28:25.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:25.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:25.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:28:25.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:28:25.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:28:25.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:28:25.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:28:25.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:28:25.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:28:25.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:28:25.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:25.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:25.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:28:25.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:25.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:28:26.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:28:26.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:28:26.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:28:26.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:28:26.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:28:26.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:28:26.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:26.579 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:26.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:28:26.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:28:26.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:28:26.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:28:26.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:28:26.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:26.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:28:27.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:28:27.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:28:27.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:27.215 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:28:27.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:28:27.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:28:27.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:28:27.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:28:27.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:28:27.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:28:27.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:28:27.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:27.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:27.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:28:27.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:27.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:28:28.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:28:28.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:28:28.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:28:28.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:28:28.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:28:28.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:28:28.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:28.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:28.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:28:28.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:28:28.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:28:28.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:28:28.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:28.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:28:29.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:28:29.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:28:29.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:28:29.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:29.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:29.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:28:29.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:28:29.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:28:29.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:28:29.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:28:29.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:28:29.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:28:29.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:29.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:28:30.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:30.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:30.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:30.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:28:30.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:30.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:28:31.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:28:31.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:28:31.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:28:31.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:28:31.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:28:31.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:28:31.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:31.541 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:31.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:28:31.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:28:31.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:28:31.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:28:31.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:31.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:28:32.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:28:32.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:28:32.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:28:32.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:32.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:32.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:28:32.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:28:32.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:28:32.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:28:32.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:28:32.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:28:32.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:28:32.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:32.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:28:33.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-05-08T18:28:33.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:33.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:33.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:28:33.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:33.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:28:33.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:33.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:28:33.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:33.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:28:33.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:33.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:28:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:28:33.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:33.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:28:33.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:33.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:28:33.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:224: TEST_backfill_test_multi: ceph pg dump pgs 2024-05-08T18:28:34.085 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:28:34.085 INFO:tasks.workunit.client.0.smithi117.stdout:8.0 599 0 0 0 0 2453504 0 0 99 500 99 active+clean 2024-05-08T18:20:34.867848+0000 146'599 146:622 [3] 3 [3] 3 0'0 2024-05-08T18:20:29.238631+0000 0'0 2024-05-08T18:20:29.238631+0000 0 0 periodic scrub scheduled @ 2024-05-09T18:38:03.032453+0000 0 0 2024-05-08T18:28:34.085 INFO:tasks.workunit.client.0.smithi117.stdout:7.0 598 0 0 0 0 2449408 0 0 98 500 98 active+clean 2024-05-08T18:20:29.390411+0000 146'598 146:629 [5] 5 [5] 5 0'0 2024-05-08T18:20:24.963842+0000 0'0 2024-05-08T18:20:24.963842+0000 0 0 periodic scrub scheduled @ 2024-05-09T23:38:04.924158+0000 0 0 2024-05-08T18:28:34.085 INFO:tasks.workunit.client.0.smithi117.stdout:6.0 595 0 0 0 0 2437120 0 0 95 500 95 active+clean 2024-05-08T18:20:25.342113+0000 146'595 146:637 [7] 7 [7] 7 0'0 2024-05-08T18:20:20.660291+0000 0'0 2024-05-08T18:20:20.660291+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:36:39.652495+0000 0 0 2024-05-08T18:28:34.086 INFO:tasks.workunit.client.0.smithi117.stdout:5.0 594 0 0 0 0 2433024 0 0 94 500 94 active+clean 2024-05-08T18:20:22.422956+0000 146'594 146:643 [12] 12 [12] 12 0'0 2024-05-08T18:20:16.074054+0000 0'0 2024-05-08T18:20:16.074054+0000 0 0 periodic scrub scheduled @ 2024-05-10T02:31:55.015190+0000 0 0 2024-05-08T18:28:34.086 INFO:tasks.workunit.client.0.smithi117.stdout:4.0 599 0 0 0 0 2453504 0 0 99 500 99 active+clean 2024-05-08T18:20:17.506095+0000 146'599 146:660 [4] 4 [4] 4 0'0 2024-05-08T18:20:12.645637+0000 0'0 2024-05-08T18:20:12.645637+0000 0 0 periodic scrub scheduled @ 2024-05-10T02:47:58.970362+0000 0 0 2024-05-08T18:28:34.086 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 597 0 0 0 0 2445312 0 0 97 500 97 active+clean 2024-05-08T18:20:12.503302+0000 146'597 146:673 [1] 1 [1] 1 0'0 2024-05-08T18:20:07.682264+0000 0'0 2024-05-08T18:20:07.682264+0000 0 0 periodic scrub scheduled @ 2024-05-09T22:35:55.768726+0000 0 0 2024-05-08T18:28:34.086 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 597 0 0 0 0 2445312 0 0 97 500 97 active+clean 2024-05-08T18:20:07.851234+0000 146'597 146:671 [17] 17 [17] 17 0'0 2024-05-08T18:20:03.678580+0000 0'0 2024-05-08T18:20:03.678580+0000 0 0 periodic scrub scheduled @ 2024-05-09T20:03:11.266948+0000 0 0 2024-05-08T18:28:34.086 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 596 0 0 0 0 2441216 0 0 96 500 96 active+clean 2024-05-08T18:20:04.277094+0000 146'596 146:689 [8] 8 [8] 8 0'0 2024-05-08T18:20:00.217803+0000 0'0 2024-05-08T18:20:00.217803+0000 0 0 periodic scrub scheduled @ 2024-05-09T23:46:08.097815+0000 0 0 2024-05-08T18:28:34.086 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:28:34.086 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:28:34.086 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:28:34.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:28:34.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:34.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test1 size 2 2024-05-08T18:28:34.785 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T18:28:34.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:34.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test2 size 2 2024-05-08T18:28:36.262 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 2 2024-05-08T18:28:36.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:36.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test3 size 2 2024-05-08T18:28:38.798 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 3 size to 2 2024-05-08T18:28:38.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:38.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test4 size 2 2024-05-08T18:28:42.198 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 4 size to 2 2024-05-08T18:28:42.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:42.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test5 size 2 2024-05-08T18:28:44.364 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 5 size to 2 2024-05-08T18:28:44.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:44.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test6 size 2 2024-05-08T18:28:46.631 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 6 size to 2 2024-05-08T18:28:46.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:46.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test7 size 2 2024-05-08T18:28:50.391 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 7 size to 2 2024-05-08T18:28:50.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-05-08T18:28:50.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test8 size 2 2024-05-08T18:28:54.402 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 8 size to 2 2024-05-08T18:28:54.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:230: TEST_backfill_test_multi: sleep 30 2024-05-08T18:29:24.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:232: TEST_backfill_test_multi: wait_for_not_backfilling 1200 2024-05-08T18:29:24.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-05-08T18:29:24.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-05-08T18:29:24.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-05-08T18:29:24.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:29:24.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:29:24.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-05-08T18:29:24.429 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:29:24.429 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:29:24.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:29:24.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:29:24.430 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:29:25.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-05-08T18:29:25.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:29:25.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:29:25.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:29:25.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:29:25.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:29:25.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:29:25.644 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:29:25.644 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:29:25.644 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:5 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:6 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:7 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:8 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:9 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:10 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:11 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:12 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:13 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:14 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:15 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:16 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:17 2024-05-08T18:29:25.645 INFO:tasks.workunit.client.0.smithi117.stderr:18 2024-05-08T18:29:25.646 INFO:tasks.workunit.client.0.smithi117.stderr:19' 2024-05-08T18:29:25.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:29:25.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:25.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:29:26.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836762 2024-05-08T18:29:26.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836762 2024-05-08T18:29:26.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762' 2024-05-08T18:29:26.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:26.058 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:29:26.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673235 2024-05-08T18:29:26.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673235 2024-05-08T18:29:26.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235' 2024-05-08T18:29:26.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:26.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:29:26.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509709 2024-05-08T18:29:26.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509709 2024-05-08T18:29:26.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709' 2024-05-08T18:29:26.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:26.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:29:26.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899346177 2024-05-08T18:29:26.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899346177 2024-05-08T18:29:26.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177' 2024-05-08T18:29:26.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:26.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:29:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182651 2024-05-08T18:29:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182651 2024-05-08T18:29:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651' 2024-05-08T18:29:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:27.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T18:29:27.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849019124 2024-05-08T18:29:27.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849019124 2024-05-08T18:29:27.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124' 2024-05-08T18:29:27.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:27.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2024-05-08T18:29:27.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=150323855593 2024-05-08T18:29:27.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 150323855593 2024-05-08T18:29:27.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593' 2024-05-08T18:29:27.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:27.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2024-05-08T18:29:27.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=171798692071 2024-05-08T18:29:27.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 171798692071 2024-05-08T18:29:27.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071' 2024-05-08T18:29:27.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:27.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2024-05-08T18:29:27.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=193273528539 2024-05-08T18:29:27.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 193273528539 2024-05-08T18:29:27.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539' 2024-05-08T18:29:27.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:27.913 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2024-05-08T18:29:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=214748365014 2024-05-08T18:29:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 214748365014 2024-05-08T18:29:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014' 2024-05-08T18:29:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:28.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2024-05-08T18:29:28.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=231928234191 2024-05-08T18:29:28.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 231928234191 2024-05-08T18:29:28.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191' 2024-05-08T18:29:28.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:28.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2024-05-08T18:29:28.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=253403070661 2024-05-08T18:29:28.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 253403070661 2024-05-08T18:29:28.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661' 2024-05-08T18:29:28.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:28.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2024-05-08T18:29:28.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=274877907129 2024-05-08T18:29:28.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 274877907129 2024-05-08T18:29:28.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661 12-274877907129' 2024-05-08T18:29:28.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:28.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2024-05-08T18:29:28.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=296352743599 2024-05-08T18:29:28.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 296352743599 2024-05-08T18:29:28.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661 12-274877907129 13-296352743599' 2024-05-08T18:29:28.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:28.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2024-05-08T18:29:29.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=317827580071 2024-05-08T18:29:29.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 317827580071 2024-05-08T18:29:29.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661 12-274877907129 13-296352743599 14-317827580071' 2024-05-08T18:29:29.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:29.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2024-05-08T18:29:29.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=339302416545 2024-05-08T18:29:29.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 339302416545 2024-05-08T18:29:29.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661 12-274877907129 13-296352743599 14-317827580071 15-339302416545' 2024-05-08T18:29:29.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:29.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2024-05-08T18:29:29.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=360777253013 2024-05-08T18:29:29.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 360777253013 2024-05-08T18:29:29.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661 12-274877907129 13-296352743599 14-317827580071 15-339302416545 16-360777253013' 2024-05-08T18:29:29.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:29.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2024-05-08T18:29:29.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=382252089488 2024-05-08T18:29:29.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 382252089488 2024-05-08T18:29:29.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661 12-274877907129 13-296352743599 14-317827580071 15-339302416545 16-360777253013 17-382252089488' 2024-05-08T18:29:29.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:29.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2024-05-08T18:29:29.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=403726925957 2024-05-08T18:29:29.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 403726925957 2024-05-08T18:29:29.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661 12-274877907129 13-296352743599 14-317827580071 15-339302416545 16-360777253013 17-382252089488 18-403726925957' 2024-05-08T18:29:29.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:29:29.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2024-05-08T18:29:29.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=425201762427 2024-05-08T18:29:29.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 425201762427 2024-05-08T18:29:29.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836762 1-42949673235 2-64424509709 3-85899346177 4-107374182651 5-128849019124 6-150323855593 7-171798692071 8-193273528539 9-214748365014 10-231928234191 11-253403070661 12-274877907129 13-296352743599 14-317827580071 15-339302416545 16-360777253013 17-382252089488 18-403726925957 19-425201762427' 2024-05-08T18:29:29.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:29.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836762 2024-05-08T18:29:29.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:29.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:29:29.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836762 2024-05-08T18:29:29.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:29.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836762 2024-05-08T18:29:29.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836762' 2024-05-08T18:29:29.838 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836762 2024-05-08T18:29:29.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:29:30.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836763 -lt 21474836762 2024-05-08T18:29:30.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:30.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673235 2024-05-08T18:29:30.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:30.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:29:30.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673235 2024-05-08T18:29:30.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:30.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673235 2024-05-08T18:29:30.368 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673235 2024-05-08T18:29:30.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673235' 2024-05-08T18:29:30.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:29:31.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673236 -lt 42949673235 2024-05-08T18:29:31.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:31.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509709 2024-05-08T18:29:31.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:31.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:29:31.155 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509709 2024-05-08T18:29:31.155 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:31.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509709 2024-05-08T18:29:31.156 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509709 2024-05-08T18:29:31.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509709' 2024-05-08T18:29:31.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:29:31.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509710 -lt 64424509709 2024-05-08T18:29:31.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:31.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899346177 2024-05-08T18:29:31.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:31.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:29:31.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899346177 2024-05-08T18:29:31.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:31.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899346177 2024-05-08T18:29:31.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899346177' 2024-05-08T18:29:31.884 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899346177 2024-05-08T18:29:31.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:29:32.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899346178 -lt 85899346177 2024-05-08T18:29:32.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:32.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182651 2024-05-08T18:29:32.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:32.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:29:32.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182651 2024-05-08T18:29:32.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:32.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182651 2024-05-08T18:29:32.649 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182651 2024-05-08T18:29:32.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182651' 2024-05-08T18:29:32.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:29:33.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182652 -lt 107374182651 2024-05-08T18:29:33.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:33.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849019124 2024-05-08T18:29:33.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:33.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T18:29:33.598 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849019124 2024-05-08T18:29:33.598 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:33.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849019124 2024-05-08T18:29:33.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849019124' 2024-05-08T18:29:33.600 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849019124 2024-05-08T18:29:33.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T18:29:34.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849019125 -lt 128849019124 2024-05-08T18:29:34.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:34.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 6-150323855593 2024-05-08T18:29:34.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:34.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=6 2024-05-08T18:29:34.215 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 6-150323855593 2024-05-08T18:29:34.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:34.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=150323855593 2024-05-08T18:29:34.217 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.6 seq 150323855593 2024-05-08T18:29:34.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.6 seq 150323855593' 2024-05-08T18:29:34.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 6 2024-05-08T18:29:34.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 150323855595 -lt 150323855593 2024-05-08T18:29:34.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:34.872 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 7-171798692071 2024-05-08T18:29:34.873 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:34.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=7 2024-05-08T18:29:34.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 7-171798692071 2024-05-08T18:29:34.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:34.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=171798692071 2024-05-08T18:29:34.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.7 seq 171798692071' 2024-05-08T18:29:34.877 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.7 seq 171798692071 2024-05-08T18:29:34.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 7 2024-05-08T18:29:35.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 171798692072 -lt 171798692071 2024-05-08T18:29:35.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:35.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 8-193273528539 2024-05-08T18:29:35.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:35.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=8 2024-05-08T18:29:35.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 8-193273528539 2024-05-08T18:29:35.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:35.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=193273528539 2024-05-08T18:29:35.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.8 seq 193273528539' 2024-05-08T18:29:35.638 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.8 seq 193273528539 2024-05-08T18:29:35.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 8 2024-05-08T18:29:36.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 193273528540 -lt 193273528539 2024-05-08T18:29:36.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:36.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 9-214748365014 2024-05-08T18:29:36.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:36.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=9 2024-05-08T18:29:36.176 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:36.176 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 9-214748365014 2024-05-08T18:29:36.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=214748365014 2024-05-08T18:29:36.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.9 seq 214748365014' 2024-05-08T18:29:36.178 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.9 seq 214748365014 2024-05-08T18:29:36.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 9 2024-05-08T18:29:36.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 214748365016 -lt 214748365014 2024-05-08T18:29:36.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:36.785 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 10-231928234191 2024-05-08T18:29:36.785 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:36.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=10 2024-05-08T18:29:36.787 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 10-231928234191 2024-05-08T18:29:36.787 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:36.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=231928234191 2024-05-08T18:29:36.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.10 seq 231928234191' 2024-05-08T18:29:36.789 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.10 seq 231928234191 2024-05-08T18:29:36.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 10 2024-05-08T18:29:37.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 231928234193 -lt 231928234191 2024-05-08T18:29:37.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:37.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 11-253403070661 2024-05-08T18:29:37.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:37.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=11 2024-05-08T18:29:37.691 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 11-253403070661 2024-05-08T18:29:37.692 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:37.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=253403070661 2024-05-08T18:29:37.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.11 seq 253403070661' 2024-05-08T18:29:37.695 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.11 seq 253403070661 2024-05-08T18:29:37.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 11 2024-05-08T18:29:38.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 253403070662 -lt 253403070661 2024-05-08T18:29:38.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:38.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 12-274877907129 2024-05-08T18:29:38.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:38.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=12 2024-05-08T18:29:38.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 12-274877907129 2024-05-08T18:29:38.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:38.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=274877907129 2024-05-08T18:29:38.438 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.12 seq 274877907129 2024-05-08T18:29:38.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.12 seq 274877907129' 2024-05-08T18:29:38.439 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 12 2024-05-08T18:29:39.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 274877907131 -lt 274877907129 2024-05-08T18:29:39.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:39.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 13-296352743599 2024-05-08T18:29:39.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:39.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=13 2024-05-08T18:29:39.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 13-296352743599 2024-05-08T18:29:39.144 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:39.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=296352743599 2024-05-08T18:29:39.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.13 seq 296352743599' 2024-05-08T18:29:39.145 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.13 seq 296352743599 2024-05-08T18:29:39.145 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 13 2024-05-08T18:29:39.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 296352743601 -lt 296352743599 2024-05-08T18:29:39.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:39.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 14-317827580071 2024-05-08T18:29:39.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:39.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=14 2024-05-08T18:29:39.969 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 14-317827580071 2024-05-08T18:29:39.969 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:39.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=317827580071 2024-05-08T18:29:39.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.14 seq 317827580071' 2024-05-08T18:29:39.971 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.14 seq 317827580071 2024-05-08T18:29:39.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 14 2024-05-08T18:29:40.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 317827580073 -lt 317827580071 2024-05-08T18:29:40.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:40.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:40.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 15-339302416545 2024-05-08T18:29:40.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=15 2024-05-08T18:29:40.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 15-339302416545 2024-05-08T18:29:40.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:40.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=339302416545 2024-05-08T18:29:40.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.15 seq 339302416545' 2024-05-08T18:29:40.701 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.15 seq 339302416545 2024-05-08T18:29:40.701 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 15 2024-05-08T18:29:41.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 339302416547 -lt 339302416545 2024-05-08T18:29:41.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:41.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:41.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 16-360777253013 2024-05-08T18:29:41.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=16 2024-05-08T18:29:41.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 16-360777253013 2024-05-08T18:29:41.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:41.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=360777253013 2024-05-08T18:29:41.563 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.16 seq 360777253013 2024-05-08T18:29:41.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.16 seq 360777253013' 2024-05-08T18:29:41.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 16 2024-05-08T18:29:42.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 360777253015 -lt 360777253013 2024-05-08T18:29:42.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:42.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 17-382252089488 2024-05-08T18:29:42.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:42.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=17 2024-05-08T18:29:42.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 17-382252089488 2024-05-08T18:29:42.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:42.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=382252089488 2024-05-08T18:29:42.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.17 seq 382252089488' 2024-05-08T18:29:42.049 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.17 seq 382252089488 2024-05-08T18:29:42.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 17 2024-05-08T18:29:43.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 382252089491 -lt 382252089488 2024-05-08T18:29:43.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:43.017 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 18-403726925957 2024-05-08T18:29:43.017 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:43.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=18 2024-05-08T18:29:43.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 18-403726925957 2024-05-08T18:29:43.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:43.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=403726925957 2024-05-08T18:29:43.022 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.18 seq 403726925957 2024-05-08T18:29:43.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.18 seq 403726925957' 2024-05-08T18:29:43.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 18 2024-05-08T18:29:43.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 403726925960 -lt 403726925957 2024-05-08T18:29:43.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:29:43.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 19-425201762427 2024-05-08T18:29:43.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:29:43.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=19 2024-05-08T18:29:43.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 19-425201762427 2024-05-08T18:29:43.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:29:43.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=425201762427 2024-05-08T18:29:43.664 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.19 seq 425201762427 2024-05-08T18:29:43.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.19 seq 425201762427' 2024-05-08T18:29:43.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 19 2024-05-08T18:29:44.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 425201762429 -lt 425201762427 2024-05-08T18:29:44.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:29:44.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:29:44.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:29:45.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 8 == 0 2024-05-08T18:29:45.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:29:45.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:29:45.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:29:45.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:29:45.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:29:45.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:29:45.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:29:45.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-05-08T18:29:45.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-05-08T18:29:45.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' -1 2024-05-08T18:29:45.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-05-08T18:29:45.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=4 2024-05-08T18:29:45.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-05-08T18:29:50.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:29:50.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:29:50.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:29:50.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:29:50.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:29:50.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:29:50.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:29:50.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:29:51.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-05-08T18:29:51.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-05-08T18:29:51.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' 4 2024-05-08T18:29:51.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 1 >= 81 )) 2024-05-08T18:29:51.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 10 2024-05-08T18:30:01.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:30:01.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:30:01.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:30:01.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:30:01.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:30:01.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:30:01.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:30:01.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:30:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-05-08T18:30:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-05-08T18:30:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' 4 2024-05-08T18:30:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 2 >= 81 )) 2024-05-08T18:30:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 15 2024-05-08T18:30:16.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:30:16.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:30:16.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:30:16.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:30:16.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:30:16.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:30:16.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:30:16.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:30:17.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-05-08T18:30:17.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-05-08T18:30:17.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' 4 2024-05-08T18:30:17.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 3 >= 81 )) 2024-05-08T18:30:17.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 15 2024-05-08T18:30:32.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:30:32.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:30:32.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:30:32.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:30:32.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:30:32.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:30:32.008 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:30:32.008 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:30:32.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-05-08T18:30:32.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-05-08T18:30:32.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' 4 2024-05-08T18:30:32.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 4 >= 81 )) 2024-05-08T18:30:32.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 15 2024-05-08T18:30:47.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:30:47.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:30:47.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:30:47.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:30:47.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:30:47.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:30:47.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:30:47.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:30:47.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=3 2024-05-08T18:30:47.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 3 = 0 2024-05-08T18:30:47.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 3 '!=' 4 2024-05-08T18:30:47.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-05-08T18:30:47.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=3 2024-05-08T18:30:47.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-05-08T18:30:52.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:30:52.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:30:52.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:30:52.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:30:52.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:30:52.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:30:52.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:30:52.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:30:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=2 2024-05-08T18:30:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 2 = 0 2024-05-08T18:30:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 2 '!=' 3 2024-05-08T18:30:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-05-08T18:30:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=2 2024-05-08T18:30:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-05-08T18:30:58.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:30:58.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:30:58.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:30:58.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:30:58.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:30:58.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:30:58.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:30:58.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:30:58.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-05-08T18:30:58.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-05-08T18:30:58.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' 2 2024-05-08T18:30:58.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-05-08T18:30:58.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=1 2024-05-08T18:30:58.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-05-08T18:31:03.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:31:03.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:31:03.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:31:03.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:31:03.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:31:03.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:31:03.770 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:31:03.771 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:233: TEST_backfill_test_multi: wait_for_not_activating 60 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-05-08T18:31:04.210 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:31:04.211 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:31:04.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:31:04.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:31:04.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:31:04.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-05-08T18:31:04.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:31:04.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:31:04.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:31:04.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:31:04.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:31:04.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:31:04.672 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:5 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:6 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:7 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:8 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:9 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:10 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:11 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:12 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:13 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:14 2024-05-08T18:31:04.673 INFO:tasks.workunit.client.0.smithi117.stderr:15 2024-05-08T18:31:04.674 INFO:tasks.workunit.client.0.smithi117.stderr:16 2024-05-08T18:31:04.674 INFO:tasks.workunit.client.0.smithi117.stderr:17 2024-05-08T18:31:04.674 INFO:tasks.workunit.client.0.smithi117.stderr:18 2024-05-08T18:31:04.674 INFO:tasks.workunit.client.0.smithi117.stderr:19' 2024-05-08T18:31:04.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:31:04.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:04.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:31:04.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836784 2024-05-08T18:31:04.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836784 2024-05-08T18:31:04.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784' 2024-05-08T18:31:04.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:04.842 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:31:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673257 2024-05-08T18:31:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673257 2024-05-08T18:31:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257' 2024-05-08T18:31:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:05.005 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:31:05.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509731 2024-05-08T18:31:05.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509731 2024-05-08T18:31:05.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731' 2024-05-08T18:31:05.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:05.166 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:31:05.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899346199 2024-05-08T18:31:05.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899346199 2024-05-08T18:31:05.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199' 2024-05-08T18:31:05.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:05.332 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:31:05.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182673 2024-05-08T18:31:05.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182673 2024-05-08T18:31:05.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673' 2024-05-08T18:31:05.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:05.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T18:31:05.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849019146 2024-05-08T18:31:05.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849019146 2024-05-08T18:31:05.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146' 2024-05-08T18:31:05.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:05.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2024-05-08T18:31:05.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=150323855615 2024-05-08T18:31:05.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 150323855615 2024-05-08T18:31:05.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615' 2024-05-08T18:31:05.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:05.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2024-05-08T18:31:05.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=171798692093 2024-05-08T18:31:05.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 171798692093 2024-05-08T18:31:05.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093' 2024-05-08T18:31:05.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:05.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2024-05-08T18:31:06.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=193273528561 2024-05-08T18:31:06.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 193273528561 2024-05-08T18:31:06.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561' 2024-05-08T18:31:06.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:06.145 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2024-05-08T18:31:06.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=214748365036 2024-05-08T18:31:06.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 214748365036 2024-05-08T18:31:06.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036' 2024-05-08T18:31:06.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:06.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2024-05-08T18:31:06.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=231928234213 2024-05-08T18:31:06.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 231928234213 2024-05-08T18:31:06.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213' 2024-05-08T18:31:06.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:06.468 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2024-05-08T18:31:06.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=253403070682 2024-05-08T18:31:06.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 253403070682 2024-05-08T18:31:06.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682' 2024-05-08T18:31:06.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:06.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2024-05-08T18:31:06.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=274877907151 2024-05-08T18:31:06.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 274877907151 2024-05-08T18:31:06.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682 12-274877907151' 2024-05-08T18:31:06.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:06.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2024-05-08T18:31:06.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=296352743621 2024-05-08T18:31:06.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 296352743621 2024-05-08T18:31:06.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682 12-274877907151 13-296352743621' 2024-05-08T18:31:06.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:06.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2024-05-08T18:31:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=317827580093 2024-05-08T18:31:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 317827580093 2024-05-08T18:31:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682 12-274877907151 13-296352743621 14-317827580093' 2024-05-08T18:31:07.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:07.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2024-05-08T18:31:07.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=339302416566 2024-05-08T18:31:07.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 339302416566 2024-05-08T18:31:07.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682 12-274877907151 13-296352743621 14-317827580093 15-339302416566' 2024-05-08T18:31:07.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:07.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2024-05-08T18:31:07.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=360777253035 2024-05-08T18:31:07.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 360777253035 2024-05-08T18:31:07.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682 12-274877907151 13-296352743621 14-317827580093 15-339302416566 16-360777253035' 2024-05-08T18:31:07.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:07.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2024-05-08T18:31:07.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=382252089510 2024-05-08T18:31:07.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 382252089510 2024-05-08T18:31:07.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682 12-274877907151 13-296352743621 14-317827580093 15-339302416566 16-360777253035 17-382252089510' 2024-05-08T18:31:07.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:07.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2024-05-08T18:31:07.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=403726925979 2024-05-08T18:31:07.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 403726925979 2024-05-08T18:31:07.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682 12-274877907151 13-296352743621 14-317827580093 15-339302416566 16-360777253035 17-382252089510 18-403726925979' 2024-05-08T18:31:07.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:31:07.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2024-05-08T18:31:07.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=425201762448 2024-05-08T18:31:07.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 425201762448 2024-05-08T18:31:07.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836784 1-42949673257 2-64424509731 3-85899346199 4-107374182673 5-128849019146 6-150323855615 7-171798692093 8-193273528561 9-214748365036 10-231928234213 11-253403070682 12-274877907151 13-296352743621 14-317827580093 15-339302416566 16-360777253035 17-382252089510 18-403726925979 19-425201762448' 2024-05-08T18:31:07.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:07.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836784 2024-05-08T18:31:07.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:07.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:31:07.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836784 2024-05-08T18:31:07.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:07.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836784 2024-05-08T18:31:07.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836784' 2024-05-08T18:31:07.919 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836784 2024-05-08T18:31:07.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:31:08.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836785 -lt 21474836784 2024-05-08T18:31:08.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:08.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673257 2024-05-08T18:31:08.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:08.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:31:08.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673257 2024-05-08T18:31:08.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:08.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673257 2024-05-08T18:31:08.569 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673257 2024-05-08T18:31:08.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673257' 2024-05-08T18:31:08.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:31:09.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673258 -lt 42949673257 2024-05-08T18:31:09.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:09.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509731 2024-05-08T18:31:09.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:09.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:31:09.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509731 2024-05-08T18:31:09.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:09.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509731 2024-05-08T18:31:09.041 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509731 2024-05-08T18:31:09.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509731' 2024-05-08T18:31:09.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:31:09.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509731 -lt 64424509731 2024-05-08T18:31:09.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:09.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899346199 2024-05-08T18:31:09.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:09.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:31:09.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899346199 2024-05-08T18:31:09.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:09.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899346199 2024-05-08T18:31:09.466 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899346199 2024-05-08T18:31:09.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899346199' 2024-05-08T18:31:09.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:31:09.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899346199 -lt 85899346199 2024-05-08T18:31:09.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:09.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182673 2024-05-08T18:31:09.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:09.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:31:09.908 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182673 2024-05-08T18:31:09.908 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:09.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182673 2024-05-08T18:31:09.910 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182673 2024-05-08T18:31:09.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182673' 2024-05-08T18:31:09.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:31:10.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182674 -lt 107374182673 2024-05-08T18:31:10.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:10.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849019146 2024-05-08T18:31:10.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T18:31:10.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849019146 2024-05-08T18:31:10.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:10.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849019146 2024-05-08T18:31:10.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849019146' 2024-05-08T18:31:10.342 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849019146 2024-05-08T18:31:10.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T18:31:10.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849019147 -lt 128849019146 2024-05-08T18:31:10.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:10.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 6-150323855615 2024-05-08T18:31:10.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:10.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=6 2024-05-08T18:31:10.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 6-150323855615 2024-05-08T18:31:10.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:10.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=150323855615 2024-05-08T18:31:10.822 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.6 seq 150323855615 2024-05-08T18:31:10.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.6 seq 150323855615' 2024-05-08T18:31:10.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 6 2024-05-08T18:31:11.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 150323855616 -lt 150323855615 2024-05-08T18:31:11.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:11.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 7-171798692093 2024-05-08T18:31:11.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:11.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=7 2024-05-08T18:31:11.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 7-171798692093 2024-05-08T18:31:11.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:11.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=171798692093 2024-05-08T18:31:11.259 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.7 seq 171798692093 2024-05-08T18:31:11.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.7 seq 171798692093' 2024-05-08T18:31:11.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 7 2024-05-08T18:31:11.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 171798692094 -lt 171798692093 2024-05-08T18:31:11.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:11.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 8-193273528561 2024-05-08T18:31:11.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:11.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=8 2024-05-08T18:31:11.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 8-193273528561 2024-05-08T18:31:11.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:11.742 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.8 seq 193273528561 2024-05-08T18:31:11.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=193273528561 2024-05-08T18:31:11.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.8 seq 193273528561' 2024-05-08T18:31:11.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 8 2024-05-08T18:31:12.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 193273528562 -lt 193273528561 2024-05-08T18:31:12.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:12.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 9-214748365036 2024-05-08T18:31:12.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:12.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=9 2024-05-08T18:31:12.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 9-214748365036 2024-05-08T18:31:12.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:12.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=214748365036 2024-05-08T18:31:12.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.9 seq 214748365036' 2024-05-08T18:31:12.197 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.9 seq 214748365036 2024-05-08T18:31:12.197 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 9 2024-05-08T18:31:12.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 214748365037 -lt 214748365036 2024-05-08T18:31:12.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:12.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 10-231928234213 2024-05-08T18:31:12.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:12.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=10 2024-05-08T18:31:12.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 10-231928234213 2024-05-08T18:31:12.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:12.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=231928234213 2024-05-08T18:31:12.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.10 seq 231928234213' 2024-05-08T18:31:12.618 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.10 seq 231928234213 2024-05-08T18:31:12.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 10 2024-05-08T18:31:13.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 231928234214 -lt 231928234213 2024-05-08T18:31:13.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:13.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:13.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 11-253403070682 2024-05-08T18:31:13.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=11 2024-05-08T18:31:13.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:13.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 11-253403070682 2024-05-08T18:31:13.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=253403070682 2024-05-08T18:31:13.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.11 seq 253403070682' 2024-05-08T18:31:13.101 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.11 seq 253403070682 2024-05-08T18:31:13.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 11 2024-05-08T18:31:13.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 253403070683 -lt 253403070682 2024-05-08T18:31:13.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:13.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:13.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 12-274877907151 2024-05-08T18:31:13.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=12 2024-05-08T18:31:13.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 12-274877907151 2024-05-08T18:31:13.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:13.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=274877907151 2024-05-08T18:31:13.529 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.12 seq 274877907151 2024-05-08T18:31:13.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.12 seq 274877907151' 2024-05-08T18:31:13.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 12 2024-05-08T18:31:13.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 274877907152 -lt 274877907151 2024-05-08T18:31:13.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:13.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 13-296352743621 2024-05-08T18:31:13.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:13.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=13 2024-05-08T18:31:13.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 13-296352743621 2024-05-08T18:31:13.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:13.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=296352743621 2024-05-08T18:31:13.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.13 seq 296352743621' 2024-05-08T18:31:13.929 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.13 seq 296352743621 2024-05-08T18:31:13.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 13 2024-05-08T18:31:14.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 296352743622 -lt 296352743621 2024-05-08T18:31:14.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:14.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 14-317827580093 2024-05-08T18:31:14.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:14.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=14 2024-05-08T18:31:14.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 14-317827580093 2024-05-08T18:31:14.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:14.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=317827580093 2024-05-08T18:31:14.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.14 seq 317827580093' 2024-05-08T18:31:14.354 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.14 seq 317827580093 2024-05-08T18:31:14.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 14 2024-05-08T18:31:14.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 317827580094 -lt 317827580093 2024-05-08T18:31:14.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:14.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 15-339302416566 2024-05-08T18:31:14.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:14.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=15 2024-05-08T18:31:14.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 15-339302416566 2024-05-08T18:31:14.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=339302416566 2024-05-08T18:31:14.839 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.15 seq 339302416566 2024-05-08T18:31:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.15 seq 339302416566' 2024-05-08T18:31:14.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 15 2024-05-08T18:31:15.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 339302416568 -lt 339302416566 2024-05-08T18:31:15.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:15.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 16-360777253035 2024-05-08T18:31:15.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:15.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=16 2024-05-08T18:31:15.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 16-360777253035 2024-05-08T18:31:15.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:15.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=360777253035 2024-05-08T18:31:15.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.16 seq 360777253035' 2024-05-08T18:31:15.277 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.16 seq 360777253035 2024-05-08T18:31:15.278 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 16 2024-05-08T18:31:15.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 360777253036 -lt 360777253035 2024-05-08T18:31:15.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:15.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 17-382252089510 2024-05-08T18:31:15.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:15.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=17 2024-05-08T18:31:15.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 17-382252089510 2024-05-08T18:31:15.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:15.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=382252089510 2024-05-08T18:31:15.686 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.17 seq 382252089510 2024-05-08T18:31:15.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.17 seq 382252089510' 2024-05-08T18:31:15.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 17 2024-05-08T18:31:16.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 382252089511 -lt 382252089510 2024-05-08T18:31:16.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:16.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 18-403726925979 2024-05-08T18:31:16.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:16.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=18 2024-05-08T18:31:16.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 18-403726925979 2024-05-08T18:31:16.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:16.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=403726925979 2024-05-08T18:31:16.166 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.18 seq 403726925979 2024-05-08T18:31:16.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.18 seq 403726925979' 2024-05-08T18:31:16.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 18 2024-05-08T18:31:16.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 403726925980 -lt 403726925979 2024-05-08T18:31:16.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:31:16.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 19-425201762448 2024-05-08T18:31:16.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:31:16.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=19 2024-05-08T18:31:16.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 19-425201762448 2024-05-08T18:31:16.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:31:16.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=425201762448 2024-05-08T18:31:16.640 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.19 seq 425201762448 2024-05-08T18:31:16.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.19 seq 425201762448' 2024-05-08T18:31:16.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 19 2024-05-08T18:31:17.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 425201762450 -lt 425201762448 2024-05-08T18:31:17.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:31:17.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:31:17.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:31:17.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 8 == 0 2024-05-08T18:31:17.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:31:17.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-05-08T18:31:17.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-05-08T18:31:17.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:31:17.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-05-08T18:31:17.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:31:17.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-05-08T18:31:18.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:31:18.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:31:18.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:31:18.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:31:18.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:235: TEST_backfill_test_multi: ERRORS=0 2024-05-08T18:31:18.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:236: TEST_backfill_test_multi: ceph pg dump pgs 2024-05-08T18:31:18.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:236: TEST_backfill_test_multi: grep +backfill_toofull 2024-05-08T18:31:18.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:236: TEST_backfill_test_multi: wc -l 2024-05-08T18:31:18.449 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:31:18.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:236: TEST_backfill_test_multi: full=4 2024-05-08T18:31:18.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:237: TEST_backfill_test_multi: '[' 4 -lt 1 ']' 2024-05-08T18:31:18.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:243: TEST_backfill_test_multi: expr 8 - 4 2024-05-08T18:31:18.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:243: TEST_backfill_test_multi: expected=4 2024-05-08T18:31:18.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:244: TEST_backfill_test_multi: grep active+clean 2024-05-08T18:31:18.468 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:244: TEST_backfill_test_multi: wc -l 2024-05-08T18:31:18.468 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:244: TEST_backfill_test_multi: ceph pg dump pgs 2024-05-08T18:31:18.857 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:31:18.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:244: TEST_backfill_test_multi: '[' 4 '!=' 4 ']' 2024-05-08T18:31:18.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:250: TEST_backfill_test_multi: ceph pg dump pgs 2024-05-08T18:31:19.276 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:8.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-05-08T18:30:55.071965+0000 146'600 180:1901 [3,15] 3 [3,15] 3 0'0 2024-05-08T18:20:29.238631+0000 0'0 2024-05-08T18:20:29.238631+0000 0 0 periodic scrub scheduled @ 2024-05-09T23:14:35.321582+0000 0 0 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:7.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T18:30:54.237911+0000 146'600 180:716 [5,1] 5 [5] 5 0'0 2024-05-08T18:20:24.963842+0000 0'0 2024-05-08T18:20:24.963842+0000 0 0 no scrub is scheduled 0 0 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:6.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T18:30:51.440686+0000 146'600 180:727 [7,4] 7 [7] 7 0'0 2024-05-08T18:20:20.660291+0000 0'0 2024-05-08T18:20:20.660291+0000 0 0 no scrub is scheduled 0 0 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:5.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-05-08T18:30:53.496925+0000 146'600 180:1919 [12,19] 12 [12,19] 12 0'0 2024-05-08T18:20:16.074054+0000 0'0 2024-05-08T18:20:16.074054+0000 0 0 periodic scrub scheduled @ 2024-05-10T01:00:58.800989+0000 0 0 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:4.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-05-08T18:30:48.131538+0000 146'600 180:1939 [4,10] 4 [4,10] 4 0'0 2024-05-08T18:20:12.645637+0000 0'0 2024-05-08T18:20:12.645637+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:51:29.713920+0000 0 0 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T18:31:12.625206+0000 146'600 180:766 [1,7] 1 [1] 1 0'0 2024-05-08T18:20:07.682264+0000 0'0 2024-05-08T18:20:07.682264+0000 0 0 no scrub is scheduled 0 0 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T18:31:11.446537+0000 146'600 180:758 [17,5] 17 [17] 17 0'0 2024-05-08T18:20:03.678580+0000 0'0 2024-05-08T18:20:03.678580+0000 0 0 no scrub is scheduled 0 0 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-05-08T18:30:42.585772+0000 146'600 180:1970 [8,0] 8 [8,0] 8 0'0 2024-05-08T18:20:00.217803+0000 0'0 2024-05-08T18:20:00.217803+0000 0 0 periodic scrub scheduled @ 2024-05-10T05:34:09.151432+0000 0 0 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:31:19.277 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:31:19.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:251: TEST_backfill_test_multi: ceph status 2024-05-08T18:31:19.818 INFO:tasks.workunit.client.0.smithi117.stdout: cluster: 2024-05-08T18:31:19.818 INFO:tasks.workunit.client.0.smithi117.stdout: id: 62f593dd-65a1-4557-a917-917cf05b8631 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: health: HEALTH_WARN 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: Low space hindering backfill (add storage if this doesn't resolve itself): 4 pgs backfill_toofull 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: Degraded data redundancy: 2400/9600 objects degraded (25.000%), 4 pgs degraded, 4 pgs undersized 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: 8 pool(s) do not have an application enabled 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: services: 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: mon: 1 daemons, quorum a (age 25m) 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: mgr: x(active, since 25m) 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: osd: 20 osds: 20 up (since 11m), 20 in (since 12m); 4 remapped pgs 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: data: 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: pools: 8 pools, 8 pgs 2024-05-08T18:31:19.819 INFO:tasks.workunit.client.0.smithi117.stdout: objects: 4.80k objects, 19 MiB 2024-05-08T18:31:19.820 INFO:tasks.workunit.client.0.smithi117.stdout: usage: 28 MiB used, 42 MiB / 70 MiB avail 2024-05-08T18:31:19.820 INFO:tasks.workunit.client.0.smithi117.stdout: pgs: 2400/9600 objects degraded (25.000%) 2024-05-08T18:31:19.820 INFO:tasks.workunit.client.0.smithi117.stdout: 4 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T18:31:19.820 INFO:tasks.workunit.client.0.smithi117.stdout: 4 active+clean 2024-05-08T18:31:19.820 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:31:19.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:253: TEST_backfill_test_multi: ceph status --format=json-pretty 2024-05-08T18:31:20.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:255: TEST_backfill_test_multi: jq .health.checks.PG_BACKFILL_FULL.severity td/osd-backfill-space/stat.json 2024-05-08T18:31:20.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:255: TEST_backfill_test_multi: eval 'SEV="HEALTH_WARN"' 2024-05-08T18:31:20.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:255: TEST_backfill_test_multi: SEV=HEALTH_WARN 2024-05-08T18:31:20.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:256: TEST_backfill_test_multi: '[' HEALTH_WARN '!=' HEALTH_WARN ']' 2024-05-08T18:31:20.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:260: TEST_backfill_test_multi: jq .health.checks.PG_BACKFILL_FULL.summary.message td/osd-backfill-space/stat.json 2024-05-08T18:31:20.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:260: TEST_backfill_test_multi: eval 'MSG="Low' space hindering backfill '(add' storage if this 'doesn'\''t' resolve 'itself):' 4 pgs 'backfill_toofull"' 2024-05-08T18:31:20.455 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:260: TEST_backfill_test_multi: MSG='Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' 2024-05-08T18:31:20.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:261: TEST_backfill_test_multi: '[' 'Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' '!=' 'Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' ']' 2024-05-08T18:31:20.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:265: TEST_backfill_test_multi: rm -f td/osd-backfill-space/stat.json 2024-05-08T18:31:20.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:267: TEST_backfill_test_multi: '[' 0 '!=' 0 ']' 2024-05-08T18:31:20.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: seq 1 8 2024-05-08T18:31:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-05-08T18:31:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test1 2024-05-08T18:31:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test1 2024-05-08T18:31:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-05-08T18:31:20.977 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' does not exist 2024-05-08T18:31:20.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-05-08T18:31:20.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test2 2024-05-08T18:31:20.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test2 2024-05-08T18:31:20.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-05-08T18:31:21.711 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' does not exist 2024-05-08T18:31:21.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-05-08T18:31:21.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test3 2024-05-08T18:31:21.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test3 2024-05-08T18:31:21.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2024-05-08T18:31:22.934 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test3' does not exist 2024-05-08T18:31:22.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-05-08T18:31:22.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test4 2024-05-08T18:31:22.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test4 2024-05-08T18:31:22.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2024-05-08T18:31:24.079 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test4' does not exist 2024-05-08T18:31:24.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-05-08T18:31:24.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test5 2024-05-08T18:31:24.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test5 2024-05-08T18:31:24.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2024-05-08T18:31:25.255 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test5' does not exist 2024-05-08T18:31:25.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-05-08T18:31:25.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test6 2024-05-08T18:31:25.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test6 2024-05-08T18:31:25.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2024-05-08T18:31:26.543 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test6' does not exist 2024-05-08T18:31:26.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-05-08T18:31:26.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test7 2024-05-08T18:31:26.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test7 2024-05-08T18:31:26.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2024-05-08T18:31:28.009 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test7' does not exist 2024-05-08T18:31:28.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-05-08T18:31:28.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test8 2024-05-08T18:31:28.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test8 2024-05-08T18:31:28.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2024-05-08T18:31:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test8' does not exist 2024-05-08T18:31:29.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:277: TEST_backfill_test_multi: kill_daemons td/osd-backfill-space 2024-05-08T18:31:29.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:31:29.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:31:29.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:31:29.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:31:29.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:31:31.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:31:31.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:278: TEST_backfill_test_multi: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.10.log td/osd-backfill-space/osd.11.log td/osd-backfill-space/osd.12.log td/osd-backfill-space/osd.13.log td/osd-backfill-space/osd.14.log td/osd-backfill-space/osd.15.log td/osd-backfill-space/osd.16.log td/osd-backfill-space/osd.17.log td/osd-backfill-space/osd.18.log td/osd-backfill-space/osd.19.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log td/osd-backfill-space/osd.3.log td/osd-backfill-space/osd.4.log td/osd-backfill-space/osd.5.log td/osd-backfill-space/osd.6.log td/osd-backfill-space/osd.7.log td/osd-backfill-space/osd.8.log td/osd-backfill-space/osd.9.log 2024-05-08T18:31:31.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-05-08T18:31:31.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:31:31.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:31:31.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:31:31.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:31:31.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:31:31.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:31:31.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:31:31.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:31:31.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:31:31.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:31:31.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:31:31.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:31:31.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:31:31.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:31:31.476 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:31:31.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:31:31.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:31:31.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:31:31.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:31:31.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:31:31.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:31:31.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:31:31.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:31:31.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:31:31.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:31:31.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:31:31.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:31:31.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:31:31.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-05-08T18:31:31.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-05-08T18:31:31.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2024-05-08T18:31:31.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2024-05-08T18:31:31.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:31:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:31:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:31:31.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:31:31.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:31:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:31:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:31:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:31:31.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:31:31.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:31:31.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:31:31.810 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:31:31.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:31:31.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:31:31.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:31:31.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:31:31.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:31:31.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:31:31.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:31:31.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:31:31.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:31:31.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:31:31.816 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:31:31.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:31:31.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:31:31.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:31:31.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:31:31.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:31:31.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2024-05-08T18:31:31.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T18:31:31.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:31:31.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:31:31.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.109971 2024-05-08T18:31:31.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_test_sametarget td/osd-backfill-space 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:295: TEST_backfill_test_sametarget: local dir=td/osd-backfill-space 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:296: TEST_backfill_test_sametarget: local pools=10 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:297: TEST_backfill_test_sametarget: local OSDS=5 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:299: TEST_backfill_test_sametarget: run_mon td/osd-backfill-space a 2024-05-08T18:31:31.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2024-05-08T18:31:31.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T18:31:31.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T18:31:31.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T18:31:31.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2024-05-08T18:31:31.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-05-08T18:31:32.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T18:31:32.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:31:32.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:31:32.137 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:31:32.137 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:31:32.137 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:31:32.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:31:32.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T18:31:32.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T18:31:32.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T18:31:32.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:31:32.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:31:32.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T18:31:32.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T18:31:32.357 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:31:32.357 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:31:32.357 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:31:32.357 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:31:32.358 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:31:32.358 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:31:32.358 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:31:32.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:31:32.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get fsid 2024-05-08T18:31:32.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T18:31:32.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:31:32.472 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:31:32.472 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T18:31:32.472 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:31:32.472 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T18:31:32.472 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:31:32.472 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:31:32.473 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:31:32.473 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:31:32.474 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:31:32.474 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:31:32.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:31:32.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get mon_host 2024-05-08T18:31:32.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:300: TEST_backfill_test_sametarget: run_mgr td/osd-backfill-space x 2024-05-08T18:31:32.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-space 2024-05-08T18:31:32.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T18:31:32.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T18:31:32.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T18:31:32.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-space/x 2024-05-08T18:31:32.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T18:31:33.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T18:31:33.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:31:33.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:31:33.499 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:31:33.499 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:31:33.499 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:31:33.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:31:33.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:31:33.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:31:33.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:301: TEST_backfill_test_sametarget: export CEPH_ARGS 2024-05-08T18:31:33.535 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: expr 5 - 1 2024-05-08T18:31:33.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: seq 0 4 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 0 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:31:33.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:31:33.541 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:31:33.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T18:31:33.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:31:33.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1177900e-37eb-40b9-9b94-d2d1853ba39c 2024-05-08T18:31:33.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 1177900e-37eb-40b9-9b94-d2d1853ba39c' 2024-05-08T18:31:33.543 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 1177900e-37eb-40b9-9b94-d2d1853ba39c 2024-05-08T18:31:33.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:31:33.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAFxTtmHfjBIRAAdwAJpfCR3GSqaUq9pY+muw== 2024-05-08T18:31:33.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAFxTtmHfjBIRAAdwAJpfCR3GSqaUq9pY+muw=="}' 2024-05-08T18:31:33.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1177900e-37eb-40b9-9b94-d2d1853ba39c -i td/osd-backfill-space/0/new.json 2024-05-08T18:31:33.865 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:31:33.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/0/new.json 2024-05-08T18:31:33.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAFxTtmHfjBIRAAdwAJpfCR3GSqaUq9pY+muw== --osd-uuid 1177900e-37eb-40b9-9b94-d2d1853ba39c 2024-05-08T18:31:33.921 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:33.921+0000 7fefa087f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:31:33.924 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:33.925+0000 7fefa087f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:31:33.926 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:33.929+0000 7fefa087f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:31:33.926 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:33.929+0000 7fefa087f7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:31:33.926 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:33.929+0000 7fefa087f7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:31:33.926 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:33.929+0000 7fefa087f7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:31:33.965 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:33.965+0000 7fefa087f7c0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-05-08T18:31:40.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-05-08T18:31:40.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:31:40.032 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T18:31:40.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T18:31:40.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:31:40.619 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T18:31:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T18:31:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:31:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:31:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:31:40.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:31:40.657 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:40.660+0000 7f5ac56a87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:31:40.671 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:40.672+0000 7f5ac56a87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:31:40.673 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:40.672+0000 7f5ac56a87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:31:41.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T18:31:41.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:31:41.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T18:31:41.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:31:41.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:31:41.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:41.028 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:31:41.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:31:41.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:41.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:41.248 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:41.248+0000 7f5ac56a87c0 -1 Falling back to public interface 2024-05-08T18:31:41.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:42.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:42.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:42.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:31:42.444 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:31:42.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:42.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:42.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:43.737 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:31:43.736+0000 7f5ac56a87c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:31:43.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:43.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:43.878 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:31:43.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:31:43.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:43.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:44.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:45.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:45.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:45.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:31:45.309 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:31:45.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:45.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:45.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:46.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:46.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:46.815 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:31:46.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:31:46.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:46.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:47.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:48.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:48.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:48.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:31:48.272 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:31:48.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:48.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:48.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:49.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:49.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:49.757 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:31:49.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:31:49.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:49.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:50.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:51.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:51.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:51.214 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:31:51.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:31:51.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:51.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:51.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:52.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:52.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:52.655 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:31:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:31:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:53.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:54.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:54.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:54.105 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:31:54.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:31:54.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:54.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:54.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:55.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:55.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:55.971 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:31:55.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:31:55.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:55.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:56.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:57.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:57.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:57.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:31:57.469 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:31:57.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:57.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:31:58.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:31:59.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:31:59.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:31:59.450 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:31:59.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:31:59.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:31:59.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:32:00.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:01.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:01.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:01.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:32:01.218 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:32:01.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:01.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:32:01.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:02.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:02.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:02.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:32:02.845 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:32:02.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:02.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:32:03.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:04.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:04.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:04.831 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:32:04.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:32:04.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:04.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:32:05.301 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/463605612,v1:127.0.0.1:6803/463605612] [v2:127.0.0.1:6804/463605612,v1:127.0.0.1:6805/463605612] exists,up 1177900e-37eb-40b9-9b94-d2d1853ba39c 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 1 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:32:05.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:32:05.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:32:05.307 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:32:05.307 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:32:05.307 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:32:05.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:32:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T18:32:05.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:32:05.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b542fa70-4686-4db7-b5e7-ce68e635e295 2024-05-08T18:32:05.309 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 b542fa70-4686-4db7-b5e7-ce68e635e295 2024-05-08T18:32:05.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 b542fa70-4686-4db7-b5e7-ce68e635e295' 2024-05-08T18:32:05.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:32:05.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAlxTtmUgN6FBAAXC/t47rtrQh6+K7l3WBu7A== 2024-05-08T18:32:05.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAlxTtmUgN6FBAAXC/t47rtrQh6+K7l3WBu7A=="}' 2024-05-08T18:32:05.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b542fa70-4686-4db7-b5e7-ce68e635e295 -i td/osd-backfill-space/1/new.json 2024-05-08T18:32:05.877 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:32:05.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/1/new.json 2024-05-08T18:32:05.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAlxTtmUgN6FBAAXC/t47rtrQh6+K7l3WBu7A== --osd-uuid b542fa70-4686-4db7-b5e7-ce68e635e295 2024-05-08T18:32:05.935 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:05.936+0000 7fe7539387c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:05.937 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:05.940+0000 7fe7539387c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:05.938 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:05.940+0000 7fe7539387c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:05.939 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:05.940+0000 7fe7539387c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:32:05.939 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:05.940+0000 7fe7539387c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:32:05.939 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:05.940+0000 7fe7539387c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:32:06.001 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:06.000+0000 7fe7539387c0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-05-08T18:32:11.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-05-08T18:32:11.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:32:11.884 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T18:32:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T18:32:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:32:12.453 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T18:32:12.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T18:32:12.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:32:12.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:32:12.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:32:12.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:32:12.491 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:12.492+0000 7fe0f58967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:12.515 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:12.516+0000 7fe0f58967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:12.517 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:12.516+0000 7fe0f58967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:12.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T18:32:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:32:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T18:32:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:32:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:32:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:12.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:32:12.904 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:32:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:13.070 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:13.072+0000 7fe0f58967c0 -1 Falling back to public interface 2024-05-08T18:32:13.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:14.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:14.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:14.333 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:32:14.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:32:14.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:14.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:14.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:15.623 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:15.624+0000 7fe0f58967c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:32:15.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:15.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:15.746 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:32:15.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:32:15.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:15.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:16.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:17.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:17.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:17.397 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:32:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:32:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:17.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:18.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:18.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:18.834 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:32:18.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:32:18.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:18.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:19.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:20.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:20.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:20.269 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:32:20.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:32:20.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:20.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:20.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:21.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:21.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:21.868 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:32:21.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:32:21.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:21.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:22.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:23.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:23.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:23.438 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:32:23.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:32:23.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:23.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:24.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:24.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:24.856 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:32:24.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:32:24.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:24.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:25.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:26.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:26.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:26.299 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:32:26.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:32:26.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:26.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:26.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:27.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:27.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:27.872 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:32:27.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:32:27.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:27.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:28.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:29.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:29.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:29.298 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:32:29.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:32:29.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:29.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:30.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:31.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:31.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:31.077 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:32:31.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:32:31.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:31.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:31.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:32.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:32.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:32.819 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:32:32.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:32:32.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:32.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:33.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:34.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:34.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:34.755 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:32:34.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:32:34.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:34.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:35.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:36.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:36.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:36.584 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:32:36.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:32:36.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:36.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:37.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:38.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:38.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:38.618 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:32:38.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:32:38.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:38.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:32:39.119 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3677444819,v1:127.0.0.1:6811/3677444819] [v2:127.0.0.1:6812/3677444819,v1:127.0.0.1:6813/3677444819] exists,up b542fa70-4686-4db7-b5e7-ce68e635e295 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 2 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T18:32:39.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:32:39.124 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:32:39.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:32:39.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:32:39.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T18:32:39.126 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:32:39.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=fd8731ed-9e20-4417-9712-dd7db7a6f31f 2024-05-08T18:32:39.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 fd8731ed-9e20-4417-9712-dd7db7a6f31f' 2024-05-08T18:32:39.127 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 fd8731ed-9e20-4417-9712-dd7db7a6f31f 2024-05-08T18:32:39.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:32:39.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBHxTtmGm4RCRAA1E3MbfJi0dxJNDXjLzAI9g== 2024-05-08T18:32:39.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBHxTtmGm4RCRAA1E3MbfJi0dxJNDXjLzAI9g=="}' 2024-05-08T18:32:39.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new fd8731ed-9e20-4417-9712-dd7db7a6f31f -i td/osd-backfill-space/2/new.json 2024-05-08T18:32:39.774 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:32:39.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/2/new.json 2024-05-08T18:32:39.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBHxTtmGm4RCRAA1E3MbfJi0dxJNDXjLzAI9g== --osd-uuid fd8731ed-9e20-4417-9712-dd7db7a6f31f 2024-05-08T18:32:39.837 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:39.835+0000 7fdcc6dfb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:39.839 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:39.839+0000 7fdcc6dfb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:39.841 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:39.839+0000 7fdcc6dfb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:39.841 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:39.839+0000 7fdcc6dfb7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:32:39.842 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:39.839+0000 7fdcc6dfb7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:32:39.842 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:39.839+0000 7fdcc6dfb7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:32:39.904 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:39.903+0000 7fdcc6dfb7c0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-05-08T18:32:45.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-05-08T18:32:45.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:32:45.783 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T18:32:45.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T18:32:45.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:32:46.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T18:32:46.340 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T18:32:46.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:32:46.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:32:46.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:32:46.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:32:46.371 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:46.371+0000 7f7279d447c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:46.403 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:46.403+0000 7f7279d447c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:46.405 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:46.403+0000 7f7279d447c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:32:46.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T18:32:46.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:32:46.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T18:32:46.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:32:46.759 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:32:46.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:32:46.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:46.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:32:46.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:46.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:46.944 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:46.943+0000 7f7279d447c0 -1 Falling back to public interface 2024-05-08T18:32:47.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:48.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:48.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:48.201 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:32:48.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:32:48.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:48.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:48.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:49.498 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:32:49.499+0000 7f7279d447c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:32:49.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:49.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:49.660 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:32:49.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:32:49.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:49.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:50.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:51.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:51.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:51.233 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:32:51.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:32:51.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:51.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:51.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:52.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:52.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:52.707 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:32:52.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:32:52.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:52.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:53.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:54.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:54.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:54.142 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:32:54.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:32:54.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:54.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:54.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:55.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:55.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:55.703 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:32:55.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:32:55.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:55.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:56.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:57.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:57.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:57.135 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:32:57.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:32:57.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:57.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:57.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:32:58.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:32:58.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:32:58.629 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:32:58.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:32:58.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:32:58.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:32:59.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:00.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:00.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:00.317 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:33:00.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:33:00.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:00.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:33:00.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:01.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:01.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:01.890 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:33:01.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:33:01.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:01.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:33:02.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:03.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:03.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:03.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:33:03.864 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:33:03.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:03.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:33:04.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:05.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:05.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:05.680 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:33:05.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:33:05.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:05.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:33:06.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:07.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:07.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:07.474 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:33:07.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:33:07.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:07.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:33:08.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:09.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:09.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:09.244 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:33:09.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:33:09.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:09.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:33:10.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:11.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:11.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:11.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:33:11.022 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:33:11.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:11.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:33:11.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:12.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:12.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:12.755 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:33:12.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:33:12.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:12.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:33:13.188 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2279846529,v1:127.0.0.1:6819/2279846529] [v2:127.0.0.1:6820/2279846529,v1:127.0.0.1:6821/2279846529] exists,up fd8731ed-9e20-4417-9712-dd7db7a6f31f 2024-05-08T18:33:13.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:33:13.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:33:13.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:33:13.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 3 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/3 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-05-08T18:33:13.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:33:13.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:33:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/3 2024-05-08T18:33:13.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:33:13.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=fb4097f7-c813-4a62-a8de-6fd0705a3c42 2024-05-08T18:33:13.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 fb4097f7-c813-4a62-a8de-6fd0705a3c42' 2024-05-08T18:33:13.205 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 fb4097f7-c813-4a62-a8de-6fd0705a3c42 2024-05-08T18:33:13.206 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:33:13.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBpxTtmS8oZDhAA3y+Zmy9RZE9NYc2/MJ35lA== 2024-05-08T18:33:13.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBpxTtmS8oZDhAA3y+Zmy9RZE9NYc2/MJ35lA=="}' 2024-05-08T18:33:13.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new fb4097f7-c813-4a62-a8de-6fd0705a3c42 -i td/osd-backfill-space/3/new.json 2024-05-08T18:33:13.732 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:33:13.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/3/new.json 2024-05-08T18:33:13.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBpxTtmS8oZDhAA3y+Zmy9RZE9NYc2/MJ35lA== --osd-uuid fb4097f7-c813-4a62-a8de-6fd0705a3c42 2024-05-08T18:33:13.788 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:13.787+0000 7f58484917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:13.790 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:13.791+0000 7f58484917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:13.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:13.791+0000 7f58484917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:13.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:13.791+0000 7f58484917c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:33:13.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:13.791+0000 7f58484917c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:33:13.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:13.791+0000 7f58484917c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:33:13.833 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:13.831+0000 7f58484917c0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-05-08T18:33:20.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-05-08T18:33:20.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:33:20.114 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T18:33:20.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T18:33:20.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:33:20.658 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T18:33:20.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T18:33:20.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:33:20.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:33:20.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:33:20.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:33:20.697 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:20.695+0000 7f109b8d87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:20.732 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:20.731+0000 7f109b8d87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:20.734 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:20.735+0000 7f109b8d87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:21.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T18:33:21.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:33:21.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T18:33:21.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:33:21.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:33:21.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:21.119 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:33:21.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:33:21.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:21.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:21.299 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:21.299+0000 7f109b8d87c0 -1 Falling back to public interface 2024-05-08T18:33:21.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:22.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:22.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:22.571 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:33:22.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:33:22.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:22.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:22.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:23.839 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:23.839+0000 7f109b8d87c0 -1 osd.3 0 log_to_monitors true 2024-05-08T18:33:24.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:24.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:24.001 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:33:24.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:33:24.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:24.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:24.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:25.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:25.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:25.473 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:33:25.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:33:25.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:25.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:25.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:26.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:26.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:26.952 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:33:26.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:33:26.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:26.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:27.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:28.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:28.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:28.413 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:33:28.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:33:28.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:28.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:29.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:30.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:30.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:30.064 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:33:30.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:33:30.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:30.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:30.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:31.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:31.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:31.617 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:33:31.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:33:31.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:31.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:32.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:33.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:33.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:33.087 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:33:33.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:33:33.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:33.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:33.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:34.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:34.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:34.670 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:33:34.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:33:34.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:34.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:35.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:36.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:36.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:36.202 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:33:36.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:33:36.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:36.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:36.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:37.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:37.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:37.755 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:33:37.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:33:37.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:37.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:38.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:39.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:39.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:39.902 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:33:39.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:33:39.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:39.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:40.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:41.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:41.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:41.679 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:33:41.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:33:41.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:41.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:42.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:43.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:43.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:43.419 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:33:43.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:33:43.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:43.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:44.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:45.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:45.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:45.138 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:33:45.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:33:45.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:45.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:45.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:46.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:46.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:46.887 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:33:46.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:33:46.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:46.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:33:47.394 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1316740727,v1:127.0.0.1:6827/1316740727] [v2:127.0.0.1:6828/1316740727,v1:127.0.0.1:6829/1316740727] exists,up fb4097f7-c813-4a62-a8de-6fd0705a3c42 2024-05-08T18:33:47.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:33:47.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:33:47.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:33:47.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:33:47.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 4 2024-05-08T18:33:47.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:33:47.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:33:47.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/4 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:33:47.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:33:47.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:33:47.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:33:47.399 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:33:47.399 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:33:47.399 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:33:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:33:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:33:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:33:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/4 2024-05-08T18:33:47.402 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:33:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=96789322-b608-49e0-8be1-bf192c878632 2024-05-08T18:33:47.402 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 96789322-b608-49e0-8be1-bf192c878632 2024-05-08T18:33:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 96789322-b608-49e0-8be1-bf192c878632' 2024-05-08T18:33:47.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:33:47.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCLxTtm7AbsGRAAw1cAsX5xSgptH7aVxOU64Q== 2024-05-08T18:33:47.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCLxTtm7AbsGRAAw1cAsX5xSgptH7aVxOU64Q=="}' 2024-05-08T18:33:47.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 96789322-b608-49e0-8be1-bf192c878632 -i td/osd-backfill-space/4/new.json 2024-05-08T18:33:47.939 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:33:47.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/4/new.json 2024-05-08T18:33:47.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCLxTtm7AbsGRAAw1cAsX5xSgptH7aVxOU64Q== --osd-uuid 96789322-b608-49e0-8be1-bf192c878632 2024-05-08T18:33:47.998 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:48.002+0000 7f24972177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:48.002 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:48.006+0000 7f24972177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:48.003 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:48.006+0000 7f24972177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:48.003 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:48.006+0000 7f24972177c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:33:48.003 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:48.006+0000 7f24972177c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:33:48.004 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:48.006+0000 7f24972177c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:33:48.072 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:48.074+0000 7f24972177c0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-05-08T18:33:54.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-05-08T18:33:54.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:33:54.140 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T18:33:54.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T18:33:54.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:33:54.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T18:33:54.733 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T18:33:54.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:33:54.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:33:54.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:33:54.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:33:54.771 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:54.774+0000 7fe7f22fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:54.781 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:54.782+0000 7fe7f22fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:54.782 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:54.786+0000 7fe7f22fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:33:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T18:33:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:33:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T18:33:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:33:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:33:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:33:55.145 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:33:55.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:55.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:33:55.375 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:55.378+0000 7fe7f22fb7c0 -1 Falling back to public interface 2024-05-08T18:33:55.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:56.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:56.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:56.577 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:33:56.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:33:56.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:56.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:33:56.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:57.845 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:33:57.846+0000 7fe7f22fb7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T18:33:57.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:57.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:57.984 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:33:57.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:33:57.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:57.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:33:58.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:33:59.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:33:59.492 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:33:59.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:33:59.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:33:59.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:33:59.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:33:59.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:00.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:00.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:00.971 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:34:00.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:34:00.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:00.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:01.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:02.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:02.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:02.412 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:34:02.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:34:02.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:02.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:03.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:04.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:04.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:04.038 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:34:04.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:34:04.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:04.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:04.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:05.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:05.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:05.690 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:34:05.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:34:05.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:05.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:06.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:07.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:07.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:07.119 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:34:07.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:34:07.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:07.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:07.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:08.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:08.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:08.583 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:34:08.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:34:08.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:08.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:09.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:10.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:10.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:10.033 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:34:10.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:34:10.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:10.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:10.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:11.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:11.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:11.901 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:34:11.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:34:11.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:11.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:12.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:13.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:13.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:13.329 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:34:13.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:34:13.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:13.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:14.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:15.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:15.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:15.122 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:34:15.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:34:15.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:15.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:15.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:16.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:16.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:16.807 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:34:16.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:34:16.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:16.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:17.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:18.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:18.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:18.619 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:34:18.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:34:18.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:18.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:19.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:34:20.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:34:20.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:34:20.775 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:34:20.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:34:20.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:34:20.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:34:21.207 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2082973411,v1:127.0.0.1:6835/2082973411] [v2:127.0.0.1:6836/2082973411,v1:127.0.0.1:6837/2082973411] exists,up 96789322-b608-49e0-8be1-bf192c878632 2024-05-08T18:34:21.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:34:21.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:34:21.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:34:21.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:308: TEST_backfill_test_sametarget: ceph osd set-backfillfull-ratio .85 2024-05-08T18:34:21.956 INFO:tasks.workunit.client.0.smithi117.stderr:osd set-backfillfull-ratio 0.85 2024-05-08T18:34:21.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: seq 1 10 2024-05-08T18:34:21.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:21.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test1 1 1 2024-05-08T18:34:21.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test1 1 1 2024-05-08T18:34:22.644 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' already exists 2024-05-08T18:34:22.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:23.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test1 size 2 2024-05-08T18:34:24.604 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T18:34:24.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:24.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test2 1 1 2024-05-08T18:34:24.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test2 1 1 2024-05-08T18:34:25.358 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' already exists 2024-05-08T18:34:25.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:26.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test2 size 2 2024-05-08T18:34:27.094 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 2 2024-05-08T18:34:27.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:27.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test3 1 1 2024-05-08T18:34:27.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test3 1 1 2024-05-08T18:34:27.824 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test3' already exists 2024-05-08T18:34:27.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:28.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test3 size 2 2024-05-08T18:34:29.718 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 3 size to 2 2024-05-08T18:34:29.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:29.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test4 1 1 2024-05-08T18:34:29.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test4 1 1 2024-05-08T18:34:30.498 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test4' already exists 2024-05-08T18:34:30.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:31.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test4 size 2 2024-05-08T18:34:32.390 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 4 size to 2 2024-05-08T18:34:32.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:32.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test5 1 1 2024-05-08T18:34:32.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test5 1 1 2024-05-08T18:34:33.019 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test5' already exists 2024-05-08T18:34:33.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:34.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test5 size 2 2024-05-08T18:34:34.870 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 5 size to 2 2024-05-08T18:34:34.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:34.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test6 1 1 2024-05-08T18:34:34.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test6 1 1 2024-05-08T18:34:35.617 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test6' already exists 2024-05-08T18:34:35.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:36.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test6 size 2 2024-05-08T18:34:37.262 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 6 size to 2 2024-05-08T18:34:37.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:37.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test7 1 1 2024-05-08T18:34:37.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test7 1 1 2024-05-08T18:34:38.084 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test7' already exists 2024-05-08T18:34:38.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:39.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test7 size 2 2024-05-08T18:34:39.864 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 7 size to 2 2024-05-08T18:34:39.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:39.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test8 1 1 2024-05-08T18:34:39.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test8 1 1 2024-05-08T18:34:40.613 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test8' already exists 2024-05-08T18:34:40.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:41.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test8 size 2 2024-05-08T18:34:42.431 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 8 size to 2 2024-05-08T18:34:42.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:42.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test9 1 1 2024-05-08T18:34:42.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test9 1 1 2024-05-08T18:34:43.385 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test9' already exists 2024-05-08T18:34:43.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:44.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test9 size 2 2024-05-08T18:34:45.264 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 9 size to 2 2024-05-08T18:34:45.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:34:45.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test10 1 1 2024-05-08T18:34:45.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test10 1 1 2024-05-08T18:34:46.505 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test10' already exists 2024-05-08T18:34:46.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:34:47.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test10 size 2 2024-05-08T18:34:48.535 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 10 size to 2 2024-05-08T18:34:48.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:315: TEST_backfill_test_sametarget: sleep 5 2024-05-08T18:34:53.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:317: TEST_backfill_test_sametarget: wait_for_clean 2024-05-08T18:34:53.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T18:34:53.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T18:34:53.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T18:34:53.563 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T18:34:53.564 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:34:53.564 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:34:53.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:34:53.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:34:53.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:34:53.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T18:34:53.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T18:34:53.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T18:34:53.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T18:34:53.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:34:53.691 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:34:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:34:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:34:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:34:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:34:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T18:34:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:34:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:34:54.126 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:34:54.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836520 2024-05-08T18:34:54.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836520 2024-05-08T18:34:54.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836520' 2024-05-08T18:34:54.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:34:54.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:34:54.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673000 2024-05-08T18:34:54.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673000 2024-05-08T18:34:54.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836520 1-42949673000' 2024-05-08T18:34:54.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:34:54.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:34:54.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509466 2024-05-08T18:34:54.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509466 2024-05-08T18:34:54.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836520 1-42949673000 2-64424509466' 2024-05-08T18:34:54.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:34:54.610 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:34:54.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345940 2024-05-08T18:34:54.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345940 2024-05-08T18:34:54.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836520 1-42949673000 2-64424509466 3-85899345940' 2024-05-08T18:34:54.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:34:54.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:34:54.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182415 2024-05-08T18:34:54.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182415 2024-05-08T18:34:54.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836520 1-42949673000 2-64424509466 3-85899345940 4-107374182415' 2024-05-08T18:34:54.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:34:54.938 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836520 2024-05-08T18:34:54.938 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:34:54.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:34:54.939 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836520 2024-05-08T18:34:54.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:34:54.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836520 2024-05-08T18:34:54.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836520' 2024-05-08T18:34:54.941 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836520 2024-05-08T18:34:54.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:34:55.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836518 -lt 21474836520 2024-05-08T18:34:55.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:34:56.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:34:56.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:34:56.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836520 -lt 21474836520 2024-05-08T18:34:56.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:34:56.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673000 2024-05-08T18:34:56.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:34:56.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:34:56.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673000 2024-05-08T18:34:56.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:34:56.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673000 2024-05-08T18:34:56.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673000' 2024-05-08T18:34:56.761 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673000 2024-05-08T18:34:56.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:34:57.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673000 -lt 42949673000 2024-05-08T18:34:57.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:34:57.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509466 2024-05-08T18:34:57.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:34:57.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:34:57.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509466 2024-05-08T18:34:57.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:34:57.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509466 2024-05-08T18:34:57.183 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509466 2024-05-08T18:34:57.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509466' 2024-05-08T18:34:57.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:34:57.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509466 -lt 64424509466 2024-05-08T18:34:57.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:34:57.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345940 2024-05-08T18:34:57.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:34:57.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:34:57.597 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345940 2024-05-08T18:34:57.597 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:34:57.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345940 2024-05-08T18:34:57.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345940' 2024-05-08T18:34:57.599 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345940 2024-05-08T18:34:57.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:34:58.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345940 -lt 85899345940 2024-05-08T18:34:58.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:34:58.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:34:58.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182415 2024-05-08T18:34:58.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:34:58.005 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182415 2024-05-08T18:34:58.005 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:34:58.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182415 2024-05-08T18:34:58.007 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182415 2024-05-08T18:34:58.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182415' 2024-05-08T18:34:58.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:34:58.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182416 -lt 107374182415 2024-05-08T18:34:58.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T18:34:58.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:34:58.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:34:58.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 10 == 0 2024-05-08T18:34:58.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:34:58.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:34:58.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:34:58.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:34:58.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:34:58.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:34:58.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:34:59.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=10 2024-05-08T18:34:59.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:34:59.408 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:34:59.408 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:34:59.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 10 = 10 2024-05-08T18:34:59.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T18:34:59.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T18:34:59.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:319: TEST_backfill_test_sametarget: ceph pg dump pgs 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:10.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:49.311585+0000 0'0 81:20 [2,1] 2 [2,1] 2 0'0 2024-05-08T18:34:45.858481+0000 0'0 2024-05-08T18:34:45.858481+0000 0 0 periodic scrub scheduled @ 2024-05-10T04:13:45.762160+0000 0 0 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:9.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:46.213337+0000 0'0 81:30 [1,2] 1 [1,2] 1 0'0 2024-05-08T18:34:43.040049+0000 0'0 2024-05-08T18:34:43.040049+0000 0 0 periodic scrub scheduled @ 2024-05-09T20:47:13.161566+0000 0 0 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:8.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:43.445856+0000 0'0 81:38 [3,4] 3 [3,4] 3 0'0 2024-05-08T18:34:40.402201+0000 0'0 2024-05-08T18:34:40.402201+0000 0 0 periodic scrub scheduled @ 2024-05-10T01:54:51.235363+0000 0 0 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:7.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:40.888717+0000 0'0 81:44 [1,4] 1 [1,4] 1 0'0 2024-05-08T18:34:37.785436+0000 0'0 2024-05-08T18:34:37.785436+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:38:44.649954+0000 0 0 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:6.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:38.365690+0000 0'0 81:59 [4,2] 4 [4,2] 4 0'0 2024-05-08T18:34:35.328158+0000 0'0 2024-05-08T18:34:35.328158+0000 0 0 periodic scrub scheduled @ 2024-05-10T00:03:59.098597+0000 0 0 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:5.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:35.871179+0000 0'0 81:64 [3,4] 3 [3,4] 3 0'0 2024-05-08T18:34:32.779929+0000 0'0 2024-05-08T18:34:32.779929+0000 0 0 periodic scrub scheduled @ 2024-05-10T02:36:15.863464+0000 0 0 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:4.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:33.352469+0000 0'0 81:78 [4,0] 4 [4,0] 4 0'0 2024-05-08T18:34:30.176282+0000 0'0 2024-05-08T18:34:30.176282+0000 0 0 periodic scrub scheduled @ 2024-05-10T02:03:27.140567+0000 0 0 2024-05-08T18:35:00.300 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:30.246490+0000 0'0 81:87 [1,2] 1 [1,2] 1 0'0 2024-05-08T18:34:27.470494+0000 0'0 2024-05-08T18:34:27.470494+0000 0 0 periodic scrub scheduled @ 2024-05-09T23:07:31.765016+0000 0 0 2024-05-08T18:35:00.301 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:27.854468+0000 0'0 81:91 [3,1] 3 [3,1] 3 0'0 2024-05-08T18:34:25.177694+0000 0'0 2024-05-08T18:34:25.177694+0000 0 0 periodic scrub scheduled @ 2024-05-09T22:57:16.547618+0000 0 0 2024-05-08T18:35:00.301 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:34:25.481145+0000 0'0 81:106 [1,0] 1 [1,0] 1 0'0 2024-05-08T18:34:22.406125+0000 0'0 2024-05-08T18:34:22.406125+0000 0 0 periodic scrub scheduled @ 2024-05-10T04:12:27.709135+0000 0 0 2024-05-08T18:35:00.301 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:35:00.301 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:35:00.301 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:323: TEST_backfill_test_sametarget: local PG1 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:324: TEST_backfill_test_sametarget: local POOLNUM1 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:325: TEST_backfill_test_sametarget: local pool1 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:326: TEST_backfill_test_sametarget: local chk_osd1 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:327: TEST_backfill_test_sametarget: local chk_osd2 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:329: TEST_backfill_test_sametarget: local PG2 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:330: TEST_backfill_test_sametarget: local POOLNUM2 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:331: TEST_backfill_test_sametarget: local pool2 2024-05-08T18:35:00.315 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: seq 1 10 2024-05-08T18:35:00.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:00.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: jq '.acting[]' 2024-05-08T18:35:00.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: ceph pg map 1.0 --format=json 2024-05-08T18:35:00.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2024-05-08T18:35:00.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd1=1 2024-05-08T18:35:00.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2024-05-08T18:35:00.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: local test_osd2=0 2024-05-08T18:35:00.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:337: TEST_backfill_test_sametarget: '[' 1 = 1 ']' 2024-05-08T18:35:00.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:339: TEST_backfill_test_sametarget: PG1=1.0 2024-05-08T18:35:00.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:340: TEST_backfill_test_sametarget: POOLNUM1=1 2024-05-08T18:35:00.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:341: TEST_backfill_test_sametarget: pool1=test1 2024-05-08T18:35:00.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:342: TEST_backfill_test_sametarget: chk_osd1=1 2024-05-08T18:35:00.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:343: TEST_backfill_test_sametarget: chk_osd2=0 2024-05-08T18:35:00.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:00.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: ceph pg map 2.0 --format=json 2024-05-08T18:35:00.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: jq '.acting[]' 2024-05-08T18:35:01.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2024-05-08T18:35:01.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd1=3 2024-05-08T18:35:01.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2024-05-08T18:35:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: local test_osd2=1 2024-05-08T18:35:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:337: TEST_backfill_test_sametarget: '[' 2 = 1 ']' 2024-05-08T18:35:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:344: TEST_backfill_test_sametarget: '[' 1 '!=' 3 -a 0 = 1 ']' 2024-05-08T18:35:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: ceph pg map 3.0 --format=json 2024-05-08T18:35:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: jq '.acting[]' 2024-05-08T18:35:01.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2024-05-08T18:35:01.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd1=1 2024-05-08T18:35:01.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2024-05-08T18:35:01.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: local test_osd2=2 2024-05-08T18:35:01.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:337: TEST_backfill_test_sametarget: '[' 3 = 1 ']' 2024-05-08T18:35:01.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:344: TEST_backfill_test_sametarget: '[' 1 '!=' 1 -a 0 = 2 ']' 2024-05-08T18:35:01.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:01.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: ceph pg map 4.0 --format=json 2024-05-08T18:35:01.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: jq '.acting[]' 2024-05-08T18:35:02.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2024-05-08T18:35:02.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd1=4 2024-05-08T18:35:02.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2024-05-08T18:35:02.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: local test_osd2=0 2024-05-08T18:35:02.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:337: TEST_backfill_test_sametarget: '[' 4 = 1 ']' 2024-05-08T18:35:02.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:344: TEST_backfill_test_sametarget: '[' 1 '!=' 4 -a 0 = 0 ']' 2024-05-08T18:35:02.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:346: TEST_backfill_test_sametarget: PG2=4.0 2024-05-08T18:35:02.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:347: TEST_backfill_test_sametarget: POOLNUM2=4 2024-05-08T18:35:02.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:348: TEST_backfill_test_sametarget: pool2=test4 2024-05-08T18:35:02.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:349: TEST_backfill_test_sametarget: break 2024-05-08T18:35:02.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:352: TEST_backfill_test_sametarget: rm -f td/osd-backfill-space/acting 2024-05-08T18:35:02.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:354: TEST_backfill_test_sametarget: '[' test4 = '' ']' 2024-05-08T18:35:02.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: seq 1 10 2024-05-08T18:35:02.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:02.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 1 '!=' 1 -a 1 '!=' 4 ']' 2024-05-08T18:35:02.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:02.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 2 '!=' 1 -a 2 '!=' 4 ']' 2024-05-08T18:35:02.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test2 2024-05-08T18:35:02.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test2 2024-05-08T18:35:02.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-05-08T18:35:02.564 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' does not exist 2024-05-08T18:35:02.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:02.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 3 '!=' 1 -a 3 '!=' 4 ']' 2024-05-08T18:35:02.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test3 2024-05-08T18:35:02.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test3 2024-05-08T18:35:02.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2024-05-08T18:35:03.083 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test3' does not exist 2024-05-08T18:35:03.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:03.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 4 '!=' 1 -a 4 '!=' 4 ']' 2024-05-08T18:35:03.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:03.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 5 '!=' 1 -a 5 '!=' 4 ']' 2024-05-08T18:35:03.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test5 2024-05-08T18:35:03.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test5 2024-05-08T18:35:03.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2024-05-08T18:35:03.766 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test5' does not exist 2024-05-08T18:35:03.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:03.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 6 '!=' 1 -a 6 '!=' 4 ']' 2024-05-08T18:35:03.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test6 2024-05-08T18:35:03.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test6 2024-05-08T18:35:03.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2024-05-08T18:35:04.349 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test6' does not exist 2024-05-08T18:35:04.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:04.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 7 '!=' 1 -a 7 '!=' 4 ']' 2024-05-08T18:35:04.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test7 2024-05-08T18:35:04.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test7 2024-05-08T18:35:04.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2024-05-08T18:35:05.216 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test7' does not exist 2024-05-08T18:35:05.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:05.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 8 '!=' 1 -a 8 '!=' 4 ']' 2024-05-08T18:35:05.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test8 2024-05-08T18:35:05.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test8 2024-05-08T18:35:05.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2024-05-08T18:35:05.730 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test8' does not exist 2024-05-08T18:35:05.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:05.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 9 '!=' 1 -a 9 '!=' 4 ']' 2024-05-08T18:35:05.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test9 2024-05-08T18:35:05.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test9 2024-05-08T18:35:05.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test9 test9 --yes-i-really-really-mean-it 2024-05-08T18:35:06.593 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test9' does not exist 2024-05-08T18:35:06.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-05-08T18:35:06.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 10 '!=' 1 -a 10 '!=' 4 ']' 2024-05-08T18:35:06.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test10 2024-05-08T18:35:06.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test10 2024-05-08T18:35:06.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test10 test10 --yes-i-really-really-mean-it 2024-05-08T18:35:07.134 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test10' does not exist 2024-05-08T18:35:07.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:368: TEST_backfill_test_sametarget: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2024-05-08T18:35:08.146 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T18:35:08.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:369: TEST_backfill_test_sametarget: ceph osd pool set test4 size 1 --yes-i-really-mean-it 2024-05-08T18:35:09.781 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 4 size to 1 2024-05-08T18:35:09.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:371: TEST_backfill_test_sametarget: wait_for_clean 2024-05-08T18:35:09.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T18:35:09.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T18:35:09.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T18:35:09.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T18:35:09.807 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:35:09.807 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:35:09.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:35:09.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:35:09.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:35:09.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T18:35:09.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T18:35:09.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T18:35:09.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T18:35:09.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:35:09.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:35:10.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:35:10.397 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:35:10.397 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:35:10.397 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:35:10.397 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T18:35:10.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:35:10.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:35:10.397 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:35:10.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836525 2024-05-08T18:35:10.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836525 2024-05-08T18:35:10.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836525' 2024-05-08T18:35:10.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:35:10.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:35:10.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673005 2024-05-08T18:35:10.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673005 2024-05-08T18:35:10.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836525 1-42949673005' 2024-05-08T18:35:10.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:35:10.734 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:35:10.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509471 2024-05-08T18:35:10.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509471 2024-05-08T18:35:10.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836525 1-42949673005 2-64424509471' 2024-05-08T18:35:10.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:35:10.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:35:11.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345945 2024-05-08T18:35:11.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345945 2024-05-08T18:35:11.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836525 1-42949673005 2-64424509471 3-85899345945' 2024-05-08T18:35:11.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:35:11.058 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:35:11.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182420 2024-05-08T18:35:11.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182420 2024-05-08T18:35:11.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836525 1-42949673005 2-64424509471 3-85899345945 4-107374182420' 2024-05-08T18:35:11.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:35:11.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836525 2024-05-08T18:35:11.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:35:11.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:35:11.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836525 2024-05-08T18:35:11.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:35:11.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836525 2024-05-08T18:35:11.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836525' 2024-05-08T18:35:11.224 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836525 2024-05-08T18:35:11.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:35:11.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836523 -lt 21474836525 2024-05-08T18:35:11.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:35:12.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:35:12.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:35:13.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836526 -lt 21474836525 2024-05-08T18:35:13.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:35:13.029 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:35:13.029 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673005 2024-05-08T18:35:13.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:35:13.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673005 2024-05-08T18:35:13.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:35:13.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673005 2024-05-08T18:35:13.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673005' 2024-05-08T18:35:13.033 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673005 2024-05-08T18:35:13.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:35:13.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673005 -lt 42949673005 2024-05-08T18:35:13.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:35:13.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509471 2024-05-08T18:35:13.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:35:13.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:35:13.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509471 2024-05-08T18:35:13.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:35:13.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509471 2024-05-08T18:35:13.448 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509471 2024-05-08T18:35:13.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509471' 2024-05-08T18:35:13.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:35:13.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509471 -lt 64424509471 2024-05-08T18:35:13.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:35:13.878 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345945 2024-05-08T18:35:13.878 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:35:13.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:35:13.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345945 2024-05-08T18:35:13.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:35:13.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345945 2024-05-08T18:35:13.883 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345945 2024-05-08T18:35:13.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345945' 2024-05-08T18:35:13.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:35:14.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345946 -lt 85899345945 2024-05-08T18:35:14.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:35:14.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182420 2024-05-08T18:35:14.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:35:14.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:35:14.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182420 2024-05-08T18:35:14.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:35:14.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182420 2024-05-08T18:35:14.300 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182420 2024-05-08T18:35:14.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182420' 2024-05-08T18:35:14.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:35:14.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182421 -lt 107374182420 2024-05-08T18:35:14.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T18:35:14.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:35:14.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:35:15.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 == 0 2024-05-08T18:35:15.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:35:15.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:35:15.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:35:15.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:35:15.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:35:15.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:35:15.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:35:15.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T18:35:15.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:35:15.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:35:15.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:35:16.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 2 2024-05-08T18:35:16.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T18:35:16.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T18:35:16.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2024-05-08T18:35:16.261 INFO:tasks.workunit.client.0.smithi117.stderr:4+0 records in 2024-05-08T18:35:16.261 INFO:tasks.workunit.client.0.smithi117.stderr:4+0 records out 2024-05-08T18:35:16.261 INFO:tasks.workunit.client.0.smithi117.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00012999 s, 31.5 MB/s 2024-05-08T18:35:16.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: seq 1 600 2024-05-08T18:35:16.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:16.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:35:16.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:35:16.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:16.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:35:16.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:35:16.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:16.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:35:16.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:35:16.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:16.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:35:17.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:35:17.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:17.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:35:17.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:35:17.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:17.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:35:17.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:35:17.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:17.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:35:17.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:35:17.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:17.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:35:17.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:35:17.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:17.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:35:17.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:35:17.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:17.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:35:18.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:35:18.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:18.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:35:18.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:35:18.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:18.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:35:18.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:35:18.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:18.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:35:18.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:35:18.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:18.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:35:18.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:35:18.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:18.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:35:19.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:35:19.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:19.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:35:19.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:35:19.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:19.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:35:19.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:35:19.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:19.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:35:19.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:35:19.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:19.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:35:19.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:35:19.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:19.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:35:20.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:35:20.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:20.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:35:20.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:35:20.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:20.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:35:20.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:35:20.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:20.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:35:20.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:35:20.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:20.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:35:20.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:35:20.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:20.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:35:21.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:35:21.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:21.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:35:21.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:35:21.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:21.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:35:21.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:35:21.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:21.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:35:21.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:35:21.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:21.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:35:21.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:35:21.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:21.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:35:21.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:35:22.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:22.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:35:22.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:35:22.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:22.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:35:22.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:35:22.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:22.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:35:22.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:35:22.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:22.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:35:22.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:35:22.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:22.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:35:22.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:35:22.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:22.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:35:23.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:35:23.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:23.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:35:23.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:35:23.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:23.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:35:23.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:35:23.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:23.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:35:23.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:35:23.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:23.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:35:23.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:35:23.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:23.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:35:23.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:35:24.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:24.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:35:24.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:35:24.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:24.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:35:24.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:35:24.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:24.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:35:24.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:35:24.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:24.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:35:24.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:35:24.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:24.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:35:24.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:35:25.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:25.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:35:25.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:35:25.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:25.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:35:25.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:35:25.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:25.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:35:25.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:35:25.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:25.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:35:25.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:35:25.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:25.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:35:25.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:35:25.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:25.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:35:26.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:35:26.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:26.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:35:26.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:35:26.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:26.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:35:26.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:35:26.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:26.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:35:26.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:35:26.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:26.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:35:26.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:35:26.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:26.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:35:27.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:35:27.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:27.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:35:27.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:35:27.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:27.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:35:27.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:35:27.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:27.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:35:27.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:35:27.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:27.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:35:27.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:35:27.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:27.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:35:27.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:35:28.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:28.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:35:28.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:35:28.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:28.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:35:28.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:35:28.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:28.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:35:28.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:35:28.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:28.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:35:28.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:35:28.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:28.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:35:28.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:35:29.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:29.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:35:29.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:35:29.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:29.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:35:29.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:35:29.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:29.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:35:29.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:35:29.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:29.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:35:29.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:35:29.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:29.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:35:29.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:35:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:35:30.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:35:30.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:30.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:35:30.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:35:30.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:30.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:35:30.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:35:30.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:30.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:35:30.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:35:30.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:30.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:35:30.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:35:30.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:30.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:35:30.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:35:31.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:31.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:35:31.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:35:31.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:31.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:35:31.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:35:31.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:31.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:35:31.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:35:31.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:31.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:35:31.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:35:31.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:31.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:35:31.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:35:31.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:31.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:35:32.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:35:32.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:32.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:35:32.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:35:32.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:32.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:35:32.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:35:32.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:32.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:35:32.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:35:32.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:32.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:35:32.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:35:32.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:32.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:35:33.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:35:33.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:33.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:35:33.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:35:33.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:33.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:35:33.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:35:33.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:33.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:35:33.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:35:33.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:33.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:35:33.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:35:33.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:33.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:35:33.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:35:33.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:33.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:35:34.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:35:34.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:34.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:35:34.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:35:34.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:34.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:35:34.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:35:34.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:34.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:35:34.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:35:34.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:34.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:35:34.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:35:34.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:34.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:35:35.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:35:35.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:35.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:35:35.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:35:35.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:35.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:35:35.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:35:35.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:35.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:35:35.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:35:35.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:35.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:35:35.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:35:35.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:35.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:35:35.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:35:36.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:36.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:35:36.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:35:36.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:36.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:35:36.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:35:36.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:36.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:35:36.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:35:36.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:36.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:35:36.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:35:36.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:36.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:35:36.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:35:37.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:37.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:35:37.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:35:37.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:37.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:35:37.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:35:37.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:37.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:35:37.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:35:37.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:37.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:35:37.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:35:37.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:37.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:35:37.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:35:37.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:37.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:35:38.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:35:38.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:38.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:35:38.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:35:38.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:38.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:35:38.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:35:38.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:38.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:35:38.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:35:38.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:38.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:35:38.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:35:38.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:38.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:35:39.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:35:39.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:39.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:35:39.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:35:39.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:39.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:35:39.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:35:39.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:39.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:35:39.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:35:39.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:39.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:35:40.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:35:40.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:40.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:35:40.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:35:40.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:40.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:35:40.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:35:40.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:40.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:35:40.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:35:40.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:40.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:35:40.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:35:40.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:40.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:35:41.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:35:41.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:41.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:35:41.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:35:41.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:41.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:35:41.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:35:41.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:41.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:35:41.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:35:41.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:41.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:35:41.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:35:41.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:41.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:35:41.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:35:41.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:41.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:35:42.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:35:42.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:42.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:35:42.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:35:42.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:42.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:35:42.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:35:42.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:42.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:35:42.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:35:42.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:42.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:35:42.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:35:42.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:42.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:35:43.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:35:43.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:43.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:35:43.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:35:43.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:43.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:35:43.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:35:43.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:43.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:35:43.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:35:43.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:43.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:35:43.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:35:43.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:43.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:35:43.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:35:44.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:44.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:35:44.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:35:44.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:44.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:35:44.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:35:44.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:44.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:35:44.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:35:44.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:44.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:35:44.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:35:44.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:44.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:35:45.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:35:45.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:45.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:35:45.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:35:45.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:45.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:35:45.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:35:45.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:45.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:35:45.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:35:45.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:45.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:35:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:35:45.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:45.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:35:45.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:35:46.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:46.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:35:46.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:35:46.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:46.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:35:46.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:35:46.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:46.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:35:46.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:35:46.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:46.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:35:46.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:35:46.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:46.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:35:46.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:35:46.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:46.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:35:47.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:35:47.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:47.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:35:47.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:35:47.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:47.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:35:47.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:35:47.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:47.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:35:47.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:35:47.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:47.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:35:47.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:35:47.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:47.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:35:47.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:35:48.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:48.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:35:48.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:35:48.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:48.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:35:48.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:35:48.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:48.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:35:48.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:35:48.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:48.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:35:48.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:35:48.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:48.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:35:48.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:35:49.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:49.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:35:49.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:35:49.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:49.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:35:49.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:35:49.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:49.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:35:49.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:35:49.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:49.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:35:49.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:35:49.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:49.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:35:49.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:35:49.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:49.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:35:50.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:35:50.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:50.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:35:50.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:35:50.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:50.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:35:50.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:35:50.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:50.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:35:50.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:35:50.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:50.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:35:50.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:35:50.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:50.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:35:51.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:35:51.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:51.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:35:51.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:35:51.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:51.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:35:51.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:35:51.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:51.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:35:51.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:35:51.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:51.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:35:51.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:35:51.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:51.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:35:51.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:35:52.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:52.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:35:52.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:35:52.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:52.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:35:52.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:35:52.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:52.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:35:52.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:35:52.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:52.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:35:52.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:35:52.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:52.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:35:52.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:35:53.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:53.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:35:53.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:35:53.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:53.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:35:53.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:35:53.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:53.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:35:53.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:35:53.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:53.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:35:53.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:35:53.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:53.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:35:53.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:35:53.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:53.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:35:54.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:35:54.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:54.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:35:54.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:35:54.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:54.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:35:54.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:35:54.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:54.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:35:54.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:35:54.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:54.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:35:54.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:35:54.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:54.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:35:54.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:35:55.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:55.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:35:55.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:35:55.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:55.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:35:55.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:35:55.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:55.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:35:55.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:35:55.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:55.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:35:55.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:35:55.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:55.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:35:55.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:35:55.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:55.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:35:56.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:35:56.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:56.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:35:56.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:35:56.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:56.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:35:56.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:35:56.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:56.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:35:56.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:35:56.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:56.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:35:56.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:35:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:35:57.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:35:57.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:57.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:35:57.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:35:57.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:57.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:35:57.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:35:57.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:57.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:35:57.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:35:57.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:57.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:35:57.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:35:57.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:57.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:35:57.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:35:58.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:58.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:35:58.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:35:58.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:58.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:35:58.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:35:58.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:58.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:35:58.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:35:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:58.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:35:58.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:35:58.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:58.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:35:58.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:35:59.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:59.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:35:59.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:35:59.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:59.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:35:59.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:35:59.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:59.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:35:59.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:35:59.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:59.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:35:59.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:35:59.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:59.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:35:59.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:35:59.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:35:59.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:36:00.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:36:00.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:00.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:36:00.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:36:00.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:00.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:36:00.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:36:00.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:00.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:36:00.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:36:00.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:00.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:36:00.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:36:00.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:00.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:36:00.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:36:01.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:01.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:36:01.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:36:01.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:01.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:36:01.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:36:01.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:01.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:36:01.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:36:01.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:01.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:36:01.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:36:01.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:01.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:36:01.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:36:01.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:01.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:36:02.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:36:02.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:02.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:36:02.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:36:02.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:02.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:36:02.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:36:02.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:02.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:36:02.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:36:02.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:02.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:36:02.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:36:02.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:02.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:36:03.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:36:03.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:03.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:36:03.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:36:03.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:03.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:36:03.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:36:03.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:03.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:36:03.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:36:03.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:03.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:36:03.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:36:03.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:03.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:36:04.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:36:04.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:04.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:36:04.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:36:04.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:04.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:36:04.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:36:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:36:04.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:36:04.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:04.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:36:04.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:36:04.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:04.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:36:04.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:36:05.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:05.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:36:05.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:36:05.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:05.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:36:05.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:36:05.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:05.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:36:05.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:36:05.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:05.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:36:05.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:36:05.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:05.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:36:05.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:36:05.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:05.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:36:05.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:36:06.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:06.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:36:06.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:36:06.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:06.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:36:06.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:36:06.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:06.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:36:06.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:36:06.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:06.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:36:06.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:36:06.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:06.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:36:06.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:36:07.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:07.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:36:07.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:36:07.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:07.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:36:07.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:36:07.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:07.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:36:07.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:36:07.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:07.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:36:07.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:36:07.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:07.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:36:07.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:36:07.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:07.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:36:08.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:36:08.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:08.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:36:08.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:36:08.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:08.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:36:08.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:36:08.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:08.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:36:08.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:36:08.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:08.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:36:08.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:36:08.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:08.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:36:09.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:36:09.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:09.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:36:09.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:36:09.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:09.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:36:09.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:36:09.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:09.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:36:09.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:36:09.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:09.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:36:09.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:36:09.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:09.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:36:09.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:36:10.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:10.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:36:10.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:36:10.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:10.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:36:10.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:36:10.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:10.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:36:10.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:36:11.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:11.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:36:11.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:36:11.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:11.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:36:11.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:36:11.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:11.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:36:11.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:36:11.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:11.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:36:11.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:36:11.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:11.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:36:11.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:36:11.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:11.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:36:12.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:36:12.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:12.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:36:12.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:36:12.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:12.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:36:12.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:36:12.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:12.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:36:12.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:36:12.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:12.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:36:12.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:36:12.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:12.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:36:12.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:36:13.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:13.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:36:13.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:36:13.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:13.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:36:13.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:36:13.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:13.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:36:13.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:36:13.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:13.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:36:13.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:36:13.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:13.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:36:13.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:36:13.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:13.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:36:14.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:36:14.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:14.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:36:14.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:36:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:14.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:36:14.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:36:14.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:14.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:36:14.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:36:14.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:14.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:36:14.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:36:14.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:14.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:36:15.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:36:15.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:15.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:36:15.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:36:15.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:15.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:36:15.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:36:15.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:15.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:36:15.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:36:15.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:15.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:36:15.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:36:15.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:15.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:36:15.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:36:16.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:16.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:36:16.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:36:16.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:16.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:36:16.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:36:16.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:16.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:36:16.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:36:16.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:16.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:36:16.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:36:16.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:16.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:36:16.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:36:16.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:16.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:36:17.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:36:17.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:17.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:36:17.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:36:17.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:17.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:36:17.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:36:17.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:17.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:36:17.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:36:17.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:17.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:36:17.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:36:17.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:17.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:36:17.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:36:17.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:17.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:36:17.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:36:18.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:18.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:36:18.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:36:18.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:18.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:36:18.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:36:18.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:18.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:36:18.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:36:18.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:18.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:36:18.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:36:18.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:18.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:36:18.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:36:18.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:18.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:36:18.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:36:19.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:19.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:36:19.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:36:19.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:19.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:36:19.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:36:19.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:19.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:36:19.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:36:19.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:19.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:36:19.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:36:19.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:19.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:36:19.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:36:19.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:19.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:36:19.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:36:19.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:19.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:36:20.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:36:20.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:20.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:36:20.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:36:20.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:20.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:36:20.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:36:20.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:20.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:36:20.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:36:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:36:20.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:36:20.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:20.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:36:20.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:36:20.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:20.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:36:21.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:36:21.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:21.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:36:21.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:36:21.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:21.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:36:21.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:36:21.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:21.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:36:21.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:36:21.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:21.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:36:21.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:36:21.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:21.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:36:21.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:36:21.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:21.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:36:21.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:36:22.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:22.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:36:22.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:36:22.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:22.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:36:22.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:36:22.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:22.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:36:22.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:36:22.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:22.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:36:22.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:36:22.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:22.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:36:22.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:36:22.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:22.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:36:22.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:36:23.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:23.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:36:23.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:36:23.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:23.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:36:23.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:36:23.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:23.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:36:23.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:36:23.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:23.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:36:23.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:36:23.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:23.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:36:23.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:36:23.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:23.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:36:23.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:36:23.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:23.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:36:24.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:36:24.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:24.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:36:24.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:36:24.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:24.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:36:24.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:36:24.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:24.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:36:24.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:36:24.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:24.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:36:24.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:36:24.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:24.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:36:24.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:36:24.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:24.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:36:25.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:36:25.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:25.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:36:25.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:36:25.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:25.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:36:25.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:36:25.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:25.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:36:25.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:36:25.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:25.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:36:25.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:36:25.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:25.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:36:25.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:36:25.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:25.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:36:25.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:36:25.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:25.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:36:26.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:36:26.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:26.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:36:26.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:36:26.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:26.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:36:26.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:36:26.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:26.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:36:26.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:36:26.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:26.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:36:26.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:36:26.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:26.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:36:26.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:36:26.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:26.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:36:27.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:36:27.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:27.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:36:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:36:27.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:27.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:36:27.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:36:27.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:27.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:36:27.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:36:27.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:27.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:36:27.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:36:27.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:27.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:36:27.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:36:27.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:27.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:36:27.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:36:27.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:27.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:36:28.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:36:28.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:28.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:36:28.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:36:28.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:28.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:36:28.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:36:28.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:28.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:36:28.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:36:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:36:28.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:36:28.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:28.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:36:28.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:36:28.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:28.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:36:29.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:36:29.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:29.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:36:29.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:36:29.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:29.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:36:29.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:36:29.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:29.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:36:29.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:36:29.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:29.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:36:29.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:36:29.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:29.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:36:29.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:36:29.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:29.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:36:29.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:36:30.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:30.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:36:30.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:36:30.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:30.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:36:30.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:36:30.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:30.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:36:30.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:36:30.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:30.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:36:30.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:36:30.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:30.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:36:30.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:36:30.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:30.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:36:30.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:36:30.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:30.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:36:31.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:36:31.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:31.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:36:31.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:36:31.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:31.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:36:31.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:36:31.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:31.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:36:31.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:36:31.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:31.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:36:31.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:36:31.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:31.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:36:31.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:36:31.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:31.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:36:31.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:36:31.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:31.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:36:32.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:36:32.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:32.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:36:32.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:36:32.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:32.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:36:32.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:36:32.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:32.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:36:32.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:36:32.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:32.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:36:32.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:36:32.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:32.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:36:32.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:36:32.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:32.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:36:33.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:36:33.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:33.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:36:33.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:36:33.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:33.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:36:33.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:36:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:36:33.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:36:33.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:33.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:36:33.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:36:33.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:33.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:36:33.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:36:33.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:33.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:36:33.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:36:34.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:34.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:36:34.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:36:34.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:34.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:36:34.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:36:34.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:34.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:36:34.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:36:34.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:34.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:36:34.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:36:34.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:34.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:36:34.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:36:34.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:34.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:36:34.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:36:35.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:35.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:36:35.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:36:35.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:35.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:36:35.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:36:35.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:35.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:36:35.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:36:35.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:35.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:36:35.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:36:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:36:35.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:36:35.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:35.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:36:35.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:36:35.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:35.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:36:36.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:36:36.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:36.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:36:36.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:36:36.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:36.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:36:36.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:36:36.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:36.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:36:36.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:36:36.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:36.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:36:36.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:36:36.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:36.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:36:36.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:36:36.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:36.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:36:36.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:36:37.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:37.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:36:37.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:36:37.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:37.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:36:37.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:36:37.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:37.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:36:37.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:36:37.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:37.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:36:37.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:36:37.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:37.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:36:37.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:36:37.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:37.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:36:37.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:36:37.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:37.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:36:37.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:36:38.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:38.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:36:38.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:36:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:36:38.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:36:38.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:38.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:36:38.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:36:38.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:38.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:36:38.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:36:38.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:38.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:36:38.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:36:38.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:38.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:36:39.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:36:39.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:39.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:36:39.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:36:39.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:39.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:36:39.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:36:39.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:39.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:36:39.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:36:39.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:39.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:36:39.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:36:39.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:39.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:36:39.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:36:39.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:39.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:36:39.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:36:39.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:39.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:36:40.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:36:40.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:40.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:36:40.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:36:40.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:40.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:36:40.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:36:40.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:40.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:36:40.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:36:40.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:40.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:36:40.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:36:40.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:40.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:36:40.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:36:40.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:40.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:36:40.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:36:41.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:41.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:36:41.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:36:41.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:41.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:36:41.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:36:41.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:41.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:36:41.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:36:41.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:41.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:36:41.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:36:41.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:41.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:36:41.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:36:42.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:42.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:36:42.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:36:42.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:42.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:36:42.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:36:42.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:42.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:36:42.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:36:42.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:42.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:36:42.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:36:42.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:42.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:36:42.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:36:43.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:43.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:36:43.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:36:43.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:43.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:36:43.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:36:43.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:43.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:36:43.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:36:43.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:43.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:36:43.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:36:43.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:43.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:36:43.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:36:43.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:43.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:36:43.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:36:43.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:43.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:36:44.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:36:44.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:44.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:36:44.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:36:44.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:44.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:36:44.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:36:44.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:44.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:36:44.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:36:44.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:44.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:36:44.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:36:44.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:44.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:36:44.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:36:44.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:44.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:36:44.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:36:45.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:45.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:36:45.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:36:45.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:45.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:36:45.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:36:45.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:45.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:36:45.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:36:45.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:45.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:36:45.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:36:45.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:45.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:36:45.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:36:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:36:45.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:36:45.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:45.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:36:46.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:36:46.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:46.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:36:46.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:36:46.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:46.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:36:46.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:36:46.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:46.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:36:46.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:36:46.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:46.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:36:46.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:36:46.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:46.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:36:46.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:36:46.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:46.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:36:46.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:36:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:47.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:36:47.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:36:47.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:47.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:36:47.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:36:47.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:47.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:36:47.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:36:47.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:47.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:36:47.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:36:47.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:47.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:36:47.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:36:47.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:47.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:36:47.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:36:47.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:47.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:36:48.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:36:48.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:48.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:36:48.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:36:48.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:48.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:36:48.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:36:48.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:48.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:36:48.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:36:48.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:48.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:36:48.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:36:48.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:48.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:36:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:36:48.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:48.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:36:48.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:36:49.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:49.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:36:49.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:36:49.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:49.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:36:49.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:36:49.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:49.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:36:49.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:36:49.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:49.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:36:49.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:36:49.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:49.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:36:49.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:36:49.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:49.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:36:49.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:36:49.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:49.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:36:50.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:36:50.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:50.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:36:50.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:36:50.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:50.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:36:50.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:36:50.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:50.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:36:50.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:36:50.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:50.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:36:50.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:36:50.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:50.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:36:50.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:36:50.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:50.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:36:51.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:36:51.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:51.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:36:51.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:36:51.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:51.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:36:51.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:36:51.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:51.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:36:51.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:36:51.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:51.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:36:51.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:36:51.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:51.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:36:51.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:36:51.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:51.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:36:51.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:36:51.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:51.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:36:52.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:36:52.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:52.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:36:52.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:36:52.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:52.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:36:52.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:36:52.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:52.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:36:52.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:36:52.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:52.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:36:52.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:36:52.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:52.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:36:52.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:36:53.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:53.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:36:53.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:36:53.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:53.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:36:53.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:36:53.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:53.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:36:53.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:36:53.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:53.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:36:53.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:36:53.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:53.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:36:53.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:36:53.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:53.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:36:53.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:36:53.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:53.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:36:54.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:36:54.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:54.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:36:54.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:36:54.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:54.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:36:54.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:36:54.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:54.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:36:54.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:36:54.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:54.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:36:54.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:36:54.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:54.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:36:54.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:36:54.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:54.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:36:54.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:36:55.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:55.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:36:55.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:36:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:55.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:36:55.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:36:55.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:55.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:36:55.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:36:55.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:55.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:36:55.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:36:55.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:55.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:36:55.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:36:55.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:55.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:36:55.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:36:55.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:55.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:36:55.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:36:55.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:55.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:36:56.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:36:56.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:56.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:36:56.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:36:56.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:56.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:36:56.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:36:56.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:56.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:36:56.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:36:56.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:56.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:36:56.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:36:56.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:56.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:36:56.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:36:57.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:57.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:36:57.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:36:57.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:57.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:36:57.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:36:57.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:57.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:36:57.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:36:57.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:57.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:36:57.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:36:57.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:57.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:36:57.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:36:57.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:57.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:36:57.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:36:57.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:57.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:36:57.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:36:58.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:58.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:36:58.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:36:58.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:58.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:36:58.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:36:58.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:58.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:36:58.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:36:58.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:58.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:36:58.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:36:58.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:58.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:36:58.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:36:58.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:58.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:36:58.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:36:58.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:58.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:36:59.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:36:59.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:59.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:36:59.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:36:59.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:59.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:36:59.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:36:59.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:59.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:36:59.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:36:59.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:59.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:36:59.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:36:59.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:59.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:36:59.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:36:59.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:59.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:36:59.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:36:59.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:36:59.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:37:00.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:37:00.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:37:00.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:37:00.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:37:00.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:37:00.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:37:00.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:37:00.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:37:00.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:37:00.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:37:00.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:37:00.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:37:00.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:37:00.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:37:00.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:37:00.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:37:00.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-05-08T18:37:00.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:37:00.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:37:00.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:380: TEST_backfill_test_sametarget: ceph osd pool set test1 size 2 2024-05-08T18:37:01.663 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T18:37:01.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:381: TEST_backfill_test_sametarget: ceph osd pool set test4 size 2 2024-05-08T18:37:02.921 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 4 size to 2 2024-05-08T18:37:02.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:382: TEST_backfill_test_sametarget: sleep 30 2024-05-08T18:37:32.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:384: TEST_backfill_test_sametarget: wait_for_not_backfilling 1200 2024-05-08T18:37:32.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-05-08T18:37:32.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-05-08T18:37:32.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-05-08T18:37:32.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:37:32.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:37:32.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-05-08T18:37:32.948 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:37:32.948 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:37:32.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:37:32.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:37:32.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:37:33.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-05-08T18:37:33.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:37:33.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:37:33.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:37:33.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:37:33.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:37:34.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:37:34.139 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:37:34.139 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:37:34.139 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:37:34.139 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T18:37:34.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:37:34.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:34.144 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:37:34.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836556 2024-05-08T18:37:34.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836556 2024-05-08T18:37:34.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556' 2024-05-08T18:37:34.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:34.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:37:34.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673036 2024-05-08T18:37:34.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673036 2024-05-08T18:37:34.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673036' 2024-05-08T18:37:34.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:34.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:37:34.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509502 2024-05-08T18:37:34.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509502 2024-05-08T18:37:34.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673036 2-64424509502' 2024-05-08T18:37:34.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:34.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:37:34.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345976 2024-05-08T18:37:34.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345976 2024-05-08T18:37:34.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673036 2-64424509502 3-85899345976' 2024-05-08T18:37:34.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:34.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:37:35.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182451 2024-05-08T18:37:35.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182451 2024-05-08T18:37:35.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673036 2-64424509502 3-85899345976 4-107374182451' 2024-05-08T18:37:35.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:35.010 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836556 2024-05-08T18:37:35.010 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:37:35.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836556 2024-05-08T18:37:35.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836556 2024-05-08T18:37:35.012 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836556 2024-05-08T18:37:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836556' 2024-05-08T18:37:35.013 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:37:35.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836554 -lt 21474836556 2024-05-08T18:37:35.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:37:36.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:37:36.427 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:37:36.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836556 -lt 21474836556 2024-05-08T18:37:36.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:36.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:36.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673036 2024-05-08T18:37:36.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:37:36.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673036 2024-05-08T18:37:36.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:36.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673036 2024-05-08T18:37:36.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673036' 2024-05-08T18:37:36.901 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673036 2024-05-08T18:37:36.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:37:37.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673036 -lt 42949673036 2024-05-08T18:37:37.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:37.337 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509502 2024-05-08T18:37:37.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:37.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:37:37.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509502 2024-05-08T18:37:37.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:37.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509502 2024-05-08T18:37:37.342 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509502 2024-05-08T18:37:37.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509502' 2024-05-08T18:37:37.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:37:37.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509502 -lt 64424509502 2024-05-08T18:37:37.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:37.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345976 2024-05-08T18:37:37.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:37.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:37:37.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345976 2024-05-08T18:37:37.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:37.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345976 2024-05-08T18:37:37.819 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345976 2024-05-08T18:37:37.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345976' 2024-05-08T18:37:37.819 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:37:38.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345977 -lt 85899345976 2024-05-08T18:37:38.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:38.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182451 2024-05-08T18:37:38.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:38.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:37:38.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182451 2024-05-08T18:37:38.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:38.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182451 2024-05-08T18:37:38.235 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182451 2024-05-08T18:37:38.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182451' 2024-05-08T18:37:38.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:37:38.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182452 -lt 107374182451 2024-05-08T18:37:38.723 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:37:38.724 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:37:38.724 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:37:39.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-05-08T18:37:39.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:37:39.273 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:37:39.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:37:39.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:37:39.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:37:39.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:37:39.274 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:37:39.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-05-08T18:37:39.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-05-08T18:37:39.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' -1 2024-05-08T18:37:39.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-05-08T18:37:39.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=1 2024-05-08T18:37:39.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-05-08T18:37:44.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:37:44.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:37:44.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:37:44.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:37:44.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:37:44.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:37:44.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:37:44.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:385: TEST_backfill_test_sametarget: wait_for_not_activating 60 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-05-08T18:37:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:37:45.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:37:45.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-05-08T18:37:45.113 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:37:45.113 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:37:45.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:37:45.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:37:45.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:37:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-05-08T18:37:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:37:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:37:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:37:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:37:45.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:37:45.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:37:45.577 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:37:45.577 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:37:45.577 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:37:45.577 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T18:37:45.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:37:45.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:45.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:37:45.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836560 2024-05-08T18:37:45.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836560 2024-05-08T18:37:45.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836560' 2024-05-08T18:37:45.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:45.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:37:45.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673040 2024-05-08T18:37:45.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673040 2024-05-08T18:37:45.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836560 1-42949673040' 2024-05-08T18:37:45.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:45.889 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:37:46.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509506 2024-05-08T18:37:46.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509506 2024-05-08T18:37:46.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836560 1-42949673040 2-64424509506' 2024-05-08T18:37:46.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:46.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:37:46.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345980 2024-05-08T18:37:46.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345980 2024-05-08T18:37:46.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836560 1-42949673040 2-64424509506 3-85899345980' 2024-05-08T18:37:46.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:37:46.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:37:46.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182456 2024-05-08T18:37:46.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182456 2024-05-08T18:37:46.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836560 1-42949673040 2-64424509506 3-85899345980 4-107374182456' 2024-05-08T18:37:46.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:46.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836560 2024-05-08T18:37:46.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:46.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:37:46.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:46.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836560 2024-05-08T18:37:46.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836560 2024-05-08T18:37:46.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836560' 2024-05-08T18:37:46.357 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836560 2024-05-08T18:37:46.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:37:46.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836560 -lt 21474836560 2024-05-08T18:37:46.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:46.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673040 2024-05-08T18:37:46.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:46.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:37:46.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673040 2024-05-08T18:37:46.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:46.787 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673040 2024-05-08T18:37:46.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673040 2024-05-08T18:37:46.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673040' 2024-05-08T18:37:46.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:37:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673040 -lt 42949673040 2024-05-08T18:37:47.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:47.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509506 2024-05-08T18:37:47.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:47.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:37:47.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509506 2024-05-08T18:37:47.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:47.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509506 2024-05-08T18:37:47.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509506' 2024-05-08T18:37:47.214 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509506 2024-05-08T18:37:47.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:37:47.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509506 -lt 64424509506 2024-05-08T18:37:47.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:47.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345980 2024-05-08T18:37:47.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:47.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:37:47.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345980 2024-05-08T18:37:47.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:47.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345980 2024-05-08T18:37:47.626 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345980 2024-05-08T18:37:47.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345980' 2024-05-08T18:37:47.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:37:48.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345978 -lt 85899345980 2024-05-08T18:37:48.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:37:49.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:37:49.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:37:49.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345981 -lt 85899345980 2024-05-08T18:37:49.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:37:49.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182456 2024-05-08T18:37:49.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:37:49.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:37:49.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182456 2024-05-08T18:37:49.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:37:49.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182456 2024-05-08T18:37:49.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182456' 2024-05-08T18:37:49.461 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182456 2024-05-08T18:37:49.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:37:50.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182456 -lt 107374182456 2024-05-08T18:37:50.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:37:50.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:37:50.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:37:50.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-05-08T18:37:50.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:37:50.572 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-05-08T18:37:50.572 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-05-08T18:37:50.572 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:37:50.572 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-05-08T18:37:50.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:37:50.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-05-08T18:37:50.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:37:50.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:37:50.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:37:50.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:37:50.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:387: TEST_backfill_test_sametarget: ERRORS=0 2024-05-08T18:37:50.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:388: TEST_backfill_test_sametarget: grep +backfill_toofull 2024-05-08T18:37:50.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:388: TEST_backfill_test_sametarget: wc -l 2024-05-08T18:37:50.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:388: TEST_backfill_test_sametarget: ceph pg dump pgs 2024-05-08T18:37:51.344 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:37:51.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:388: TEST_backfill_test_sametarget: '[' 1 '!=' 1 ']' 2024-05-08T18:37:51.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:394: TEST_backfill_test_sametarget: ceph pg dump pgs 2024-05-08T18:37:51.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:394: TEST_backfill_test_sametarget: wc -l 2024-05-08T18:37:51.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:394: TEST_backfill_test_sametarget: grep active+clean 2024-05-08T18:37:51.743 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:37:51.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:394: TEST_backfill_test_sametarget: '[' 1 '!=' 1 ']' 2024-05-08T18:37:51.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:400: TEST_backfill_test_sametarget: ceph pg dump pgs 2024-05-08T18:37:52.125 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:37:52.126 INFO:tasks.workunit.client.0.smithi117.stdout:4.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T18:37:34.354524+0000 95'600 106:733 [4,0] 4 [4] 4 0'0 2024-05-08T18:34:30.176282+0000 0'0 2024-05-08T18:34:30.176282+0000 0 0 no scrub is scheduled 0 0 2024-05-08T18:37:52.126 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-05-08T18:37:38.786404+0000 95'600 106:1961 [1,0] 1 [1,0] 1 0'0 2024-05-08T18:34:22.406125+0000 0'0 2024-05-08T18:34:22.406125+0000 0 0 periodic scrub scheduled @ 2024-05-10T01:24:13.031215+0000 0 0 2024-05-08T18:37:52.126 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:37:52.126 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:37:52.126 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:37:52.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:402: TEST_backfill_test_sametarget: '[' 0 '!=' 0 ']' 2024-05-08T18:37:52.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:407: TEST_backfill_test_sametarget: delete_pool test1 2024-05-08T18:37:52.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test1 2024-05-08T18:37:52.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-05-08T18:37:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' does not exist 2024-05-08T18:37:52.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:408: TEST_backfill_test_sametarget: delete_pool test4 2024-05-08T18:37:52.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test4 2024-05-08T18:37:52.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2024-05-08T18:37:53.209 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test4' does not exist 2024-05-08T18:37:53.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:409: TEST_backfill_test_sametarget: kill_daemons td/osd-backfill-space 2024-05-08T18:37:53.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:37:53.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:37:53.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:37:53.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:37:53.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:37:58.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:37:58.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:410: TEST_backfill_test_sametarget: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log td/osd-backfill-space/osd.3.log td/osd-backfill-space/osd.4.log 2024-05-08T18:37:58.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-05-08T18:37:58.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:37:58.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:37:58.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:37:58.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:37:58.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:37:58.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:37:58.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:37:58.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:37:58.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:37:58.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:37:58.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:37:58.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:37:58.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:37:58.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:37:58.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:37:58.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:37:58.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:37:58.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:37:58.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:37:58.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:37:58.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:37:58.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:37:58.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:37:58.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:37:58.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:37:58.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:37:58.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:37:58.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:37:58.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-05-08T18:37:58.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-05-08T18:37:58.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2024-05-08T18:37:58.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2024-05-08T18:37:58.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:37:58.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:37:58.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:37:58.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:37:58.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:37:58.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:37:58.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:37:58.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:37:58.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:37:58.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:37:58.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:37:58.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:37:58.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:37:58.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:37:58.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:37:58.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:37:58.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:37:58.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:37:58.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:37:58.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:37:58.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:37:58.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:37:58.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:37:58.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:37:58.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:37:58.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:37:58.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:37:58.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:37:58.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2024-05-08T18:37:58.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T18:37:58.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:37:58.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:37:58.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.109971 2024-05-08T18:37:58.691 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_test_simple td/osd-backfill-space 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:110: TEST_backfill_test_simple: local dir=td/osd-backfill-space 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:111: TEST_backfill_test_simple: local pools=2 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:112: TEST_backfill_test_simple: local OSDS=3 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:114: TEST_backfill_test_simple: run_mon td/osd-backfill-space a 2024-05-08T18:37:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2024-05-08T18:37:58.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T18:37:58.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T18:37:58.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T18:37:58.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2024-05-08T18:37:58.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-05-08T18:37:59.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T18:37:59.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:37:59.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:37:59.079 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:37:59.080 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:37:59.080 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:37:59.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:37:59.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T18:37:59.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T18:37:59.290 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T18:37:59.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:37:59.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:37:59.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T18:37:59.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T18:37:59.292 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:37:59.292 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:37:59.292 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:37:59.293 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:37:59.293 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:37:59.293 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:37:59.293 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:37:59.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:37:59.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get fsid 2024-05-08T18:37:59.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T18:37:59.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:37:59.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:37:59.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T18:37:59.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T18:37:59.414 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:37:59.414 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:37:59.414 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:37:59.415 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:37:59.415 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:37:59.415 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:37:59.415 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:37:59.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:37:59.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get mon_host 2024-05-08T18:37:59.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:115: TEST_backfill_test_simple: run_mgr td/osd-backfill-space x 2024-05-08T18:37:59.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-space 2024-05-08T18:37:59.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T18:37:59.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T18:37:59.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T18:37:59.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-space/x 2024-05-08T18:37:59.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T18:38:00.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T18:38:00.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:38:00.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:38:00.444 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:38:00.444 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:38:00.444 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:38:00.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:38:00.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:38:00.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:38:00.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:116: TEST_backfill_test_simple: export CEPH_ARGS 2024-05-08T18:38:00.482 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: expr 3 - 1 2024-05-08T18:38:00.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: seq 0 2 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:120: TEST_backfill_test_simple: run_osd td/osd-backfill-space 0 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:38:00.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:38:00.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:38:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T18:38:00.489 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:38:00.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=febee55b-a7dc-4afa-a99c-8bb50cadd1f7 2024-05-08T18:38:00.489 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 febee55b-a7dc-4afa-a99c-8bb50cadd1f7 2024-05-08T18:38:00.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 febee55b-a7dc-4afa-a99c-8bb50cadd1f7' 2024-05-08T18:38:00.489 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:38:00.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCIxjtmoo+wHhAAzYgHfFsrUxnXSPNeFe2etQ== 2024-05-08T18:38:00.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCIxjtmoo+wHhAAzYgHfFsrUxnXSPNeFe2etQ=="}' 2024-05-08T18:38:00.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new febee55b-a7dc-4afa-a99c-8bb50cadd1f7 -i td/osd-backfill-space/0/new.json 2024-05-08T18:38:00.818 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:38:00.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/0/new.json 2024-05-08T18:38:00.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCIxjtmoo+wHhAAzYgHfFsrUxnXSPNeFe2etQ== --osd-uuid febee55b-a7dc-4afa-a99c-8bb50cadd1f7 2024-05-08T18:38:00.872 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:00.873+0000 7f922ad847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:00.885 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:00.889+0000 7f922ad847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:00.887 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:00.889+0000 7f922ad847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:00.888 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:00.889+0000 7f922ad847c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:38:00.888 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:00.889+0000 7f922ad847c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:38:00.888 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:00.889+0000 7f922ad847c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:38:00.926 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:00.929+0000 7f922ad847c0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-05-08T18:38:06.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-05-08T18:38:06.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:38:06.861 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T18:38:06.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T18:38:06.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:38:07.459 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T18:38:07.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T18:38:07.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:38:07.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:38:07.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:38:07.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:38:07.499 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:07.501+0000 7fe045fc07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:07.524 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:07.525+0000 7fe045fc07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:07.525 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:07.529+0000 7fe045fc07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:07.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T18:38:07.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:38:07.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T18:38:07.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:38:07.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:38:07.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:07.908 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:38:07.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:38:07.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:07.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:08.070 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:08.073+0000 7fe045fc07c0 -1 Falling back to public interface 2024-05-08T18:38:08.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:09.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:09.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:09.307 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:38:09.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:38:09.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:09.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:09.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:10.595 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:10.597+0000 7fe045fc07c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:38:10.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:10.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:10.740 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:38:10.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:38:10.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:10.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:11.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:12.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:12.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:12.296 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:38:12.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:38:12.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:12.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:12.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:13.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:13.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:13.723 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:38:13.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:38:13.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:13.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:14.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:15.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:15.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:15.153 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:38:15.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:38:15.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:15.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:15.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:16.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:16.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:16.584 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:38:16.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:38:16.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:16.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:17.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:18.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:18.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:18.048 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:38:18.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:38:18.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:18.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:18.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:19.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:19.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:19.464 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:38:19.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:38:19.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:19.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:19.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:20.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:20.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:20.941 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:38:20.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:38:20.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:20.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:21.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:22.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:22.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:22.640 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:38:22.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:38:22.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:22.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:23.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:24.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:24.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:24.327 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:38:24.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:38:24.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:24.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:24.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:25.870 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:38:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:38:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:26.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:27.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:27.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:27.651 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:38:27.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:38:27.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:27.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:28.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:29.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:29.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:29.479 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:38:29.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:38:29.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:29.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:30.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:31.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:31.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:31.392 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:38:31.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:38:31.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:31.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:32.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:33.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:33.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:33.012 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:38:33.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:38:33.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:33.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:38:33.452 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2400128340,v1:127.0.0.1:6803/2400128340] [v2:127.0.0.1:6804/2400128340,v1:127.0.0.1:6805/2400128340] exists,up febee55b-a7dc-4afa-a99c-8bb50cadd1f7 2024-05-08T18:38:33.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:38:33.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:38:33.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:38:33.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:38:33.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:120: TEST_backfill_test_simple: run_osd td/osd-backfill-space 1 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:38:33.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:38:33.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:38:33.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:38:33.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:38:33.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:38:33.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:38:33.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T18:38:33.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:38:33.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=63c33d7c-ca77-4c86-a8b0-ee67248cfae1 2024-05-08T18:38:33.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 63c33d7c-ca77-4c86-a8b0-ee67248cfae1' 2024-05-08T18:38:33.459 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 63c33d7c-ca77-4c86-a8b0-ee67248cfae1 2024-05-08T18:38:33.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:38:33.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCpxjtmkowsHRAAiXmEBMLPM90xDaOSLftfRQ== 2024-05-08T18:38:33.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCpxjtmkowsHRAAiXmEBMLPM90xDaOSLftfRQ=="}' 2024-05-08T18:38:33.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 63c33d7c-ca77-4c86-a8b0-ee67248cfae1 -i td/osd-backfill-space/1/new.json 2024-05-08T18:38:34.032 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:38:34.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/1/new.json 2024-05-08T18:38:34.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCpxjtmkowsHRAAiXmEBMLPM90xDaOSLftfRQ== --osd-uuid 63c33d7c-ca77-4c86-a8b0-ee67248cfae1 2024-05-08T18:38:34.088 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:34.089+0000 7f4a4e7b27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:34.094 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:34.097+0000 7f4a4e7b27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:34.095 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:34.097+0000 7f4a4e7b27c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:34.096 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:34.097+0000 7f4a4e7b27c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:38:34.096 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:34.097+0000 7f4a4e7b27c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:38:34.096 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:34.097+0000 7f4a4e7b27c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:38:34.134 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:34.137+0000 7f4a4e7b27c0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-05-08T18:38:39.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-05-08T18:38:39.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:38:39.679 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T18:38:39.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T18:38:39.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:38:40.233 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T18:38:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T18:38:40.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:38:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:38:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:38:40.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:38:40.273 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:40.277+0000 7f44833ac7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:40.281 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:40.285+0000 7f44833ac7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:40.283 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:40.285+0000 7f44833ac7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:38:40.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T18:38:40.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:38:40.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T18:38:40.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:38:40.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:38:40.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:40.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:38:40.659 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:38:40.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:40.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:40.858 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:40.861+0000 7f44833ac7c0 -1 Falling back to public interface 2024-05-08T18:38:41.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:42.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:42.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:42.147 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:38:42.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:38:42.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:42.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:42.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:43.429 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:38:43.433+0000 7f44833ac7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:38:43.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:43.558 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:38:43.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:43.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:38:43.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:43.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:44.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:45.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:45.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:45.141 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:38:45.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:38:45.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:45.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:45.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:46.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:46.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:46.609 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:38:46.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:38:46.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:46.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:47.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:48.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:48.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:48.069 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:38:48.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:38:48.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:48.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:48.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:49.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:49.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:49.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:38:49.562 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:38:49.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:49.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:50.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:51.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:51.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:51.267 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:38:51.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:38:51.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:51.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:51.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:52.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:52.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:52.816 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:38:52.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:38:52.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:52.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:53.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:54.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:54.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:54.478 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:38:54.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:38:54.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:54.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:54.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:55.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:55.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:55.995 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:38:55.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:38:55.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:55.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:56.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:57.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:57.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:57.917 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:38:57.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:38:57.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:57.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:38:58.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:38:59.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:38:59.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:38:59.994 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:38:59.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:38:59.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:38:59.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:39:00.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:01.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:01.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:01.981 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:39:01.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:39:01.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:01.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:39:02.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:03.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:03.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:03.755 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:39:03.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:39:03.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:03.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:39:04.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:05.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:05.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:05.811 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:39:05.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:39:05.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:05.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:39:06.270 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4267478114,v1:127.0.0.1:6811/4267478114] [v2:127.0.0.1:6812/4267478114,v1:127.0.0.1:6813/4267478114] exists,up 63c33d7c-ca77-4c86-a8b0-ee67248cfae1 2024-05-08T18:39:06.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:39:06.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:39:06.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:120: TEST_backfill_test_simple: run_osd td/osd-backfill-space 2 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T18:39:06.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:39:06.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:39:06.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T18:39:06.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:39:06.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=52cc4468-65e2-4a5d-be3a-d928004b5aff 2024-05-08T18:39:06.277 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 52cc4468-65e2-4a5d-be3a-d928004b5aff 2024-05-08T18:39:06.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 52cc4468-65e2-4a5d-be3a-d928004b5aff' 2024-05-08T18:39:06.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:39:06.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDKxjtmqxBREhAABy7mmeCun+9try5SXPXxfg== 2024-05-08T18:39:06.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDKxjtmqxBREhAABy7mmeCun+9try5SXPXxfg=="}' 2024-05-08T18:39:06.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 52cc4468-65e2-4a5d-be3a-d928004b5aff -i td/osd-backfill-space/2/new.json 2024-05-08T18:39:06.964 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:39:06.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/2/new.json 2024-05-08T18:39:06.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDKxjtmqxBREhAABy7mmeCun+9try5SXPXxfg== --osd-uuid 52cc4468-65e2-4a5d-be3a-d928004b5aff 2024-05-08T18:39:07.023 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:07.024+0000 7f50b9fcf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:39:07.025 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:07.028+0000 7f50b9fcf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:39:07.026 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:07.028+0000 7f50b9fcf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:39:07.027 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:07.028+0000 7f50b9fcf7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:39:07.027 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:07.028+0000 7f50b9fcf7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:39:07.027 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:07.028+0000 7f50b9fcf7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:39:07.093 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:07.096+0000 7f50b9fcf7c0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-05-08T18:39:13.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-05-08T18:39:13.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:39:13.107 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T18:39:13.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T18:39:13.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:39:13.681 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T18:39:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T18:39:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:39:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:39:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:39:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:39:13.720 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:13.720+0000 7fd2bc3967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:39:13.722 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:13.724+0000 7fd2bc3967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:39:13.724 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:13.724+0000 7fd2bc3967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:39:14.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T18:39:14.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:39:14.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T18:39:14.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:39:14.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:39:14.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:14.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:39:14.108 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:39:14.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:14.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:14.278 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:14.280+0000 7fd2bc3967c0 -1 Falling back to public interface 2024-05-08T18:39:14.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:15.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:15.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:15.523 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:39:15.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:39:15.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:15.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:15.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:16.782 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:39:16.784+0000 7fd2bc3967c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:39:16.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:16.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:16.946 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:39:16.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:39:16.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:16.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:17.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:18.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:18.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:18.366 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:39:18.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:39:18.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:18.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:18.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:19.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:19.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:19.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:39:19.818 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:39:19.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:19.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:20.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:21.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:21.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:21.294 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:39:21.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:39:21.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:21.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:21.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:22.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:22.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:22.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:39:22.713 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:39:22.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:22.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:23.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:24.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:24.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:24.162 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:39:24.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:39:24.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:24.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:24.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:25.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:25.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:25.694 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:39:25.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:39:25.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:25.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:26.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:27.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:27.176 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:39:27.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:39:27.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:27.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:27.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:28.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:28.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:28.763 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:39:28.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:39:28.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:28.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:29.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:30.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:30.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:30.212 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:39:30.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:39:30.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:30.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:31.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:32.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:32.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:32.250 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:39:32.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:39:32.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:32.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:33.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:34.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:34.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:34.022 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:39:34.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:39:34.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:34.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:34.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:35.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:35.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:35.764 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:39:35.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:39:35.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:35.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:36.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:37.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:37.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:37.866 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:39:37.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:39:37.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:37.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:38.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:39:39.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:39:39.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:39:39.944 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:39:39.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:39:39.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:39:39.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:39:40.365 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2090718003,v1:127.0.0.1:6819/2090718003] [v2:127.0.0.1:6820/2090718003,v1:127.0.0.1:6821/2090718003] exists,up 52cc4468-65e2-4a5d-be3a-d928004b5aff 2024-05-08T18:39:40.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:39:40.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:39:40.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:39:40.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:123: TEST_backfill_test_simple: ceph osd set-backfillfull-ratio .85 2024-05-08T18:39:41.017 INFO:tasks.workunit.client.0.smithi117.stderr:osd set-backfillfull-ratio 0.85 2024-05-08T18:39:41.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:125: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:125: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:127: TEST_backfill_test_simple: create_pool test1 1 1 2024-05-08T18:39:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test1 1 1 2024-05-08T18:39:41.613 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' already exists 2024-05-08T18:39:41.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:39:42.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:128: TEST_backfill_test_simple: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2024-05-08T18:39:43.754 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T18:39:43.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:125: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:43.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:127: TEST_backfill_test_simple: create_pool test2 1 1 2024-05-08T18:39:43.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test2 1 1 2024-05-08T18:39:44.385 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' already exists 2024-05-08T18:39:44.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:39:45.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:128: TEST_backfill_test_simple: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2024-05-08T18:39:46.518 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 1 2024-05-08T18:39:46.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:131: TEST_backfill_test_simple: wait_for_clean 2024-05-08T18:39:46.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T18:39:46.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T18:39:46.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T18:39:46.545 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T18:39:46.546 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:39:46.546 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:39:46.546 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:39:46.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:39:46.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:39:46.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T18:39:46.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T18:39:46.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T18:39:46.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T18:39:46.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:39:46.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:39:47.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:39:47.095 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:39:47.095 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T18:39:47.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:39:47.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:39:47.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:39:47.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836498 2024-05-08T18:39:47.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836498 2024-05-08T18:39:47.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836498' 2024-05-08T18:39:47.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:39:47.285 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:39:47.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672974 2024-05-08T18:39:47.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672974 2024-05-08T18:39:47.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836498 1-42949672974' 2024-05-08T18:39:47.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:39:47.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:39:47.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509446 2024-05-08T18:39:47.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509446 2024-05-08T18:39:47.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836498 1-42949672974 2-64424509446' 2024-05-08T18:39:47.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:39:47.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836498 2024-05-08T18:39:47.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:39:47.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:39:47.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836498 2024-05-08T18:39:47.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:39:47.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836498 2024-05-08T18:39:47.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2024-05-08T18:39:47.626 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836498 2024-05-08T18:39:47.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:39:48.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836496 -lt 21474836498 2024-05-08T18:39:48.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:39:49.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:39:49.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:39:49.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836499 -lt 21474836498 2024-05-08T18:39:49.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:39:49.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672974 2024-05-08T18:39:49.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:39:49.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:39:49.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672974 2024-05-08T18:39:49.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:39:49.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672974 2024-05-08T18:39:49.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2024-05-08T18:39:49.452 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672974 2024-05-08T18:39:49.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:39:49.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672974 -lt 42949672974 2024-05-08T18:39:49.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:39:49.859 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:39:49.859 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509446 2024-05-08T18:39:49.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:39:49.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509446 2024-05-08T18:39:49.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:39:49.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509446 2024-05-08T18:39:49.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2024-05-08T18:39:49.862 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509446 2024-05-08T18:39:49.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:39:50.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509446 -lt 64424509446 2024-05-08T18:39:50.281 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T18:39:50.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:39:50.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:39:50.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 == 0 2024-05-08T18:39:50.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:39:50.810 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:39:50.810 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:39:50.810 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:39:50.810 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:39:50.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:39:50.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:39:51.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=2 2024-05-08T18:39:51.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:39:51.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:39:51.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:39:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 2 = 2 2024-05-08T18:39:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T18:39:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T18:39:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:136: TEST_backfill_test_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2024-05-08T18:39:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:4+0 records in 2024-05-08T18:39:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:4+0 records out 2024-05-08T18:39:51.761 INFO:tasks.workunit.client.0.smithi117.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000132789 s, 30.8 MB/s 2024-05-08T18:39:51.762 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: seq 1 600 2024-05-08T18:39:51.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:51.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:51.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:51.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:39:51.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:51.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:39:51.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:51.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:51.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:51.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:39:52.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:39:52.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:52.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:52.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:39:52.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:39:52.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:52.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:52.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:39:52.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:39:52.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:52.546 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:52.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:39:52.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:39:52.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:52.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:52.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:39:52.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:39:52.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:52.912 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:52.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:39:52.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:52.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:39:53.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:53.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:53.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:39:53.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:39:53.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:53.290 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:53.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:39:53.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:39:53.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:53.473 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:53.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:39:53.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:39:53.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:53.699 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:53.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:39:53.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:39:53.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:53.874 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:53.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:39:53.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:53.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:39:54.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:54.058 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:54.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:39:54.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:39:54.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:54.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:54.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:39:54.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:39:54.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:54.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:54.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:39:54.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:39:54.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:54.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:54.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:39:54.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:39:54.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:54.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:54.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:39:54.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:54.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:39:55.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:55.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:55.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:39:55.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:39:55.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:55.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:55.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:39:55.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:39:55.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:55.397 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:55.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:39:55.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:39:55.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:55.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:55.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:39:55.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:39:55.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:55.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:55.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:39:55.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:55.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:39:56.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:56.008 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:56.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:39:56.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:39:56.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:56.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:56.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:39:56.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:39:56.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:56.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:56.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:39:56.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:39:56.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:56.551 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:56.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:39:56.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:39:56.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:56.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:56.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:39:56.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:39:56.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:56.936 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:56.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:56.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:39:57.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:39:57.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:57.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:57.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:39:57.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:39:57.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:57.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:57.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:39:57.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:39:57.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:57.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:57.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:39:57.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:39:57.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:57.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:57.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:39:57.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:39:57.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:57.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:57.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:39:57.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:57.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:39:58.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:58.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:58.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:39:58.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:39:58.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:58.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:58.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:39:58.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:39:58.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:58.516 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:58.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:39:58.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:39:58.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:58.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:58.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:39:58.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:39:58.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:58.909 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:58.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:58.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:39:59.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:39:59.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:59.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:59.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:39:59.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:39:59.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:59.285 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:59.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:39:59.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:39:59.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:59.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:59.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:39:59.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:39:59.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:59.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:59.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:39:59.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:39:59.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:39:59.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:39:59.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:39:59.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:39:59.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:40:00.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:00.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:00.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:40:00.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:40:00.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:00.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:00.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:40:00.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:40:00.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:00.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:00.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:40:00.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:40:00.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:00.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:00.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:40:00.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:40:00.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:00.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:00.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:40:00.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:40:00.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:00.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:00.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:00.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:40:01.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:40:01.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:01.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:01.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:40:01.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:40:01.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:01.376 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:01.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:40:01.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:40:01.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:01.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:01.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:40:01.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:40:01.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:01.754 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:01.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:40:01.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:40:01.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:01.938 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:01.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:01.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:40:02.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:40:02.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:02.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:02.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:40:02.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:40:02.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:02.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:02.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:40:02.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:40:02.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:02.489 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:02.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:40:02.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:40:02.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:02.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:02.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:40:02.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:40:02.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:02.865 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:02.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:40:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:40:03.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:03.075 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:03.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:03.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:40:03.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:03.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:40:03.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:03.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:03.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:03.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:40:03.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:03.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:40:03.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:03.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:03.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:03.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:40:03.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:03.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:40:03.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:03.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:03.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:03.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:40:04.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:40:04.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:04.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:04.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:40:04.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:40:04.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:04.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:04.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:40:04.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:40:04.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:04.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:04.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:40:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:40:04.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:04.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:04.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:40:04.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:40:04.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:04.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:04.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:40:04.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:04.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:40:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:05.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:05.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:40:05.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:40:05.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:05.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:05.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:40:05.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:40:05.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:05.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:05.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:40:05.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:40:05.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:05.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:05.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:40:05.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:40:05.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:05.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:05.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:40:05.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:05.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:40:06.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:06.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:06.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:40:06.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:40:06.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:06.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:06.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:40:06.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:40:06.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:06.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:06.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:40:06.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:40:06.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:06.546 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:06.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:40:06.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:40:06.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:06.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:06.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:40:06.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:40:06.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:06.913 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:06.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:06.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:40:07.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:40:07.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:07.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:07.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:40:07.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:40:07.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:07.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:07.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:40:07.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:40:07.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:07.507 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:07.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:40:07.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:40:07.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:07.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:07.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:40:07.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:40:07.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:07.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:07.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:07.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:40:08.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:40:08.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:08.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:08.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:40:08.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:40:08.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:08.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:08.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:40:08.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:40:08.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:08.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:08.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:40:08.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:40:08.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:08.653 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:08.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:40:08.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:40:08.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:08.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:08.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:08.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:40:09.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:40:09.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:09.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:09.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:40:09.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:40:09.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:09.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:09.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:40:09.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:40:09.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:09.473 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:09.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:40:09.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:40:09.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:09.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:09.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:40:09.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:40:09.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:09.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:09.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:40:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj94 td/osd-backfill-space/datafile 2024-05-08T18:40:10.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:10.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:10.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:40:10.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj95 td/osd-backfill-space/datafile 2024-05-08T18:40:10.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:10.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:10.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:40:10.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj96 td/osd-backfill-space/datafile 2024-05-08T18:40:10.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:10.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:10.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:40:10.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj97 td/osd-backfill-space/datafile 2024-05-08T18:40:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:10.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:40:10.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj98 td/osd-backfill-space/datafile 2024-05-08T18:40:10.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:10.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:10.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:40:10.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj99 td/osd-backfill-space/datafile 2024-05-08T18:40:10.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:10.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:10.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:10.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:40:11.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj100 td/osd-backfill-space/datafile 2024-05-08T18:40:11.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:11.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:11.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:40:11.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj101 td/osd-backfill-space/datafile 2024-05-08T18:40:11.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:11.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:11.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:40:11.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj102 td/osd-backfill-space/datafile 2024-05-08T18:40:11.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:11.580 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:11.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:40:11.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj103 td/osd-backfill-space/datafile 2024-05-08T18:40:11.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:11.814 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:11.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:40:11.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj104 td/osd-backfill-space/datafile 2024-05-08T18:40:11.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:11.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:11.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:11.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:40:12.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj105 td/osd-backfill-space/datafile 2024-05-08T18:40:12.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:12.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:12.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:40:12.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj106 td/osd-backfill-space/datafile 2024-05-08T18:40:12.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:12.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:12.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:40:12.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj107 td/osd-backfill-space/datafile 2024-05-08T18:40:12.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:12.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:12.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:40:12.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj108 td/osd-backfill-space/datafile 2024-05-08T18:40:12.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:12.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:12.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:40:12.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj109 td/osd-backfill-space/datafile 2024-05-08T18:40:12.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:12.894 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:12.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:40:12.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:12.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj110 td/osd-backfill-space/datafile 2024-05-08T18:40:13.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:13.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:13.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:40:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj111 td/osd-backfill-space/datafile 2024-05-08T18:40:13.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:13.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:13.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:40:13.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj112 td/osd-backfill-space/datafile 2024-05-08T18:40:13.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:13.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:13.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:40:13.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj113 td/osd-backfill-space/datafile 2024-05-08T18:40:13.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:13.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:13.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:40:13.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj114 td/osd-backfill-space/datafile 2024-05-08T18:40:13.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:13.882 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:13.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:40:13.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:13.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj115 td/osd-backfill-space/datafile 2024-05-08T18:40:14.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:14.064 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:14.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:40:14.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj116 td/osd-backfill-space/datafile 2024-05-08T18:40:14.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:14.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:14.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:40:14.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj117 td/osd-backfill-space/datafile 2024-05-08T18:40:14.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:14.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:14.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:40:14.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj118 td/osd-backfill-space/datafile 2024-05-08T18:40:14.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:14.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:14.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:40:14.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj119 td/osd-backfill-space/datafile 2024-05-08T18:40:14.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:14.850 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:14.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:40:14.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:14.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj120 td/osd-backfill-space/datafile 2024-05-08T18:40:15.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:15.035 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:15.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:40:15.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj121 td/osd-backfill-space/datafile 2024-05-08T18:40:15.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:15.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:15.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:40:15.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj122 td/osd-backfill-space/datafile 2024-05-08T18:40:15.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:15.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:15.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:40:15.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj123 td/osd-backfill-space/datafile 2024-05-08T18:40:15.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:15.637 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:15.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:40:15.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj124 td/osd-backfill-space/datafile 2024-05-08T18:40:15.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:15.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:15.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:40:15.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:15.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj125 td/osd-backfill-space/datafile 2024-05-08T18:40:16.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:16.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:16.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:40:16.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj126 td/osd-backfill-space/datafile 2024-05-08T18:40:16.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:16.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:16.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:40:16.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj127 td/osd-backfill-space/datafile 2024-05-08T18:40:16.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:16.389 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:16.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:40:16.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj128 td/osd-backfill-space/datafile 2024-05-08T18:40:16.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:16.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:16.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:40:16.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj129 td/osd-backfill-space/datafile 2024-05-08T18:40:16.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:16.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:16.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:40:16.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj130 td/osd-backfill-space/datafile 2024-05-08T18:40:16.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:16.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:16.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:16.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:40:17.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj131 td/osd-backfill-space/datafile 2024-05-08T18:40:17.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:17.134 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:17.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:40:17.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj132 td/osd-backfill-space/datafile 2024-05-08T18:40:17.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:17.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:17.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:40:17.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj133 td/osd-backfill-space/datafile 2024-05-08T18:40:17.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:17.502 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:17.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:40:17.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj134 td/osd-backfill-space/datafile 2024-05-08T18:40:17.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:17.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:17.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:40:17.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj135 td/osd-backfill-space/datafile 2024-05-08T18:40:17.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:17.920 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:17.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:17.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:40:18.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj136 td/osd-backfill-space/datafile 2024-05-08T18:40:18.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:18.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:18.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:40:18.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj137 td/osd-backfill-space/datafile 2024-05-08T18:40:18.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:18.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:18.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:40:18.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj138 td/osd-backfill-space/datafile 2024-05-08T18:40:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:18.472 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:18.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:40:18.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj139 td/osd-backfill-space/datafile 2024-05-08T18:40:18.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:18.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:18.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:40:18.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj140 td/osd-backfill-space/datafile 2024-05-08T18:40:18.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:18.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:18.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:40:18.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:18.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj141 td/osd-backfill-space/datafile 2024-05-08T18:40:19.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:19.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:19.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:40:19.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj142 td/osd-backfill-space/datafile 2024-05-08T18:40:19.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:19.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:19.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:40:19.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj143 td/osd-backfill-space/datafile 2024-05-08T18:40:19.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:19.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:19.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:40:19.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj144 td/osd-backfill-space/datafile 2024-05-08T18:40:19.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:19.686 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:19.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:40:19.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj145 td/osd-backfill-space/datafile 2024-05-08T18:40:19.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:19.870 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:19.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:40:19.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:19.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj146 td/osd-backfill-space/datafile 2024-05-08T18:40:20.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:20.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:20.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:40:20.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj147 td/osd-backfill-space/datafile 2024-05-08T18:40:20.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:20.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:20.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:40:20.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj148 td/osd-backfill-space/datafile 2024-05-08T18:40:20.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:20.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:20.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:40:20.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj149 td/osd-backfill-space/datafile 2024-05-08T18:40:20.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:20.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:20.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:40:20.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj150 td/osd-backfill-space/datafile 2024-05-08T18:40:20.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:20.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:20.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:40:20.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:20.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj151 td/osd-backfill-space/datafile 2024-05-08T18:40:21.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:21.023 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:21.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:40:21.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj152 td/osd-backfill-space/datafile 2024-05-08T18:40:21.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:21.215 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:21.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:40:21.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj153 td/osd-backfill-space/datafile 2024-05-08T18:40:21.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:21.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:40:21.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj154 td/osd-backfill-space/datafile 2024-05-08T18:40:21.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:21.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:21.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:40:21.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj155 td/osd-backfill-space/datafile 2024-05-08T18:40:21.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:21.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:21.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:40:21.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:21.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj156 td/osd-backfill-space/datafile 2024-05-08T18:40:22.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:22.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:22.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:40:22.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj157 td/osd-backfill-space/datafile 2024-05-08T18:40:22.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:22.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:22.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:40:22.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj158 td/osd-backfill-space/datafile 2024-05-08T18:40:22.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:22.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:22.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:40:22.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj159 td/osd-backfill-space/datafile 2024-05-08T18:40:22.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:22.587 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:22.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:40:22.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj160 td/osd-backfill-space/datafile 2024-05-08T18:40:22.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:22.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:22.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:40:22.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj161 td/osd-backfill-space/datafile 2024-05-08T18:40:22.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:22.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:22.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:22.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:40:23.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj162 td/osd-backfill-space/datafile 2024-05-08T18:40:23.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:23.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:23.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:40:23.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj163 td/osd-backfill-space/datafile 2024-05-08T18:40:23.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:23.373 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:23.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:40:23.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj164 td/osd-backfill-space/datafile 2024-05-08T18:40:23.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:23.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:23.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:40:23.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj165 td/osd-backfill-space/datafile 2024-05-08T18:40:23.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:23.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:23.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:40:23.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj166 td/osd-backfill-space/datafile 2024-05-08T18:40:23.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:23.979 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:23.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:23.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:40:24.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj167 td/osd-backfill-space/datafile 2024-05-08T18:40:24.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:24.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:24.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:40:24.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj168 td/osd-backfill-space/datafile 2024-05-08T18:40:24.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:24.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:24.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:40:24.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj169 td/osd-backfill-space/datafile 2024-05-08T18:40:24.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:24.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:24.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:40:24.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj170 td/osd-backfill-space/datafile 2024-05-08T18:40:24.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:24.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:24.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:40:24.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj171 td/osd-backfill-space/datafile 2024-05-08T18:40:24.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:24.938 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:24.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:24.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:40:25.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj172 td/osd-backfill-space/datafile 2024-05-08T18:40:25.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:25.126 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:25.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:40:25.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj173 td/osd-backfill-space/datafile 2024-05-08T18:40:25.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:25.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:25.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:40:25.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj174 td/osd-backfill-space/datafile 2024-05-08T18:40:25.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:25.489 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:25.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:40:25.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj175 td/osd-backfill-space/datafile 2024-05-08T18:40:25.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:25.733 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:25.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:40:25.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj176 td/osd-backfill-space/datafile 2024-05-08T18:40:25.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:25.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:25.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:25.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:40:26.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj177 td/osd-backfill-space/datafile 2024-05-08T18:40:26.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:26.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:26.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:40:26.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj178 td/osd-backfill-space/datafile 2024-05-08T18:40:26.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:26.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:26.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:40:26.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj179 td/osd-backfill-space/datafile 2024-05-08T18:40:26.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:26.484 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:26.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:40:26.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj180 td/osd-backfill-space/datafile 2024-05-08T18:40:26.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:26.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:26.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:40:26.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj181 td/osd-backfill-space/datafile 2024-05-08T18:40:26.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:26.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:26.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:40:26.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:26.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj182 td/osd-backfill-space/datafile 2024-05-08T18:40:27.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:27.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:27.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:40:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj183 td/osd-backfill-space/datafile 2024-05-08T18:40:27.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:27.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:27.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:40:27.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj184 td/osd-backfill-space/datafile 2024-05-08T18:40:27.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:27.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:27.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:40:27.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj185 td/osd-backfill-space/datafile 2024-05-08T18:40:27.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:27.672 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:27.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:40:27.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj186 td/osd-backfill-space/datafile 2024-05-08T18:40:27.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:27.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:27.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:40:27.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:27.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj187 td/osd-backfill-space/datafile 2024-05-08T18:40:28.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:28.040 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:28.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:40:28.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj188 td/osd-backfill-space/datafile 2024-05-08T18:40:28.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:28.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:28.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:40:28.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj189 td/osd-backfill-space/datafile 2024-05-08T18:40:28.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:28.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:28.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:40:28.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj190 td/osd-backfill-space/datafile 2024-05-08T18:40:28.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:28.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:28.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:40:28.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj191 td/osd-backfill-space/datafile 2024-05-08T18:40:28.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:28.784 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:28.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:40:28.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj192 td/osd-backfill-space/datafile 2024-05-08T18:40:28.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:28.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:28.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:28.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:40:29.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj193 td/osd-backfill-space/datafile 2024-05-08T18:40:29.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:29.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:29.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:40:29.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj194 td/osd-backfill-space/datafile 2024-05-08T18:40:29.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:29.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:29.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:40:29.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj195 td/osd-backfill-space/datafile 2024-05-08T18:40:29.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:29.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:29.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:40:29.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj196 td/osd-backfill-space/datafile 2024-05-08T18:40:29.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:29.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:29.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:40:29.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:29.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj197 td/osd-backfill-space/datafile 2024-05-08T18:40:30.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:30.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:30.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:40:30.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj198 td/osd-backfill-space/datafile 2024-05-08T18:40:30.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:30.215 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:30.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:40:30.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj199 td/osd-backfill-space/datafile 2024-05-08T18:40:30.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:30.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:30.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:40:30.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj200 td/osd-backfill-space/datafile 2024-05-08T18:40:30.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:30.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:30.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:40:30.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj201 td/osd-backfill-space/datafile 2024-05-08T18:40:30.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:30.775 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:30.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:40:30.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj202 td/osd-backfill-space/datafile 2024-05-08T18:40:30.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:30.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:30.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:30.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:40:31.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj203 td/osd-backfill-space/datafile 2024-05-08T18:40:31.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:31.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:31.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:40:31.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj204 td/osd-backfill-space/datafile 2024-05-08T18:40:31.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:31.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:31.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:40:31.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj205 td/osd-backfill-space/datafile 2024-05-08T18:40:31.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:31.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:31.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:40:31.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj206 td/osd-backfill-space/datafile 2024-05-08T18:40:31.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:31.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:31.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:40:31.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:31.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj207 td/osd-backfill-space/datafile 2024-05-08T18:40:32.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:32.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:32.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:40:32.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj208 td/osd-backfill-space/datafile 2024-05-08T18:40:32.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:32.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:32.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:40:32.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj209 td/osd-backfill-space/datafile 2024-05-08T18:40:32.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:32.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:32.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:40:32.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj210 td/osd-backfill-space/datafile 2024-05-08T18:40:32.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:32.539 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:32.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:40:32.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj211 td/osd-backfill-space/datafile 2024-05-08T18:40:32.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:32.724 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:32.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:40:32.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj212 td/osd-backfill-space/datafile 2024-05-08T18:40:32.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:32.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:32.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:32.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:40:33.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj213 td/osd-backfill-space/datafile 2024-05-08T18:40:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:33.109 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:33.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:40:33.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj214 td/osd-backfill-space/datafile 2024-05-08T18:40:33.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:33.300 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:33.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:40:33.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj215 td/osd-backfill-space/datafile 2024-05-08T18:40:33.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:33.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:33.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:40:33.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj216 td/osd-backfill-space/datafile 2024-05-08T18:40:33.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:33.777 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:33.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:40:33.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj217 td/osd-backfill-space/datafile 2024-05-08T18:40:33.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:33.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:33.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:33.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:40:34.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:34.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj218 td/osd-backfill-space/datafile 2024-05-08T18:40:34.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:34.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:34.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:34.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:40:34.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:34.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj219 td/osd-backfill-space/datafile 2024-05-08T18:40:34.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:34.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:34.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:34.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:40:34.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:34.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj220 td/osd-backfill-space/datafile 2024-05-08T18:40:34.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:34.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:34.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:34.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:40:34.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:34.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj221 td/osd-backfill-space/datafile 2024-05-08T18:40:35.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:35.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:35.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:40:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj222 td/osd-backfill-space/datafile 2024-05-08T18:40:35.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:35.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:35.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:40:35.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj223 td/osd-backfill-space/datafile 2024-05-08T18:40:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:35.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:35.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:40:35.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj224 td/osd-backfill-space/datafile 2024-05-08T18:40:35.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:35.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:35.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:40:35.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj225 td/osd-backfill-space/datafile 2024-05-08T18:40:35.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:35.909 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:40:36.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj226 td/osd-backfill-space/datafile 2024-05-08T18:40:36.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:36.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:36.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:40:36.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj227 td/osd-backfill-space/datafile 2024-05-08T18:40:36.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:36.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:36.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:40:36.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj228 td/osd-backfill-space/datafile 2024-05-08T18:40:36.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:36.477 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:36.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:40:36.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj229 td/osd-backfill-space/datafile 2024-05-08T18:40:36.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:36.678 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:36.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:40:36.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj230 td/osd-backfill-space/datafile 2024-05-08T18:40:36.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:36.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:36.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:40:36.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:36.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj231 td/osd-backfill-space/datafile 2024-05-08T18:40:37.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:37.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:37.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:40:37.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj232 td/osd-backfill-space/datafile 2024-05-08T18:40:37.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:37.222 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:37.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:40:37.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj233 td/osd-backfill-space/datafile 2024-05-08T18:40:37.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:37.406 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:37.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:40:37.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj234 td/osd-backfill-space/datafile 2024-05-08T18:40:37.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:37.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:37.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:40:37.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj235 td/osd-backfill-space/datafile 2024-05-08T18:40:37.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:37.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:37.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:40:37.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:37.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj236 td/osd-backfill-space/datafile 2024-05-08T18:40:38.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:38.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:38.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:40:38.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj237 td/osd-backfill-space/datafile 2024-05-08T18:40:38.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:38.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:38.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:40:38.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj238 td/osd-backfill-space/datafile 2024-05-08T18:40:38.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:38.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:38.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:40:38.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj239 td/osd-backfill-space/datafile 2024-05-08T18:40:38.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:38.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:38.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:40:38.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj240 td/osd-backfill-space/datafile 2024-05-08T18:40:38.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:38.777 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:38.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:40:38.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj241 td/osd-backfill-space/datafile 2024-05-08T18:40:38.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:38.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:38.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:38.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:40:39.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj242 td/osd-backfill-space/datafile 2024-05-08T18:40:39.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:39.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:39.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:40:39.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj243 td/osd-backfill-space/datafile 2024-05-08T18:40:39.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:39.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:39.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:40:39.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj244 td/osd-backfill-space/datafile 2024-05-08T18:40:39.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:39.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:39.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:40:39.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj245 td/osd-backfill-space/datafile 2024-05-08T18:40:39.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:39.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:39.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:40:39.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj246 td/osd-backfill-space/datafile 2024-05-08T18:40:39.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:39.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:39.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:39.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:40:40.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj247 td/osd-backfill-space/datafile 2024-05-08T18:40:40.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:40.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:40.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:40:40.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj248 td/osd-backfill-space/datafile 2024-05-08T18:40:40.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:40.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:40.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:40:40.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj249 td/osd-backfill-space/datafile 2024-05-08T18:40:40.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:40.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:40.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:40:40.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj250 td/osd-backfill-space/datafile 2024-05-08T18:40:40.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:40.768 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:40.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:40:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj251 td/osd-backfill-space/datafile 2024-05-08T18:40:40.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:40.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:40.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:40.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:40:41.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj252 td/osd-backfill-space/datafile 2024-05-08T18:40:41.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:41.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:41.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:40:41.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj253 td/osd-backfill-space/datafile 2024-05-08T18:40:41.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:41.353 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:41.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:40:41.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj254 td/osd-backfill-space/datafile 2024-05-08T18:40:41.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:41.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:41.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:40:41.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj255 td/osd-backfill-space/datafile 2024-05-08T18:40:41.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:41.772 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:41.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:40:41.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj256 td/osd-backfill-space/datafile 2024-05-08T18:40:41.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:41.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:41.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:41.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:40:42.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj257 td/osd-backfill-space/datafile 2024-05-08T18:40:42.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:42.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:42.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:40:42.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj258 td/osd-backfill-space/datafile 2024-05-08T18:40:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:42.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:42.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:40:42.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj259 td/osd-backfill-space/datafile 2024-05-08T18:40:42.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:42.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:42.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:40:42.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj260 td/osd-backfill-space/datafile 2024-05-08T18:40:42.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:42.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:42.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:40:42.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj261 td/osd-backfill-space/datafile 2024-05-08T18:40:42.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:42.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:42.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:40:42.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:42.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj262 td/osd-backfill-space/datafile 2024-05-08T18:40:43.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:43.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:43.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:40:43.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj263 td/osd-backfill-space/datafile 2024-05-08T18:40:43.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:43.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:43.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:40:43.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj264 td/osd-backfill-space/datafile 2024-05-08T18:40:43.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:43.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:43.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:40:43.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj265 td/osd-backfill-space/datafile 2024-05-08T18:40:43.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:43.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:43.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:40:43.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj266 td/osd-backfill-space/datafile 2024-05-08T18:40:43.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:43.879 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:43.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:40:43.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:43.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj267 td/osd-backfill-space/datafile 2024-05-08T18:40:44.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:44.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:44.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:40:44.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj268 td/osd-backfill-space/datafile 2024-05-08T18:40:44.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:44.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:44.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:40:44.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj269 td/osd-backfill-space/datafile 2024-05-08T18:40:44.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:44.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:44.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:40:44.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj270 td/osd-backfill-space/datafile 2024-05-08T18:40:44.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:44.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:44.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:40:44.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj271 td/osd-backfill-space/datafile 2024-05-08T18:40:44.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:44.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:44.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:40:44.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj272 td/osd-backfill-space/datafile 2024-05-08T18:40:44.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:44.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:44.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:44.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:40:45.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj273 td/osd-backfill-space/datafile 2024-05-08T18:40:45.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:45.202 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:45.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:40:45.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj274 td/osd-backfill-space/datafile 2024-05-08T18:40:45.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:45.394 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:45.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:40:45.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj275 td/osd-backfill-space/datafile 2024-05-08T18:40:45.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:45.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:45.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:40:45.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj276 td/osd-backfill-space/datafile 2024-05-08T18:40:45.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:45.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:45.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:40:45.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj277 td/osd-backfill-space/datafile 2024-05-08T18:40:45.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:45.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:45.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:45.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:40:46.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj278 td/osd-backfill-space/datafile 2024-05-08T18:40:46.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:46.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:46.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:40:46.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj279 td/osd-backfill-space/datafile 2024-05-08T18:40:46.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:46.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:46.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:40:46.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj280 td/osd-backfill-space/datafile 2024-05-08T18:40:46.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:46.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:46.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:40:46.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj281 td/osd-backfill-space/datafile 2024-05-08T18:40:46.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:46.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:46.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:40:46.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj282 td/osd-backfill-space/datafile 2024-05-08T18:40:46.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:46.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:46.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:46.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:40:47.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj283 td/osd-backfill-space/datafile 2024-05-08T18:40:47.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:47.122 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:47.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:40:47.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj284 td/osd-backfill-space/datafile 2024-05-08T18:40:47.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:47.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:47.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:40:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj285 td/osd-backfill-space/datafile 2024-05-08T18:40:47.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:47.495 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:47.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:40:47.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj286 td/osd-backfill-space/datafile 2024-05-08T18:40:47.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:47.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:47.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:40:47.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj287 td/osd-backfill-space/datafile 2024-05-08T18:40:47.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:47.913 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:47.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:47.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:40:48.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj288 td/osd-backfill-space/datafile 2024-05-08T18:40:48.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:48.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:48.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:40:48.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj289 td/osd-backfill-space/datafile 2024-05-08T18:40:48.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:48.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:48.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:40:48.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj290 td/osd-backfill-space/datafile 2024-05-08T18:40:48.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:48.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:48.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:40:48.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj291 td/osd-backfill-space/datafile 2024-05-08T18:40:48.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:48.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:48.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:40:48.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj292 td/osd-backfill-space/datafile 2024-05-08T18:40:48.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:48.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:48.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:40:48.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:48.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj293 td/osd-backfill-space/datafile 2024-05-08T18:40:49.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:49.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:49.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:40:49.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj294 td/osd-backfill-space/datafile 2024-05-08T18:40:49.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:49.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:49.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:40:49.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj295 td/osd-backfill-space/datafile 2024-05-08T18:40:49.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:49.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:49.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:40:49.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj296 td/osd-backfill-space/datafile 2024-05-08T18:40:49.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:49.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:49.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:40:49.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj297 td/osd-backfill-space/datafile 2024-05-08T18:40:49.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:49.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:49.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:40:49.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:49.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj298 td/osd-backfill-space/datafile 2024-05-08T18:40:50.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:50.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:50.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:40:50.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj299 td/osd-backfill-space/datafile 2024-05-08T18:40:50.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:50.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:50.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:40:50.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj300 td/osd-backfill-space/datafile 2024-05-08T18:40:50.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:50.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:50.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:40:50.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj301 td/osd-backfill-space/datafile 2024-05-08T18:40:50.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:50.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:50.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:40:50.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj302 td/osd-backfill-space/datafile 2024-05-08T18:40:50.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:50.773 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:50.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:40:50.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj303 td/osd-backfill-space/datafile 2024-05-08T18:40:50.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:50.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:50.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:50.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:40:51.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj304 td/osd-backfill-space/datafile 2024-05-08T18:40:51.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:51.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:51.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:40:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj305 td/osd-backfill-space/datafile 2024-05-08T18:40:51.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:51.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:51.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:40:51.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj306 td/osd-backfill-space/datafile 2024-05-08T18:40:51.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:51.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:51.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:40:51.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj307 td/osd-backfill-space/datafile 2024-05-08T18:40:51.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:51.786 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:51.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:40:51.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj308 td/osd-backfill-space/datafile 2024-05-08T18:40:51.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:51.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:51.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:51.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:40:52.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj309 td/osd-backfill-space/datafile 2024-05-08T18:40:52.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:52.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:52.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:40:52.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj310 td/osd-backfill-space/datafile 2024-05-08T18:40:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:52.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:52.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:40:52.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj311 td/osd-backfill-space/datafile 2024-05-08T18:40:52.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:52.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:52.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:40:52.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj312 td/osd-backfill-space/datafile 2024-05-08T18:40:52.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:52.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:52.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:40:52.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj313 td/osd-backfill-space/datafile 2024-05-08T18:40:52.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:52.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:52.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:40:52.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:52.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj314 td/osd-backfill-space/datafile 2024-05-08T18:40:53.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:53.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:53.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:40:53.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj315 td/osd-backfill-space/datafile 2024-05-08T18:40:53.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:53.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:53.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:40:53.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj316 td/osd-backfill-space/datafile 2024-05-08T18:40:53.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:53.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:53.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:40:53.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj317 td/osd-backfill-space/datafile 2024-05-08T18:40:53.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:53.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:53.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:40:53.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj318 td/osd-backfill-space/datafile 2024-05-08T18:40:53.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:53.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:53.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:40:53.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:53.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj319 td/osd-backfill-space/datafile 2024-05-08T18:40:54.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:54.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:54.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:40:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj320 td/osd-backfill-space/datafile 2024-05-08T18:40:54.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:54.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:54.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:40:54.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj321 td/osd-backfill-space/datafile 2024-05-08T18:40:54.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:54.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:54.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:40:54.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj322 td/osd-backfill-space/datafile 2024-05-08T18:40:54.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:54.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:54.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:40:54.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj323 td/osd-backfill-space/datafile 2024-05-08T18:40:54.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:54.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:54.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:40:54.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj324 td/osd-backfill-space/datafile 2024-05-08T18:40:54.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:54.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:54.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:54.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:40:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj325 td/osd-backfill-space/datafile 2024-05-08T18:40:55.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:55.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:55.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:55.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:40:55.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:55.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj326 td/osd-backfill-space/datafile 2024-05-08T18:40:55.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:55.391 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:55.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:55.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:40:55.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:55.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj327 td/osd-backfill-space/datafile 2024-05-08T18:40:55.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:55.574 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:55.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:55.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:40:55.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:55.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj328 td/osd-backfill-space/datafile 2024-05-08T18:40:55.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:55.784 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:55.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:55.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:40:55.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj329 td/osd-backfill-space/datafile 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj330 td/osd-backfill-space/datafile 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:40:56.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj331 td/osd-backfill-space/datafile 2024-05-08T18:40:56.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:56.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:56.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:40:56.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj332 td/osd-backfill-space/datafile 2024-05-08T18:40:56.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:56.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:56.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:40:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj333 td/osd-backfill-space/datafile 2024-05-08T18:40:56.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:56.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:56.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:40:56.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj334 td/osd-backfill-space/datafile 2024-05-08T18:40:56.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:56.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:56.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:40:56.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:56.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj335 td/osd-backfill-space/datafile 2024-05-08T18:40:57.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:57.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:57.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:40:57.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj336 td/osd-backfill-space/datafile 2024-05-08T18:40:57.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:57.290 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:57.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:40:57.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj337 td/osd-backfill-space/datafile 2024-05-08T18:40:57.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:57.473 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:57.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:40:57.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj338 td/osd-backfill-space/datafile 2024-05-08T18:40:57.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:57.701 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:57.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:40:57.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj339 td/osd-backfill-space/datafile 2024-05-08T18:40:57.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:57.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:57.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:40:57.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:57.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj340 td/osd-backfill-space/datafile 2024-05-08T18:40:58.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:58.076 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:58.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:40:58.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj341 td/osd-backfill-space/datafile 2024-05-08T18:40:58.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:58.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:58.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:40:58.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj342 td/osd-backfill-space/datafile 2024-05-08T18:40:58.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:58.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:58.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:40:58.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj343 td/osd-backfill-space/datafile 2024-05-08T18:40:58.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:58.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:58.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:40:58.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj344 td/osd-backfill-space/datafile 2024-05-08T18:40:58.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:58.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:58.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:40:58.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:58.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj345 td/osd-backfill-space/datafile 2024-05-08T18:40:59.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:59.013 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:59.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:40:59.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj346 td/osd-backfill-space/datafile 2024-05-08T18:40:59.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:59.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:59.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:40:59.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj347 td/osd-backfill-space/datafile 2024-05-08T18:40:59.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:59.397 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:40:59.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj348 td/osd-backfill-space/datafile 2024-05-08T18:40:59.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:59.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:59.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:40:59.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj349 td/osd-backfill-space/datafile 2024-05-08T18:40:59.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:40:59.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:40:59.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:40:59.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:40:59.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj350 td/osd-backfill-space/datafile 2024-05-08T18:41:00.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:00.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:00.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:41:00.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj351 td/osd-backfill-space/datafile 2024-05-08T18:41:00.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:00.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:00.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:41:00.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj352 td/osd-backfill-space/datafile 2024-05-08T18:41:00.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:00.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:00.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:41:00.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj353 td/osd-backfill-space/datafile 2024-05-08T18:41:00.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:00.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:00.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:41:00.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj354 td/osd-backfill-space/datafile 2024-05-08T18:41:00.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:00.785 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:00.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:41:00.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj355 td/osd-backfill-space/datafile 2024-05-08T18:41:00.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:00.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:00.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:00.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:41:01.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj356 td/osd-backfill-space/datafile 2024-05-08T18:41:01.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:01.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:01.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:41:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj357 td/osd-backfill-space/datafile 2024-05-08T18:41:01.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:01.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:01.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:41:01.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj358 td/osd-backfill-space/datafile 2024-05-08T18:41:01.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:01.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:01.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:41:01.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj359 td/osd-backfill-space/datafile 2024-05-08T18:41:01.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:01.773 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:01.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:41:01.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj360 td/osd-backfill-space/datafile 2024-05-08T18:41:01.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:01.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:01.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:01.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:41:02.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj361 td/osd-backfill-space/datafile 2024-05-08T18:41:02.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:02.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:02.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:41:02.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj362 td/osd-backfill-space/datafile 2024-05-08T18:41:02.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:02.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:41:02.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj363 td/osd-backfill-space/datafile 2024-05-08T18:41:02.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:02.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:02.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:41:02.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj364 td/osd-backfill-space/datafile 2024-05-08T18:41:02.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:02.678 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:02.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:41:02.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj365 td/osd-backfill-space/datafile 2024-05-08T18:41:02.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:02.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:02.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:41:02.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:02.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj366 td/osd-backfill-space/datafile 2024-05-08T18:41:03.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:03.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:03.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:41:03.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj367 td/osd-backfill-space/datafile 2024-05-08T18:41:03.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:03.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:03.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:41:03.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj368 td/osd-backfill-space/datafile 2024-05-08T18:41:03.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:03.412 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:03.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:41:03.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj369 td/osd-backfill-space/datafile 2024-05-08T18:41:03.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:03.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:03.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:41:03.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj370 td/osd-backfill-space/datafile 2024-05-08T18:41:03.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:03.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:03.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:41:03.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:03.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj371 td/osd-backfill-space/datafile 2024-05-08T18:41:04.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:04.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:04.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:41:04.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj372 td/osd-backfill-space/datafile 2024-05-08T18:41:04.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:04.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:04.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:41:04.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj373 td/osd-backfill-space/datafile 2024-05-08T18:41:04.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:04.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:04.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:41:04.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj374 td/osd-backfill-space/datafile 2024-05-08T18:41:04.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:04.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:04.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:41:04.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj375 td/osd-backfill-space/datafile 2024-05-08T18:41:04.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:04.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:04.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:41:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj376 td/osd-backfill-space/datafile 2024-05-08T18:41:04.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:04.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:04.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:04.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:41:05.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:05.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj377 td/osd-backfill-space/datafile 2024-05-08T18:41:05.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:05.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:05.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:05.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:41:05.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:05.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj378 td/osd-backfill-space/datafile 2024-05-08T18:41:05.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:05.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:05.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:05.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:41:05.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:05.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj379 td/osd-backfill-space/datafile 2024-05-08T18:41:05.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:05.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:05.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:05.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:41:05.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:05.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj380 td/osd-backfill-space/datafile 2024-05-08T18:41:06.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:06.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:06.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:41:06.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj381 td/osd-backfill-space/datafile 2024-05-08T18:41:06.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:06.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:06.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:41:06.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj382 td/osd-backfill-space/datafile 2024-05-08T18:41:06.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:06.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:06.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:41:06.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj383 td/osd-backfill-space/datafile 2024-05-08T18:41:06.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:06.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:06.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:41:06.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj384 td/osd-backfill-space/datafile 2024-05-08T18:41:06.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:06.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:06.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:06.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:41:07.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj385 td/osd-backfill-space/datafile 2024-05-08T18:41:07.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:07.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:07.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:41:07.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj386 td/osd-backfill-space/datafile 2024-05-08T18:41:07.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:07.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:07.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:41:07.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj387 td/osd-backfill-space/datafile 2024-05-08T18:41:07.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:07.477 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:07.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:41:07.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj388 td/osd-backfill-space/datafile 2024-05-08T18:41:07.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:07.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:07.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:41:07.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj389 td/osd-backfill-space/datafile 2024-05-08T18:41:07.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:07.879 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:07.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:41:07.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:07.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj390 td/osd-backfill-space/datafile 2024-05-08T18:41:08.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:08.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:08.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:41:08.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj391 td/osd-backfill-space/datafile 2024-05-08T18:41:08.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:08.263 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:08.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:41:08.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj392 td/osd-backfill-space/datafile 2024-05-08T18:41:08.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:08.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:08.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:41:08.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj393 td/osd-backfill-space/datafile 2024-05-08T18:41:08.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:08.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:08.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:41:08.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj394 td/osd-backfill-space/datafile 2024-05-08T18:41:08.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:08.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:08.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:41:08.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:08.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj395 td/osd-backfill-space/datafile 2024-05-08T18:41:08.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:08.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:09.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:41:09.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj396 td/osd-backfill-space/datafile 2024-05-08T18:41:09.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:09.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:09.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:41:09.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj397 td/osd-backfill-space/datafile 2024-05-08T18:41:09.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:09.394 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:09.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:41:09.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj398 td/osd-backfill-space/datafile 2024-05-08T18:41:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:09.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:09.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:41:09.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj399 td/osd-backfill-space/datafile 2024-05-08T18:41:09.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:09.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:09.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:41:09.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj400 td/osd-backfill-space/datafile 2024-05-08T18:41:09.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:09.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:09.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:09.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:41:10.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj401 td/osd-backfill-space/datafile 2024-05-08T18:41:10.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:10.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:10.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:41:10.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj402 td/osd-backfill-space/datafile 2024-05-08T18:41:10.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:10.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:10.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:41:10.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj403 td/osd-backfill-space/datafile 2024-05-08T18:41:10.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:10.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:10.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:41:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj404 td/osd-backfill-space/datafile 2024-05-08T18:41:10.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:10.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:10.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:41:10.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj405 td/osd-backfill-space/datafile 2024-05-08T18:41:10.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:10.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:10.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:10.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:41:11.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj406 td/osd-backfill-space/datafile 2024-05-08T18:41:11.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:11.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:11.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:41:11.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj407 td/osd-backfill-space/datafile 2024-05-08T18:41:11.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:11.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:11.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:41:11.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj408 td/osd-backfill-space/datafile 2024-05-08T18:41:11.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:11.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:11.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:41:11.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj409 td/osd-backfill-space/datafile 2024-05-08T18:41:11.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:11.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:11.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:41:11.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:11.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj410 td/osd-backfill-space/datafile 2024-05-08T18:41:12.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:12.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:41:12.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj411 td/osd-backfill-space/datafile 2024-05-08T18:41:12.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:12.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:12.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:41:12.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj412 td/osd-backfill-space/datafile 2024-05-08T18:41:12.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:12.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:12.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:41:12.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj413 td/osd-backfill-space/datafile 2024-05-08T18:41:12.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:12.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:12.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:41:12.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj414 td/osd-backfill-space/datafile 2024-05-08T18:41:12.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:12.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:12.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:41:12.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj415 td/osd-backfill-space/datafile 2024-05-08T18:41:12.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:12.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:12.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:12.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:41:13.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj416 td/osd-backfill-space/datafile 2024-05-08T18:41:13.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:13.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:13.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:41:13.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj417 td/osd-backfill-space/datafile 2024-05-08T18:41:13.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:13.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:13.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:41:13.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj418 td/osd-backfill-space/datafile 2024-05-08T18:41:13.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:13.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:13.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:41:13.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj419 td/osd-backfill-space/datafile 2024-05-08T18:41:13.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:13.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:13.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:41:13.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj420 td/osd-backfill-space/datafile 2024-05-08T18:41:13.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:13.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:13.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:13.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:41:14.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj421 td/osd-backfill-space/datafile 2024-05-08T18:41:14.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:14.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:14.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:41:14.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj422 td/osd-backfill-space/datafile 2024-05-08T18:41:14.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:14.352 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:14.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:41:14.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj423 td/osd-backfill-space/datafile 2024-05-08T18:41:14.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:14.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:14.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:41:14.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj424 td/osd-backfill-space/datafile 2024-05-08T18:41:14.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:14.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:14.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:41:14.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj425 td/osd-backfill-space/datafile 2024-05-08T18:41:14.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:14.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:14.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:41:14.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:14.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj426 td/osd-backfill-space/datafile 2024-05-08T18:41:15.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:15.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:15.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:41:15.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj427 td/osd-backfill-space/datafile 2024-05-08T18:41:15.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:15.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:15.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:41:15.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj428 td/osd-backfill-space/datafile 2024-05-08T18:41:15.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:15.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:15.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:41:15.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj429 td/osd-backfill-space/datafile 2024-05-08T18:41:15.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:15.691 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:15.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:41:15.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj430 td/osd-backfill-space/datafile 2024-05-08T18:41:15.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:15.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:15.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:41:15.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:15.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj431 td/osd-backfill-space/datafile 2024-05-08T18:41:16.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:16.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:16.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:41:16.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj432 td/osd-backfill-space/datafile 2024-05-08T18:41:16.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:16.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:16.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:41:16.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj433 td/osd-backfill-space/datafile 2024-05-08T18:41:16.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:16.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:16.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:41:16.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj434 td/osd-backfill-space/datafile 2024-05-08T18:41:16.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:16.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:16.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:41:16.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj435 td/osd-backfill-space/datafile 2024-05-08T18:41:16.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:16.804 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:16.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:41:16.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj436 td/osd-backfill-space/datafile 2024-05-08T18:41:16.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:16.996 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:16.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:16.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:41:17.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj437 td/osd-backfill-space/datafile 2024-05-08T18:41:17.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:17.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:17.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:41:17.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj438 td/osd-backfill-space/datafile 2024-05-08T18:41:17.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:17.397 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:41:17.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj439 td/osd-backfill-space/datafile 2024-05-08T18:41:17.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:17.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:17.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:41:17.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj440 td/osd-backfill-space/datafile 2024-05-08T18:41:17.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:17.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:17.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:41:17.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:17.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj441 td/osd-backfill-space/datafile 2024-05-08T18:41:18.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:18.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:18.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:41:18.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj442 td/osd-backfill-space/datafile 2024-05-08T18:41:18.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:18.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:18.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:41:18.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj443 td/osd-backfill-space/datafile 2024-05-08T18:41:18.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:18.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:18.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:41:18.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj444 td/osd-backfill-space/datafile 2024-05-08T18:41:18.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:18.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:18.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:41:18.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj445 td/osd-backfill-space/datafile 2024-05-08T18:41:18.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:18.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:18.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:41:18.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj446 td/osd-backfill-space/datafile 2024-05-08T18:41:18.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:18.953 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:18.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:18.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:41:19.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj447 td/osd-backfill-space/datafile 2024-05-08T18:41:19.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:19.148 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:19.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:41:19.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj448 td/osd-backfill-space/datafile 2024-05-08T18:41:19.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:19.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:19.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:41:19.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj449 td/osd-backfill-space/datafile 2024-05-08T18:41:19.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:19.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:19.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:41:19.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj450 td/osd-backfill-space/datafile 2024-05-08T18:41:19.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:19.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:19.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:41:19.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj451 td/osd-backfill-space/datafile 2024-05-08T18:41:19.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:19.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:19.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:19.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:41:20.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj452 td/osd-backfill-space/datafile 2024-05-08T18:41:20.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:20.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:20.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:41:20.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj453 td/osd-backfill-space/datafile 2024-05-08T18:41:20.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:20.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:20.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:41:20.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj454 td/osd-backfill-space/datafile 2024-05-08T18:41:20.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:20.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:20.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:41:20.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj455 td/osd-backfill-space/datafile 2024-05-08T18:41:20.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:20.785 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:20.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:41:20.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj456 td/osd-backfill-space/datafile 2024-05-08T18:41:20.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:20.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:20.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:20.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:41:21.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj457 td/osd-backfill-space/datafile 2024-05-08T18:41:21.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:21.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:21.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:41:21.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj458 td/osd-backfill-space/datafile 2024-05-08T18:41:21.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:21.329 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:21.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:41:21.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj459 td/osd-backfill-space/datafile 2024-05-08T18:41:21.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:21.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:21.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:41:21.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj460 td/osd-backfill-space/datafile 2024-05-08T18:41:21.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:21.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:21.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:41:21.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj461 td/osd-backfill-space/datafile 2024-05-08T18:41:21.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:21.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:21.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:21.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:41:22.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj462 td/osd-backfill-space/datafile 2024-05-08T18:41:22.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:22.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:22.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:41:22.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj463 td/osd-backfill-space/datafile 2024-05-08T18:41:22.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:22.300 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:22.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:41:22.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj464 td/osd-backfill-space/datafile 2024-05-08T18:41:22.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:22.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:22.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:41:22.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj465 td/osd-backfill-space/datafile 2024-05-08T18:41:22.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:22.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:22.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:41:22.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj466 td/osd-backfill-space/datafile 2024-05-08T18:41:22.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:22.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:22.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:41:22.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:22.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj467 td/osd-backfill-space/datafile 2024-05-08T18:41:23.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:23.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:23.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:41:23.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj468 td/osd-backfill-space/datafile 2024-05-08T18:41:23.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:23.253 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:23.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:41:23.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj469 td/osd-backfill-space/datafile 2024-05-08T18:41:23.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:23.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:23.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:41:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj470 td/osd-backfill-space/datafile 2024-05-08T18:41:23.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:23.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:23.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:41:23.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj471 td/osd-backfill-space/datafile 2024-05-08T18:41:23.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:23.872 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:23.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:41:23.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:23.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj472 td/osd-backfill-space/datafile 2024-05-08T18:41:24.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:24.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:24.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:41:24.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj473 td/osd-backfill-space/datafile 2024-05-08T18:41:24.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:24.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:24.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:41:24.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj474 td/osd-backfill-space/datafile 2024-05-08T18:41:24.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:24.432 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:24.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:41:24.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj475 td/osd-backfill-space/datafile 2024-05-08T18:41:24.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:24.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:24.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:41:24.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj476 td/osd-backfill-space/datafile 2024-05-08T18:41:24.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:24.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:24.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:41:24.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj477 td/osd-backfill-space/datafile 2024-05-08T18:41:24.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:24.950 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:24.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:24.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:41:25.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj478 td/osd-backfill-space/datafile 2024-05-08T18:41:25.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:25.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:25.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:41:25.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj479 td/osd-backfill-space/datafile 2024-05-08T18:41:25.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:25.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:25.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:41:25.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj480 td/osd-backfill-space/datafile 2024-05-08T18:41:25.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:25.510 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:25.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:41:25.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj481 td/osd-backfill-space/datafile 2024-05-08T18:41:25.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:25.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:25.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:41:25.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj482 td/osd-backfill-space/datafile 2024-05-08T18:41:25.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:25.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:25.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:25.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:41:26.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj483 td/osd-backfill-space/datafile 2024-05-08T18:41:26.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:26.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:26.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:41:26.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj484 td/osd-backfill-space/datafile 2024-05-08T18:41:26.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:26.331 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:26.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:41:26.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj485 td/osd-backfill-space/datafile 2024-05-08T18:41:26.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:26.507 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:26.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:41:26.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj486 td/osd-backfill-space/datafile 2024-05-08T18:41:26.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:26.690 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:26.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:41:26.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj487 td/osd-backfill-space/datafile 2024-05-08T18:41:26.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:26.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:26.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:41:26.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:26.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj488 td/osd-backfill-space/datafile 2024-05-08T18:41:27.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:27.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:27.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:41:27.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj489 td/osd-backfill-space/datafile 2024-05-08T18:41:27.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:27.227 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:27.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:41:27.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj490 td/osd-backfill-space/datafile 2024-05-08T18:41:27.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:27.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:27.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:41:27.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj491 td/osd-backfill-space/datafile 2024-05-08T18:41:27.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:27.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:27.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:41:27.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj492 td/osd-backfill-space/datafile 2024-05-08T18:41:27.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:27.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:27.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:41:27.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:27.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj493 td/osd-backfill-space/datafile 2024-05-08T18:41:28.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:28.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:28.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:41:28.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj494 td/osd-backfill-space/datafile 2024-05-08T18:41:28.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:28.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:28.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:41:28.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj495 td/osd-backfill-space/datafile 2024-05-08T18:41:28.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:28.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:28.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:41:28.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj496 td/osd-backfill-space/datafile 2024-05-08T18:41:28.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:28.598 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:28.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:41:28.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj497 td/osd-backfill-space/datafile 2024-05-08T18:41:28.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:28.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:28.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:41:28.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj498 td/osd-backfill-space/datafile 2024-05-08T18:41:28.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:28.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:28.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:28.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:41:29.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj499 td/osd-backfill-space/datafile 2024-05-08T18:41:29.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:29.138 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:29.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:41:29.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj500 td/osd-backfill-space/datafile 2024-05-08T18:41:29.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:29.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:29.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:41:29.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj501 td/osd-backfill-space/datafile 2024-05-08T18:41:29.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:29.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:29.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:41:29.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj502 td/osd-backfill-space/datafile 2024-05-08T18:41:29.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:29.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:29.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:41:29.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj503 td/osd-backfill-space/datafile 2024-05-08T18:41:29.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:29.944 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:29.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:29.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:41:30.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj504 td/osd-backfill-space/datafile 2024-05-08T18:41:30.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:30.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:30.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:41:30.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj505 td/osd-backfill-space/datafile 2024-05-08T18:41:30.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:30.306 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:30.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:41:30.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj506 td/osd-backfill-space/datafile 2024-05-08T18:41:30.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:30.497 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:30.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:41:30.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj507 td/osd-backfill-space/datafile 2024-05-08T18:41:30.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:30.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:30.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:41:30.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj508 td/osd-backfill-space/datafile 2024-05-08T18:41:30.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:30.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:30.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:41:30.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:30.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj509 td/osd-backfill-space/datafile 2024-05-08T18:41:31.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:31.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:31.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:41:31.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj510 td/osd-backfill-space/datafile 2024-05-08T18:41:31.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:31.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:31.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:41:31.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj511 td/osd-backfill-space/datafile 2024-05-08T18:41:31.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:31.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:31.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:41:31.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj512 td/osd-backfill-space/datafile 2024-05-08T18:41:31.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:31.659 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:31.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:41:31.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj513 td/osd-backfill-space/datafile 2024-05-08T18:41:31.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:31.936 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:31.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:31.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:41:32.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj514 td/osd-backfill-space/datafile 2024-05-08T18:41:32.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:32.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:32.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:41:32.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj515 td/osd-backfill-space/datafile 2024-05-08T18:41:32.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:32.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:32.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:41:32.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj516 td/osd-backfill-space/datafile 2024-05-08T18:41:32.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:32.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:32.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:41:32.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj517 td/osd-backfill-space/datafile 2024-05-08T18:41:32.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:32.671 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:32.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:41:32.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj518 td/osd-backfill-space/datafile 2024-05-08T18:41:32.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:32.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:32.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:41:32.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:32.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj519 td/osd-backfill-space/datafile 2024-05-08T18:41:33.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:33.039 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:33.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:41:33.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj520 td/osd-backfill-space/datafile 2024-05-08T18:41:33.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:33.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:33.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:41:33.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj521 td/osd-backfill-space/datafile 2024-05-08T18:41:33.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:33.415 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:33.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:41:33.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj522 td/osd-backfill-space/datafile 2024-05-08T18:41:33.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:33.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:33.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:41:33.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj523 td/osd-backfill-space/datafile 2024-05-08T18:41:33.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:33.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:33.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:41:33.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:33.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj524 td/osd-backfill-space/datafile 2024-05-08T18:41:34.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:34.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:34.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:41:34.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj525 td/osd-backfill-space/datafile 2024-05-08T18:41:34.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:34.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:34.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:41:34.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj526 td/osd-backfill-space/datafile 2024-05-08T18:41:34.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:34.386 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:34.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:41:34.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj527 td/osd-backfill-space/datafile 2024-05-08T18:41:34.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:34.570 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:34.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:41:34.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj528 td/osd-backfill-space/datafile 2024-05-08T18:41:34.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:34.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:34.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:41:34.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj529 td/osd-backfill-space/datafile 2024-05-08T18:41:34.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:34.930 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:34.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:34.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:41:35.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj530 td/osd-backfill-space/datafile 2024-05-08T18:41:35.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:35.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:35.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:41:35.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj531 td/osd-backfill-space/datafile 2024-05-08T18:41:35.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:35.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:35.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:41:35.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj532 td/osd-backfill-space/datafile 2024-05-08T18:41:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:35.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:35.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:41:35.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj533 td/osd-backfill-space/datafile 2024-05-08T18:41:35.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:35.709 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:35.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:41:35.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj534 td/osd-backfill-space/datafile 2024-05-08T18:41:35.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:35.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:35.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:41:35.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:35.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj535 td/osd-backfill-space/datafile 2024-05-08T18:41:36.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:36.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:36.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:41:36.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj536 td/osd-backfill-space/datafile 2024-05-08T18:41:36.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:36.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:36.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:41:36.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj537 td/osd-backfill-space/datafile 2024-05-08T18:41:36.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:36.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:36.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:41:36.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj538 td/osd-backfill-space/datafile 2024-05-08T18:41:36.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:36.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:36.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:41:36.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj539 td/osd-backfill-space/datafile 2024-05-08T18:41:36.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:36.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:36.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:36.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:41:37.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:37.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj540 td/osd-backfill-space/datafile 2024-05-08T18:41:37.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:37.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:37.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:37.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:41:37.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:37.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj541 td/osd-backfill-space/datafile 2024-05-08T18:41:37.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:37.698 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:37.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:37.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:41:37.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:37.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj542 td/osd-backfill-space/datafile 2024-05-08T18:41:37.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:37.882 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:37.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:37.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:41:37.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:37.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj543 td/osd-backfill-space/datafile 2024-05-08T18:41:38.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:38.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:38.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:41:38.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj544 td/osd-backfill-space/datafile 2024-05-08T18:41:38.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:38.250 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:38.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:41:38.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj545 td/osd-backfill-space/datafile 2024-05-08T18:41:38.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:38.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:38.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:41:38.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj546 td/osd-backfill-space/datafile 2024-05-08T18:41:38.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:38.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:38.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:41:38.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj547 td/osd-backfill-space/datafile 2024-05-08T18:41:38.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:38.819 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:38.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:41:38.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:38.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj548 td/osd-backfill-space/datafile 2024-05-08T18:41:39.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:39.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:39.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:41:39.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj549 td/osd-backfill-space/datafile 2024-05-08T18:41:39.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:39.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:39.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:41:39.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj550 td/osd-backfill-space/datafile 2024-05-08T18:41:39.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:39.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:39.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:41:39.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj551 td/osd-backfill-space/datafile 2024-05-08T18:41:39.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:39.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:39.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:41:39.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj552 td/osd-backfill-space/datafile 2024-05-08T18:41:39.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:39.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:39.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:41:39.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:39.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj553 td/osd-backfill-space/datafile 2024-05-08T18:41:40.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:40.023 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:40.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:41:40.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj554 td/osd-backfill-space/datafile 2024-05-08T18:41:40.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:40.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:40.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:41:40.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj555 td/osd-backfill-space/datafile 2024-05-08T18:41:40.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:40.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:40.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:41:40.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj556 td/osd-backfill-space/datafile 2024-05-08T18:41:40.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:40.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:40.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:41:40.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj557 td/osd-backfill-space/datafile 2024-05-08T18:41:40.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:40.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:40.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:41:40.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj558 td/osd-backfill-space/datafile 2024-05-08T18:41:40.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:40.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:40.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:41:40.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:40.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj559 td/osd-backfill-space/datafile 2024-05-08T18:41:41.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:41.060 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:41:41.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj560 td/osd-backfill-space/datafile 2024-05-08T18:41:41.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:41.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:41.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:41:41.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj561 td/osd-backfill-space/datafile 2024-05-08T18:41:41.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:41.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:41.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:41:41.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj562 td/osd-backfill-space/datafile 2024-05-08T18:41:41.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:41.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:41.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:41:41.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj563 td/osd-backfill-space/datafile 2024-05-08T18:41:41.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:41.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:41.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:41:41.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj564 td/osd-backfill-space/datafile 2024-05-08T18:41:41.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:41.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:41.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:41:41.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:41.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj565 td/osd-backfill-space/datafile 2024-05-08T18:41:42.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:42.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:42.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:41:42.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj566 td/osd-backfill-space/datafile 2024-05-08T18:41:42.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:42.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:42.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:41:42.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj567 td/osd-backfill-space/datafile 2024-05-08T18:41:42.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:42.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:42.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:41:42.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj568 td/osd-backfill-space/datafile 2024-05-08T18:41:42.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:42.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:42.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:41:42.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj569 td/osd-backfill-space/datafile 2024-05-08T18:41:42.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:42.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:42.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:41:42.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj570 td/osd-backfill-space/datafile 2024-05-08T18:41:42.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:42.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:42.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:41:42.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:42.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj571 td/osd-backfill-space/datafile 2024-05-08T18:41:43.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:43.065 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:43.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:41:43.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj572 td/osd-backfill-space/datafile 2024-05-08T18:41:43.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:43.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:43.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:41:43.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj573 td/osd-backfill-space/datafile 2024-05-08T18:41:43.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:43.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:43.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:41:43.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj574 td/osd-backfill-space/datafile 2024-05-08T18:41:43.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:43.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:43.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:41:43.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj575 td/osd-backfill-space/datafile 2024-05-08T18:41:43.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:43.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:43.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:41:43.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj576 td/osd-backfill-space/datafile 2024-05-08T18:41:43.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:43.943 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:43.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:43.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:41:44.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj577 td/osd-backfill-space/datafile 2024-05-08T18:41:44.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:44.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:44.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:41:44.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj578 td/osd-backfill-space/datafile 2024-05-08T18:41:44.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:44.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:44.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:41:44.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj579 td/osd-backfill-space/datafile 2024-05-08T18:41:44.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:44.411 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:44.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:41:44.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj580 td/osd-backfill-space/datafile 2024-05-08T18:41:44.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:44.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:44.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:41:44.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj581 td/osd-backfill-space/datafile 2024-05-08T18:41:44.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:44.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:44.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:41:44.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj582 td/osd-backfill-space/datafile 2024-05-08T18:41:44.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:44.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:44.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:41:44.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:44.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj583 td/osd-backfill-space/datafile 2024-05-08T18:41:45.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:45.037 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:45.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:41:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj584 td/osd-backfill-space/datafile 2024-05-08T18:41:45.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:45.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:45.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:41:45.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj585 td/osd-backfill-space/datafile 2024-05-08T18:41:45.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:45.337 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:45.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:41:45.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj586 td/osd-backfill-space/datafile 2024-05-08T18:41:45.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:45.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:45.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:41:45.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj587 td/osd-backfill-space/datafile 2024-05-08T18:41:45.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:45.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:45.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:41:45.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj588 td/osd-backfill-space/datafile 2024-05-08T18:41:45.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:45.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:45.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:41:45.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj589 td/osd-backfill-space/datafile 2024-05-08T18:41:45.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:45.914 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:45.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:41:45.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:45.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj590 td/osd-backfill-space/datafile 2024-05-08T18:41:46.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:46.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:46.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:41:46.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj591 td/osd-backfill-space/datafile 2024-05-08T18:41:46.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:46.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:46.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:41:46.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj592 td/osd-backfill-space/datafile 2024-05-08T18:41:46.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:46.332 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:46.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:41:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj593 td/osd-backfill-space/datafile 2024-05-08T18:41:46.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:46.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:46.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:41:46.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj594 td/osd-backfill-space/datafile 2024-05-08T18:41:46.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:46.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:46.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:41:46.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj595 td/osd-backfill-space/datafile 2024-05-08T18:41:46.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:46.733 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:46.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:41:46.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj596 td/osd-backfill-space/datafile 2024-05-08T18:41:46.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:46.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:46.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:41:46.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:46.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj597 td/osd-backfill-space/datafile 2024-05-08T18:41:47.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:47.009 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:47.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:47.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:41:47.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:47.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj598 td/osd-backfill-space/datafile 2024-05-08T18:41:47.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:47.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:47.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:47.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:41:47.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:47.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj599 td/osd-backfill-space/datafile 2024-05-08T18:41:47.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-05-08T18:41:47.326 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:47.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:47.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:41:47.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:47.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj600 td/osd-backfill-space/datafile 2024-05-08T18:41:47.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:145: TEST_backfill_test_simple: ceph pg dump pgs 2024-05-08T18:41:47.930 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:41:47.930 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 584 0 0 0 0 2392064 0 0 84 500 84 active+clean 2024-05-08T18:39:46.724345+0000 28'584 28:604 [2] 2 [2] 2 0'0 2024-05-08T18:39:44.229959+0000 0'0 2024-05-08T18:39:44.229959+0000 0 0 periodic scrub scheduled @ 2024-05-09T19:02:22.300284+0000 0 0 2024-05-08T18:41:47.930 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 597 0 0 0 0 2445312 0 0 97 500 97 active+clean 2024-05-08T18:39:43.960897+0000 28'597 28:626 [1] 1 [1] 1 0'0 2024-05-08T18:39:41.462405+0000 0'0 2024-05-08T18:39:41.462405+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:09:07.134308+0000 0 0 2024-05-08T18:41:47.930 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:41:47.930 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:41:47.930 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:41:47.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:147: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:41:47.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:147: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:47.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:149: TEST_backfill_test_simple: ceph osd pool set test1 size 2 2024-05-08T18:41:48.535 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T18:41:48.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:147: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-05-08T18:41:48.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:149: TEST_backfill_test_simple: ceph osd pool set test2 size 2 2024-05-08T18:41:49.273 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 2 size to 2 2024-05-08T18:41:49.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:151: TEST_backfill_test_simple: sleep 30 2024-05-08T18:42:19.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:153: TEST_backfill_test_simple: wait_for_not_backfilling 1200 2024-05-08T18:42:19.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-05-08T18:42:19.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-05-08T18:42:19.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-05-08T18:42:19.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:42:19.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:42:19.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-05-08T18:42:19.297 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:42:19.297 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:42:19.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:42:19.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:42:19.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:42:20.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-05-08T18:42:20.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:42:20.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:42:20.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:42:20.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:42:20.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:42:20.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:42:20.515 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:42:20.515 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T18:42:20.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:42:20.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:42:20.516 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:42:20.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836531 2024-05-08T18:42:20.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836531 2024-05-08T18:42:20.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836531' 2024-05-08T18:42:20.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:42:20.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:42:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673006 2024-05-08T18:42:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673006 2024-05-08T18:42:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836531 1-42949673006' 2024-05-08T18:42:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:42:20.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:42:21.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509479 2024-05-08T18:42:21.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509479 2024-05-08T18:42:21.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836531 1-42949673006 2-64424509479' 2024-05-08T18:42:21.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:42:21.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836531 2024-05-08T18:42:21.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:42:21.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:42:21.050 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836531 2024-05-08T18:42:21.050 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:42:21.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836531 2024-05-08T18:42:21.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836531' 2024-05-08T18:42:21.051 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836531 2024-05-08T18:42:21.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:42:21.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836531 -lt 21474836531 2024-05-08T18:42:21.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:42:21.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:42:21.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673006 2024-05-08T18:42:21.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:42:21.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673006 2024-05-08T18:42:21.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:42:21.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673006 2024-05-08T18:42:21.468 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673006 2024-05-08T18:42:21.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673006' 2024-05-08T18:42:21.468 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:42:21.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673006 -lt 42949673006 2024-05-08T18:42:21.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:42:21.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509479 2024-05-08T18:42:21.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:42:21.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:42:21.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509479 2024-05-08T18:42:21.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:42:21.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509479 2024-05-08T18:42:21.908 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509479 2024-05-08T18:42:21.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509479' 2024-05-08T18:42:21.908 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:42:22.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509479 -lt 64424509479 2024-05-08T18:42:22.344 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:42:22.344 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:42:22.344 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:42:22.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-05-08T18:42:22.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:42:22.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:42:22.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:42:22.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:42:22.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:42:22.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:42:22.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:42:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-05-08T18:42:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-05-08T18:42:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' -1 2024-05-08T18:42:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-05-08T18:42:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=1 2024-05-08T18:42:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-05-08T18:42:28.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:42:28.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:42:28.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:42:28.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:42:28.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:42:28.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:42:28.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:42:28.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:42:28.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-05-08T18:42:28.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-05-08T18:42:28.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' 1 2024-05-08T18:42:28.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 1 >= 81 )) 2024-05-08T18:42:28.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 10 2024-05-08T18:42:38.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-05-08T18:42:38.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:42:38.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:42:38.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:42:38.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:42:38.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:42:38.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:42:38.870 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:154: TEST_backfill_test_simple: wait_for_not_activating 60 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:42:39.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:42:39.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-05-08T18:42:39.301 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:42:39.301 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:42:39.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:42:39.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:42:39.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:42:39.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-05-08T18:42:39.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:42:39.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:42:39.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:42:39.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:42:39.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:42:39.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:42:39.755 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:42:39.755 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T18:42:39.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:42:39.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:42:39.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:42:39.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836537 2024-05-08T18:42:39.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836537 2024-05-08T18:42:39.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537' 2024-05-08T18:42:39.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:42:39.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:42:40.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673012 2024-05-08T18:42:40.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673012 2024-05-08T18:42:40.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673012' 2024-05-08T18:42:40.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:42:40.076 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:42:40.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509484 2024-05-08T18:42:40.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509484 2024-05-08T18:42:40.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673012 2-64424509484' 2024-05-08T18:42:40.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:42:40.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836537 2024-05-08T18:42:40.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:42:40.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:42:40.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836537 2024-05-08T18:42:40.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:42:40.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836537 2024-05-08T18:42:40.244 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836537 2024-05-08T18:42:40.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2024-05-08T18:42:40.245 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:42:40.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836535 -lt 21474836537 2024-05-08T18:42:40.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:42:41.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:42:41.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:42:42.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836537 -lt 21474836537 2024-05-08T18:42:42.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:42:42.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:42:42.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673012 2024-05-08T18:42:42.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:42:42.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673012 2024-05-08T18:42:42.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:42:42.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673012 2024-05-08T18:42:42.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673012' 2024-05-08T18:42:42.056 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673012 2024-05-08T18:42:42.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:42:42.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673012 -lt 42949673012 2024-05-08T18:42:42.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:42:42.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509484 2024-05-08T18:42:42.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:42:42.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:42:42.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509484 2024-05-08T18:42:42.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:42:42.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509484 2024-05-08T18:42:42.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509484' 2024-05-08T18:42:42.487 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509484 2024-05-08T18:42:42.487 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:42:42.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509485 -lt 64424509484 2024-05-08T18:42:42.889 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:42:42.890 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:42:42.890 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:42:43.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-05-08T18:42:43.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:42:43.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-05-08T18:42:43.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-05-08T18:42:43.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:42:43.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-05-08T18:42:43.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:42:43.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-05-08T18:42:43.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:42:43.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:42:43.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:42:43.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:42:43.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:156: TEST_backfill_test_simple: ERRORS=0 2024-05-08T18:42:43.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:157: TEST_backfill_test_simple: ceph pg dump pgs 2024-05-08T18:42:43.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:157: TEST_backfill_test_simple: grep +backfill_toofull 2024-05-08T18:42:43.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:157: TEST_backfill_test_simple: wc -l 2024-05-08T18:42:44.220 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:42:44.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:157: TEST_backfill_test_simple: '[' 1 '!=' 1 ']' 2024-05-08T18:42:44.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:163: TEST_backfill_test_simple: expr 2 - 1 2024-05-08T18:42:44.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:163: TEST_backfill_test_simple: expected=1 2024-05-08T18:42:44.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:164: TEST_backfill_test_simple: ceph pg dump pgs 2024-05-08T18:42:44.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:164: TEST_backfill_test_simple: grep active+clean 2024-05-08T18:42:44.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:164: TEST_backfill_test_simple: wc -l 2024-05-08T18:42:44.639 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:42:44.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:164: TEST_backfill_test_simple: '[' 1 '!=' 1 ']' 2024-05-08T18:42:44.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:170: TEST_backfill_test_simple: ceph pg dump pgs 2024-05-08T18:42:45.029 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:42:45.029 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T18:42:22.052448+0000 28'600 37:644 [2,1] 2 [2] 2 0'0 2024-05-08T18:39:44.229959+0000 0'0 2024-05-08T18:39:44.229959+0000 0 0 no scrub is scheduled 0 0 2024-05-08T18:42:45.029 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-05-08T18:42:31.153042+0000 28'600 37:1857 [1,0] 1 [1,0] 1 0'0 2024-05-08T18:39:41.462405+0000 0'0 2024-05-08T18:39:41.462405+0000 0 0 periodic scrub scheduled @ 2024-05-10T06:37:40.793597+0000 0 0 2024-05-08T18:42:45.029 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:42:45.030 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:42:45.030 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:42:45.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:172: TEST_backfill_test_simple: '[' 0 '!=' 0 ']' 2024-05-08T18:42:45.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:177: TEST_backfill_test_simple: seq 1 2 2024-05-08T18:42:45.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:177: TEST_backfill_test_simple: for i in $(seq 1 $pools) 2024-05-08T18:42:45.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:179: TEST_backfill_test_simple: delete_pool test1 2024-05-08T18:42:45.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test1 2024-05-08T18:42:45.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-05-08T18:42:45.557 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' does not exist 2024-05-08T18:42:45.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:177: TEST_backfill_test_simple: for i in $(seq 1 $pools) 2024-05-08T18:42:45.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:179: TEST_backfill_test_simple: delete_pool test2 2024-05-08T18:42:45.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test2 2024-05-08T18:42:45.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-05-08T18:42:46.097 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' does not exist 2024-05-08T18:42:46.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:181: TEST_backfill_test_simple: kill_daemons td/osd-backfill-space 2024-05-08T18:42:46.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:42:46.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:42:46.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:42:46.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:42:46.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:42:51.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:42:51.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:182: TEST_backfill_test_simple: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2024-05-08T18:42:51.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-05-08T18:42:51.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:42:51.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:42:51.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:42:51.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:42:51.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:42:51.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:42:51.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:42:51.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:42:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:42:51.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:42:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:42:51.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:42:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:42:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:42:51.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:42:51.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:42:51.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:42:51.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:42:51.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:42:51.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:42:51.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:42:51.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:42:51.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:42:51.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:42:51.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:42:51.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:42:51.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:42:51.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:42:51.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:42:51.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:42:51.548 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:42:51.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:42:51.549 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:42:51.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:42:51.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:42:51.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:42:51.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:42:51.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:42:51.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:42:51.551 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:42:51.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:42:51.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:42:51.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:42:51.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:42:51.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:42:51.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:42:51.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:42:51.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:42:51.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:42:51.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2024-05-08T18:42:51.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T18:42:51.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:42:51.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:42:51.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.109971 2024-05-08T18:42:51.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T18:42:51.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T18:42:51.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T18:42:51.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-05-08T18:42:51.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_ec_backfill_grow td/osd-backfill-space 2024-05-08T18:42:51.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1111: TEST_ec_backfill_grow: local dir=td/osd-backfill-space 2024-05-08T18:42:51.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1112: TEST_ec_backfill_grow: local poolname=test 2024-05-08T18:42:51.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1113: TEST_ec_backfill_grow: local OSDS=6 2024-05-08T18:42:51.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1114: TEST_ec_backfill_grow: local k=3 2024-05-08T18:42:51.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1115: TEST_ec_backfill_grow: local m=2 2024-05-08T18:42:51.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1116: TEST_ec_backfill_grow: expr 600 / 3 2024-05-08T18:42:51.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1116: TEST_ec_backfill_grow: local ecobjects=200 2024-05-08T18:42:51.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1118: TEST_ec_backfill_grow: run_mon td/osd-backfill-space a 2024-05-08T18:42:51.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2024-05-08T18:42:51.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T18:42:51.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T18:42:51.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T18:42:51.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2024-05-08T18:42:51.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-05-08T18:42:51.874 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T18:42:51.874 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:42:51.874 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:42:51.875 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:42:51.875 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:42:51.875 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:42:51.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:42:51.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T18:42:52.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T18:42:52.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T18:42:52.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:42:52.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:42:52.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T18:42:52.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T18:42:52.093 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:42:52.093 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:42:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:42:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:42:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:42:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:42:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:42:52.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:42:52.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get fsid 2024-05-08T18:42:52.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T18:42:52.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:42:52.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:42:52.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T18:42:52.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T18:42:52.212 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:42:52.212 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:42:52.212 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:42:52.213 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:42:52.213 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:42:52.213 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:42:52.214 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:42:52.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:42:52.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get mon_host 2024-05-08T18:42:52.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1119: TEST_ec_backfill_grow: run_mgr td/osd-backfill-space x 2024-05-08T18:42:52.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-space 2024-05-08T18:42:52.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T18:42:52.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T18:42:52.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T18:42:52.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-space/x 2024-05-08T18:42:52.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T18:42:53.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T18:42:53.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:42:53.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:42:53.247 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:42:53.247 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:42:53.247 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:42:53.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:42:53.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:42:53.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:42:53.322 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: expr 6 - 1 2024-05-08T18:42:53.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: seq 0 5 2024-05-08T18:42:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:42:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 0 2024-05-08T18:42:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:42:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:42:53.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:42:53.328 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:42:53.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:42:53.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:42:53.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T18:42:53.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:42:53.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=72472a31-4897-4220-8434-7a8b73bcb276 2024-05-08T18:42:53.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 72472a31-4897-4220-8434-7a8b73bcb276' 2024-05-08T18:42:53.331 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 72472a31-4897-4220-8434-7a8b73bcb276 2024-05-08T18:42:53.331 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:42:53.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCtxztmBzw7FRAA4dmS5zYyUitc326vQ9INyg== 2024-05-08T18:42:53.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCtxztmBzw7FRAA4dmS5zYyUitc326vQ9INyg=="}' 2024-05-08T18:42:53.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 72472a31-4897-4220-8434-7a8b73bcb276 -i td/osd-backfill-space/0/new.json 2024-05-08T18:42:53.645 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:42:53.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/0/new.json 2024-05-08T18:42:53.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCtxztmBzw7FRAA4dmS5zYyUitc326vQ9INyg== --osd-uuid 72472a31-4897-4220-8434-7a8b73bcb276 2024-05-08T18:42:53.697 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:42:53.700+0000 7ff87ea397c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:42:53.713 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:42:53.716+0000 7ff87ea397c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:42:53.714 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:42:53.716+0000 7ff87ea397c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:42:53.714 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:42:53.716+0000 7ff87ea397c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:42:53.715 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:42:53.716+0000 7ff87ea397c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:42:53.715 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:42:53.716+0000 7ff87ea397c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:42:53.753 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:42:53.756+0000 7ff87ea397c0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-05-08T18:42:59.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-05-08T18:42:59.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:42:59.600 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T18:42:59.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T18:42:59.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:43:00.236 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T18:43:00.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T18:43:00.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:43:00.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:43:00.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:43:00.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:43:00.274 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:00.276+0000 7f94541da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:00.293 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:00.296+0000 7f94541da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:00.294 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:00.296+0000 7f94541da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:00.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T18:43:00.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:43:00.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T18:43:00.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:43:00.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:43:00.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:00.644 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:43:00.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:43:00.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:00.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:00.859 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:00.860+0000 7f94541da7c0 -1 Falling back to public interface 2024-05-08T18:43:01.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:02.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:02.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:02.077 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:43:02.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:43:02.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:02.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:02.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:03.333 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:03.336+0000 7f94541da7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:43:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:43:03.494 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:43:03.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:03.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:04.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:05.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:05.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:05.080 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:43:05.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:43:05.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:05.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:05.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:06.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:06.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:06.511 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:43:06.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:43:06.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:06.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:07.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:08.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:08.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:08.090 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:43:08.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:43:08.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:08.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:08.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:09.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:09.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:09.560 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:43:09.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:43:09.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:09.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:10.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:11.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:11.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:11.220 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:43:11.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:43:11.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:11.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:11.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:12.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:12.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:12.685 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:43:12.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:43:12.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:12.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:13.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:14.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:14.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:14.219 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:43:14.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:43:14.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:14.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:14.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:15.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:15.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:15.667 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:43:15.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:43:15.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:15.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:16.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:17.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:17.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:17.219 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:43:17.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:43:17.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:17.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:18.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:19.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:19.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:19.137 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:43:19.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:43:19.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:19.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:19.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:20.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:20.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:20.893 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:43:20.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:43:20.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:20.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:21.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:22.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:22.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:22.709 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:43:22.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:43:22.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:22.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:23.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:24.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:24.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:24.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:43:24.593 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:43:24.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:24.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:25.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:26.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:26.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:26.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:43:26.621 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:43:26.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:26.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:43:27.063 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4029279873,v1:127.0.0.1:6803/4029279873] [v2:127.0.0.1:6804/4029279873,v1:127.0.0.1:6805/4029279873] exists,up 72472a31-4897-4220-8434-7a8b73bcb276 2024-05-08T18:43:27.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:43:27.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:43:27.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:43:27.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:43:27.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 1 2024-05-08T18:43:27.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:43:27.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:43:27.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:43:27.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:43:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:43:27.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:43:27.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:43:27.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:43:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:43:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:43:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:43:27.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:43:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:43:27.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:43:27.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:43:27.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:43:27.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T18:43:27.072 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:43:27.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=58fc3722-b8d7-4458-aeea-dae11208b6f9 2024-05-08T18:43:27.072 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 58fc3722-b8d7-4458-aeea-dae11208b6f9 2024-05-08T18:43:27.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 58fc3722-b8d7-4458-aeea-dae11208b6f9' 2024-05-08T18:43:27.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:43:27.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDPxztmC7X5BRAA5rrZcX/C9Km7O2cftEDETA== 2024-05-08T18:43:27.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDPxztmC7X5BRAA5rrZcX/C9Km7O2cftEDETA=="}' 2024-05-08T18:43:27.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 58fc3722-b8d7-4458-aeea-dae11208b6f9 -i td/osd-backfill-space/1/new.json 2024-05-08T18:43:27.617 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:43:27.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/1/new.json 2024-05-08T18:43:27.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDPxztmC7X5BRAA5rrZcX/C9Km7O2cftEDETA== --osd-uuid 58fc3722-b8d7-4458-aeea-dae11208b6f9 2024-05-08T18:43:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:27.676+0000 7f55c1c257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:27.679 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:27.680+0000 7f55c1c257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:27.680 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:27.680+0000 7f55c1c257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:27.681 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:27.684+0000 7f55c1c257c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:43:27.681 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:27.684+0000 7f55c1c257c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:43:27.681 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:27.684+0000 7f55c1c257c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:43:27.718 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:27.720+0000 7f55c1c257c0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-05-08T18:43:33.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-05-08T18:43:33.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:43:33.787 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T18:43:33.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T18:43:33.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:43:34.359 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T18:43:34.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T18:43:34.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:43:34.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:43:34.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:43:34.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:43:34.397 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:34.400+0000 7f296f6da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:34.415 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:34.416+0000 7f296f6da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:34.417 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:34.420+0000 7f296f6da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:43:34.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T18:43:34.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:43:34.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T18:43:34.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:43:34.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:43:34.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:34.771 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:43:34.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:43:34.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:34.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:34.974 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:34.976+0000 7f296f6da7c0 -1 Falling back to public interface 2024-05-08T18:43:35.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:36.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:36.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:36.230 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:43:36.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:43:36.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:36.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:36.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:37.504 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:43:37.503+0000 7f296f6da7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:43:37.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:37.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:37.664 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:43:37.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:43:37.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:37.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:38.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:39.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:39.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:39.109 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:43:39.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:43:39.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:39.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:39.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:40.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:40.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:40.591 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:43:40.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:43:40.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:40.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:41.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:42.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:42.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:42.088 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:43:42.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:43:42.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:42.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:42.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:43.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:43.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:43.700 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:43:43.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:43:43.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:43.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:44.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:45.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:45.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:45.325 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:43:45.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:43:45.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:45.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:45.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:46.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:46.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:46.787 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:43:46.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:43:46.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:46.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:47.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:48.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:48.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:48.328 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:43:48.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:43:48.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:48.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:48.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:49.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:49.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:49.814 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:43:49.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:43:49.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:49.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:50.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:51.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:51.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:51.618 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:43:51.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:43:51.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:51.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:52.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:53.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:53.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:53.467 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:43:53.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:43:53.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:53.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:54.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:55.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:55.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:55.130 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:43:55.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:43:55.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:55.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:56.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:57.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:57.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:57.472 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:43:57.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:43:57.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:57.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:43:58.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:43:59.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:43:59.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:43:59.297 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:43:59.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:43:59.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:43:59.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:44:00.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:01.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:01.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:01.079 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:44:01.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:44:01.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:01.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:44:01.522 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2152600350,v1:127.0.0.1:6811/2152600350] [v2:127.0.0.1:6812/2152600350,v1:127.0.0.1:6813/2152600350] exists,up 58fc3722-b8d7-4458-aeea-dae11208b6f9 2024-05-08T18:44:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:44:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:44:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:44:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:44:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 2 2024-05-08T18:44:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:44:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:44:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:44:01.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:44:01.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:44:01.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:44:01.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:44:01.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:44:01.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T18:44:01.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:44:01.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=743aeb06-4b0c-4054-b230-6c65841c4daf 2024-05-08T18:44:01.531 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 743aeb06-4b0c-4054-b230-6c65841c4daf 2024-05-08T18:44:01.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 743aeb06-4b0c-4054-b230-6c65841c4daf' 2024-05-08T18:44:01.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:44:01.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDxxztmbSoKIRAAAUEjAW6Vxe32ggUjzMtJNQ== 2024-05-08T18:44:01.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDxxztmbSoKIRAAAUEjAW6Vxe32ggUjzMtJNQ=="}' 2024-05-08T18:44:01.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 743aeb06-4b0c-4054-b230-6c65841c4daf -i td/osd-backfill-space/2/new.json 2024-05-08T18:44:02.058 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:44:02.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/2/new.json 2024-05-08T18:44:02.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDxxztmbSoKIRAAAUEjAW6Vxe32ggUjzMtJNQ== --osd-uuid 743aeb06-4b0c-4054-b230-6c65841c4daf 2024-05-08T18:44:02.115 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:02.115+0000 7f2708a8c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:02.119 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:02.119+0000 7f2708a8c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:02.121 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:02.123+0000 7f2708a8c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:02.121 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:02.123+0000 7f2708a8c7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:44:02.121 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:02.123+0000 7f2708a8c7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:44:02.121 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:02.123+0000 7f2708a8c7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:44:02.150 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:02.151+0000 7f2708a8c7c0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-05-08T18:44:08.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-05-08T18:44:08.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:44:08.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T18:44:08.243 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T18:44:08.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:44:08.795 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T18:44:08.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T18:44:08.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:44:08.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:44:08.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:44:08.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:44:08.833 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:08.835+0000 7f4ab75877c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:08.865 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:08.867+0000 7f4ab75877c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:08.866 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:08.867+0000 7f4ab75877c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:09.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T18:44:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:44:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T18:44:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:44:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:44:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:09.241 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:44:09.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:44:09.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:09.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:09.446 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:09.447+0000 7f4ab75877c0 -1 Falling back to public interface 2024-05-08T18:44:09.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:10.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:10.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:10.724 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:44:10.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:44:10.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:10.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:11.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:12.081 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:12.083+0000 7f4ab75877c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:44:12.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:12.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:12.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:44:12.142 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:44:12.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:12.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:12.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:13.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:13.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:13.784 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:44:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:44:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:14.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:15.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:15.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:15.234 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:44:15.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:44:15.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:15.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:15.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:16.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:16.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:16.681 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:44:16.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:44:16.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:16.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:17.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:18.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:18.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:18.180 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:44:18.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:44:18.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:18.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:18.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:19.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:19.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:19.666 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:44:19.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:44:19.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:19.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:20.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:21.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:21.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:21.184 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:44:21.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:44:21.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:21.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:21.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:22.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:22.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:22.639 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:44:22.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:44:22.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:22.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:23.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:24.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:24.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:24.221 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:44:24.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:44:24.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:24.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:24.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:25.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:25.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:25.961 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:44:25.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:44:25.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:25.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:26.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:27.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:27.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:27.397 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:44:27.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:44:27.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:27.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:28.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:29.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:29.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:29.135 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:44:29.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:44:29.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:29.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:29.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:30.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:30.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:30.912 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:44:30.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:44:30.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:30.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:31.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:32.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:32.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:32.634 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:44:32.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:44:32.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:32.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:33.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:34.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:34.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:34.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:44:34.554 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:44:34.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:34.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:44:35.007 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/275403075,v1:127.0.0.1:6819/275403075] [v2:127.0.0.1:6820/275403075,v1:127.0.0.1:6821/275403075] exists,up 743aeb06-4b0c-4054-b230-6c65841c4daf 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 3 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/3 2024-05-08T18:44:35.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:44:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:44:35.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:44:35.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:44:35.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/3 2024-05-08T18:44:35.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:44:35.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=353d866c-0402-4e70-8274-7a1d2475a9bf 2024-05-08T18:44:35.015 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 353d866c-0402-4e70-8274-7a1d2475a9bf 2024-05-08T18:44:35.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 353d866c-0402-4e70-8274-7a1d2475a9bf' 2024-05-08T18:44:35.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:44:35.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQATyDtmvUZgAhAARVRknF8eySRY9zwFliGCqQ== 2024-05-08T18:44:35.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQATyDtmvUZgAhAARVRknF8eySRY9zwFliGCqQ=="}' 2024-05-08T18:44:35.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 353d866c-0402-4e70-8274-7a1d2475a9bf -i td/osd-backfill-space/3/new.json 2024-05-08T18:44:35.631 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:44:35.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/3/new.json 2024-05-08T18:44:35.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQATyDtmvUZgAhAARVRknF8eySRY9zwFliGCqQ== --osd-uuid 353d866c-0402-4e70-8274-7a1d2475a9bf 2024-05-08T18:44:35.690 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:35.690+0000 7fa7e875c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:35.697 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:35.698+0000 7fa7e875c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:35.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:35.698+0000 7fa7e875c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:35.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:35.698+0000 7fa7e875c7c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:44:35.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:35.698+0000 7fa7e875c7c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:44:35.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:35.698+0000 7fa7e875c7c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:44:35.737 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:35.738+0000 7fa7e875c7c0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-05-08T18:44:41.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-05-08T18:44:41.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:44:41.607 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T18:44:41.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T18:44:41.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:44:42.198 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T18:44:42.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T18:44:42.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:44:42.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:44:42.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:44:42.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:44:42.238 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:42.238+0000 7fd2ebfea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:42.244 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:42.242+0000 7fd2ebfea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:42.245 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:42.246+0000 7fd2ebfea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:44:42.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T18:44:42.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:44:42.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T18:44:42.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:44:42.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:44:42.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:42.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:44:42.641 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:44:42.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:42.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:42.826 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:42.826+0000 7fd2ebfea7c0 -1 Falling back to public interface 2024-05-08T18:44:43.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:44.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:44.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:44.058 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:44:44.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:44:44.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:44.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:44.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:45.350 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:44:45.350+0000 7fd2ebfea7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T18:44:45.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:45.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:45.511 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:44:45.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:44:45.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:45.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:46.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:47.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:47.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:47.045 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:44:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:44:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:47.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:47.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:48.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:48.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:48.481 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:44:48.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:44:48.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:48.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:49.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:50.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:50.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:50.091 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:44:50.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:44:50.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:50.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:50.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:51.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:51.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:51.698 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:44:51.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:44:51.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:51.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:52.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:53.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:53.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:53.114 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:44:53.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:44:53.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:53.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:53.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:54.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:54.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:54.575 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:44:54.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:44:54.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:54.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:55.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:56.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:56.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:56.114 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:44:56.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:44:56.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:56.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:56.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:57.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:57.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:57.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:44:57.701 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:44:57.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:57.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:58.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:44:59.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:44:59.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:44:59.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:44:59.313 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:44:59.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:44:59.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:44:59.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:00.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:00.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:00.830 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:45:00.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:45:00.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:00.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:45:01.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:02.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:02.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:02.585 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:45:02.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:45:02.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:02.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:45:03.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:04.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:04.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:04.602 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:45:04.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:45:04.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:04.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:45:05.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:06.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:06.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:06.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:45:06.613 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:45:06.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:06.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:45:07.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:08.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:08.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:08.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:45:08.754 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:45:08.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:08.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:45:09.176 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3918086575,v1:127.0.0.1:6827/3918086575] [v2:127.0.0.1:6828/3918086575,v1:127.0.0.1:6829/3918086575] exists,up 353d866c-0402-4e70-8274-7a1d2475a9bf 2024-05-08T18:45:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:45:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:45:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:45:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:45:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 4 2024-05-08T18:45:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:45:09.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/4 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:45:09.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:45:09.180 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:45:09.180 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:45:09.180 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:45:09.180 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:45:09.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:45:09.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:45:09.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:45:09.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:45:09.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:45:09.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:45:09.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/4 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:45:09.182 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 8af12f75-9b54-47f3-a931-ce57897cca21 2024-05-08T18:45:09.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8af12f75-9b54-47f3-a931-ce57897cca21 2024-05-08T18:45:09.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 8af12f75-9b54-47f3-a931-ce57897cca21' 2024-05-08T18:45:09.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:45:09.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA1yDtmcl2yDBAAfpFSPN5e+VCxGFWEG/CIiA== 2024-05-08T18:45:09.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA1yDtmcl2yDBAAfpFSPN5e+VCxGFWEG/CIiA=="}' 2024-05-08T18:45:09.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8af12f75-9b54-47f3-a931-ce57897cca21 -i td/osd-backfill-space/4/new.json 2024-05-08T18:45:09.818 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:45:09.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/4/new.json 2024-05-08T18:45:09.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA1yDtmcl2yDBAAfpFSPN5e+VCxGFWEG/CIiA== --osd-uuid 8af12f75-9b54-47f3-a931-ce57897cca21 2024-05-08T18:45:09.866 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:09.870+0000 7f42aa3677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:09.882 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:09.886+0000 7f42aa3677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:09.883 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:09.886+0000 7f42aa3677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:09.883 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:09.886+0000 7f42aa3677c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:45:09.883 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:09.886+0000 7f42aa3677c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:45:09.883 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:09.886+0000 7f42aa3677c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:45:09.981 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:09.986+0000 7f42aa3677c0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-05-08T18:45:16.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-05-08T18:45:16.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:45:16.024 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T18:45:16.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T18:45:16.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:45:16.602 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T18:45:16.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T18:45:16.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:45:16.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:45:16.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:45:16.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:45:16.642 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:16.645+0000 7f445c41b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:16.643 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:16.645+0000 7f445c41b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:16.644 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:16.649+0000 7f445c41b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:17.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T18:45:17.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:45:17.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T18:45:17.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:45:17.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:45:17.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:17.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:45:17.034 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:45:17.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:17.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:17.215 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:17.217+0000 7f445c41b7c0 -1 Falling back to public interface 2024-05-08T18:45:17.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:18.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:18.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:18.450 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:45:18.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:45:18.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:18.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:18.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:19.764 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:19.765+0000 7f445c41b7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T18:45:19.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:19.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:19.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:45:19.883 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:45:19.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:19.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:20.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:21.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:21.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:21.468 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:45:21.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:45:21.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:21.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:21.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:22.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:22.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:22.909 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:45:22.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:45:22.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:22.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:23.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:24.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:24.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:24.340 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:45:24.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:45:24.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:24.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:24.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:25.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:25.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:25.977 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:45:25.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:45:25.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:25.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:26.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:27.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:27.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:27.405 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:45:27.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:45:27.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:27.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:27.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:28.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:28.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:28.849 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:45:28.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:45:28.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:28.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:29.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:30.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:30.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:30.313 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:45:30.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:45:30.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:30.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:31.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:32.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:32.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:32.006 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:45:32.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:45:32.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:32.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:32.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:33.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:33.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:33.686 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:45:33.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:45:33.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:33.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:34.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:35.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:35.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:35.329 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:45:35.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:45:35.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:35.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:36.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:37.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:37.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:37.092 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:45:37.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:45:37.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:37.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:37.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:38.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:38.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:38.756 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:45:38.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:45:38.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:38.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:39.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:40.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:40.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:40.768 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:45:40.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:45:40.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:40.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:41.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:42.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:42.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:42.576 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:45:42.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:45:42.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:42.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:45:43.087 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/4082364324,v1:127.0.0.1:6835/4082364324] [v2:127.0.0.1:6836/4082364324,v1:127.0.0.1:6837/4082364324] exists,up 8af12f75-9b54-47f3-a931-ce57897cca21 2024-05-08T18:45:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:45:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:45:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:45:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:45:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 5 2024-05-08T18:45:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:45:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/5 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:45:43.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:45:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:45:43.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:45:43.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:45:43.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:45:43.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:45:43.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/5 2024-05-08T18:45:43.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:45:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e54dea94-1043-499f-919b-77030b78933f 2024-05-08T18:45:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 e54dea94-1043-499f-919b-77030b78933f' 2024-05-08T18:45:43.094 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 e54dea94-1043-499f-919b-77030b78933f 2024-05-08T18:45:43.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:45:43.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBXyDtmfhInBxAAVH/rHyueEB2jOOmR1aC0RQ== 2024-05-08T18:45:43.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBXyDtmfhInBxAAVH/rHyueEB2jOOmR1aC0RQ=="}' 2024-05-08T18:45:43.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e54dea94-1043-499f-919b-77030b78933f -i td/osd-backfill-space/5/new.json 2024-05-08T18:45:43.690 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:45:43.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/5/new.json 2024-05-08T18:45:43.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBXyDtmfhInBxAAVH/rHyueEB2jOOmR1aC0RQ== --osd-uuid e54dea94-1043-499f-919b-77030b78933f 2024-05-08T18:45:43.748 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:43.749+0000 7f4475a557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:43.791 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:43.793+0000 7f4475a557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:43.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:43.793+0000 7f4475a557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:43.793 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:43.793+0000 7f4475a557c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:45:43.793 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:43.793+0000 7f4475a557c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:45:43.793 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:43.793+0000 7f4475a557c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:45:43.830 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:43.833+0000 7f4475a557c0 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2024-05-08T18:45:49.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2024-05-08T18:45:49.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:45:49.914 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T18:45:49.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T18:45:49.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:45:50.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T18:45:50.490 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T18:45:50.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:45:50.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:45:50.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:45:50.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:45:50.528 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:50.529+0000 7ffacc0b57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:50.555 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:50.557+0000 7ffacc0b57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:50.556 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:50.557+0000 7ffacc0b57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:45:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T18:45:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:45:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T18:45:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:45:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:45:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:45:50.927 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:45:50.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:45:50.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:51.118 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:51.121+0000 7ffacc0b57c0 -1 Falling back to public interface 2024-05-08T18:45:51.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:52.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:52.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:52.354 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:45:52.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:45:52.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:52.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:45:52.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:53.656 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:45:53.657+0000 7ffacc0b57c0 -1 osd.5 0 log_to_monitors true 2024-05-08T18:45:53.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:53.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:53.787 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:45:53.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:45:53.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:53.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:45:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:55.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:55.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:55.358 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:45:55.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:45:55.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:55.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:45:55.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:56.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:56.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:56.795 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:45:56.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:45:56.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:56.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:45:57.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:58.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:58.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:58.275 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:45:58.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:45:58.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:58.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:45:58.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:45:59.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:45:59.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:45:59.792 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:45:59.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:45:59.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:45:59.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:00.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:01.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:01.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:01.361 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:46:01.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:46:01.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:01.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:01.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:02.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:02.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:02.797 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:46:02.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:46:02.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:02.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:03.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:04.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:04.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:04.219 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:46:04.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:46:04.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:04.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:04.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:05.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:05.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:05.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:46:05.834 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:46:05.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:05.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:06.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:07.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:07.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:07.330 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:46:07.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:46:07.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:07.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:08.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:09.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:09.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:09.552 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:46:09.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:46:09.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:09.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:10.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:11.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:11.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:11.328 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:46:11.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:46:11.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:11.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:12.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:13.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:13.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:13.052 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:46:13.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:46:13.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:13.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:14.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:14.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:14.773 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:46:14.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:46:14.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:14.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:15.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:46:16.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:46:16.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:46:16.643 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:46:16.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:46:16.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:46:16.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:46:17.215 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2407052194,v1:127.0.0.1:6843/2407052194] [v2:127.0.0.1:6844/2407052194,v1:127.0.0.1:6845/2407052194] exists,up e54dea94-1043-499f-919b-77030b78933f 2024-05-08T18:46:17.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:46:17.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:46:17.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:46:17.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1126: TEST_ec_backfill_grow: ceph osd set-backfillfull-ratio .85 2024-05-08T18:46:17.864 INFO:tasks.workunit.client.0.smithi117.stderr:osd set-backfillfull-ratio 0.85 2024-05-08T18:46:17.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1128: TEST_ec_backfill_grow: ceph osd set-require-min-compat-client luminous 2024-05-08T18:46:18.685 INFO:tasks.workunit.client.0.smithi117.stderr:set require_min_compat_client to luminous 2024-05-08T18:46:18.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1129: TEST_ec_backfill_grow: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2024-05-08T18:46:19.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1130: TEST_ec_backfill_grow: ceph osd pool create test 1 1 erasure ec-profile 2024-05-08T18:46:20.271 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T18:46:20.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1132: TEST_ec_backfill_grow: wait_for_clean 2024-05-08T18:46:20.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T18:46:20.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T18:46:20.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T18:46:20.290 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T18:46:20.291 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:46:20.291 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:46:20.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:46:20.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:46:20.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:46:20.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T18:46:20.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T18:46:20.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T18:46:20.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T18:46:20.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:46:20.404 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:46:20.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:46:20.865 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:46:20.866 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:46:20.866 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:46:20.866 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T18:46:20.866 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T18:46:20.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:46:20.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:46:20.866 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:46:21.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836522 2024-05-08T18:46:21.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836522 2024-05-08T18:46:21.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836522' 2024-05-08T18:46:21.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:46:21.087 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:46:21.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672997 2024-05-08T18:46:21.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672997 2024-05-08T18:46:21.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836522 1-42949672997' 2024-05-08T18:46:21.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:46:21.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:46:21.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509466 2024-05-08T18:46:21.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509466 2024-05-08T18:46:21.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836522 1-42949672997 2-64424509466' 2024-05-08T18:46:21.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:46:21.492 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:46:21.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345939 2024-05-08T18:46:21.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345939 2024-05-08T18:46:21.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836522 1-42949672997 2-64424509466 3-85899345939' 2024-05-08T18:46:21.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:46:21.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:46:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182414 2024-05-08T18:46:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182414 2024-05-08T18:46:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836522 1-42949672997 2-64424509466 3-85899345939 4-107374182414' 2024-05-08T18:46:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:46:21.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T18:46:21.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018888 2024-05-08T18:46:21.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018888 2024-05-08T18:46:21.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836522 1-42949672997 2-64424509466 3-85899345939 4-107374182414 5-128849018888' 2024-05-08T18:46:21.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:46:21.989 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836522 2024-05-08T18:46:21.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:46:21.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:46:21.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836522 2024-05-08T18:46:21.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:46:21.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836522 2024-05-08T18:46:21.992 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836522 2024-05-08T18:46:21.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836522' 2024-05-08T18:46:21.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:46:22.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836523 -lt 21474836522 2024-05-08T18:46:22.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:46:22.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672997 2024-05-08T18:46:22.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:46:22.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:46:22.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672997 2024-05-08T18:46:22.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:46:22.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672997 2024-05-08T18:46:22.448 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672997 2024-05-08T18:46:22.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672997' 2024-05-08T18:46:22.449 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:46:22.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672997 -lt 42949672997 2024-05-08T18:46:22.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:46:22.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509466 2024-05-08T18:46:22.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:46:22.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:46:22.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509466 2024-05-08T18:46:22.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:46:22.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509466 2024-05-08T18:46:22.849 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509466 2024-05-08T18:46:22.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509466' 2024-05-08T18:46:22.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:46:23.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509466 -lt 64424509466 2024-05-08T18:46:23.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:46:23.253 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:46:23.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345939 2024-05-08T18:46:23.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:46:23.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345939 2024-05-08T18:46:23.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:46:23.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345939 2024-05-08T18:46:23.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345939' 2024-05-08T18:46:23.257 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345939 2024-05-08T18:46:23.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:46:23.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345939 -lt 85899345939 2024-05-08T18:46:23.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:46:23.733 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182414 2024-05-08T18:46:23.733 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:46:23.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:46:23.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182414 2024-05-08T18:46:23.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:46:23.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182414 2024-05-08T18:46:23.737 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182414 2024-05-08T18:46:23.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182414' 2024-05-08T18:46:23.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:46:24.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182415 -lt 107374182414 2024-05-08T18:46:24.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:46:24.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:46:24.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018888 2024-05-08T18:46:24.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T18:46:24.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018888 2024-05-08T18:46:24.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:46:24.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018888 2024-05-08T18:46:24.204 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018888 2024-05-08T18:46:24.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018888' 2024-05-08T18:46:24.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T18:46:24.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018889 -lt 128849018888 2024-05-08T18:46:24.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T18:46:24.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:46:24.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:46:25.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T18:46:25.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:46:25.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:46:25.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:46:25.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:46:25.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:46:25.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:46:25.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:46:25.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:46:25.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:46:25.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:46:25.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:46:26.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:46:26.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T18:46:26.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T18:46:26.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T18:46:26.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:46:26.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T18:46:26.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:46:26.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:46:26.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:46:26.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:46:26.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:46:26.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:46:26.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:46:26.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:46:26.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:46:26.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:46:26.659 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:46:26.659 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:46:27.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:46:27.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T18:46:27.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T18:46:27.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T18:46:27.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T18:46:27.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T18:46:27.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T18:46:27.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T18:46:27.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T18:46:27.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T18:46:27.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T18:46:27.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 1 >= 13 )) 2024-05-08T18:46:27.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:46:27.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.2 2024-05-08T18:46:27.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:46:27.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:46:27.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:46:27.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:46:27.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:46:27.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:46:27.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:46:27.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:46:28.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T18:46:28.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:46:28.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:46:28.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:46:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T18:46:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T18:46:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T18:46:28.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/12kdata bs=1k count=12 2024-05-08T18:46:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:12+0 records in 2024-05-08T18:46:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:12+0 records out 2024-05-08T18:46:28.884 INFO:tasks.workunit.client.0.smithi117.stderr:12288 bytes (12 kB, 12 KiB) copied, 0.000362135 s, 33.9 MB/s 2024-05-08T18:46:28.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: seq 1 200 2024-05-08T18:46:28.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:28.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj1 td/osd-backfill-space/12kdata 2024-05-08T18:46:29.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:29.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj2 td/osd-backfill-space/12kdata 2024-05-08T18:46:29.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:29.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj3 td/osd-backfill-space/12kdata 2024-05-08T18:46:29.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:29.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj4 td/osd-backfill-space/12kdata 2024-05-08T18:46:30.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:30.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj5 td/osd-backfill-space/12kdata 2024-05-08T18:46:30.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:30.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj6 td/osd-backfill-space/12kdata 2024-05-08T18:46:30.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:30.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj7 td/osd-backfill-space/12kdata 2024-05-08T18:46:30.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:31.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj8 td/osd-backfill-space/12kdata 2024-05-08T18:46:31.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:31.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj9 td/osd-backfill-space/12kdata 2024-05-08T18:46:31.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:31.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj10 td/osd-backfill-space/12kdata 2024-05-08T18:46:31.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:31.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj11 td/osd-backfill-space/12kdata 2024-05-08T18:46:31.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:31.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj12 td/osd-backfill-space/12kdata 2024-05-08T18:46:32.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:32.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj13 td/osd-backfill-space/12kdata 2024-05-08T18:46:32.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:32.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj14 td/osd-backfill-space/12kdata 2024-05-08T18:46:32.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:32.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj15 td/osd-backfill-space/12kdata 2024-05-08T18:46:33.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:33.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj16 td/osd-backfill-space/12kdata 2024-05-08T18:46:33.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:33.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj17 td/osd-backfill-space/12kdata 2024-05-08T18:46:33.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:33.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj18 td/osd-backfill-space/12kdata 2024-05-08T18:46:34.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:34.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj19 td/osd-backfill-space/12kdata 2024-05-08T18:46:34.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:34.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj20 td/osd-backfill-space/12kdata 2024-05-08T18:46:34.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:34.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj21 td/osd-backfill-space/12kdata 2024-05-08T18:46:34.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:34.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj22 td/osd-backfill-space/12kdata 2024-05-08T18:46:35.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:35.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj23 td/osd-backfill-space/12kdata 2024-05-08T18:46:35.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:35.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj24 td/osd-backfill-space/12kdata 2024-05-08T18:46:35.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:35.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj25 td/osd-backfill-space/12kdata 2024-05-08T18:46:35.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:35.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj26 td/osd-backfill-space/12kdata 2024-05-08T18:46:36.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:36.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj27 td/osd-backfill-space/12kdata 2024-05-08T18:46:36.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:36.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj28 td/osd-backfill-space/12kdata 2024-05-08T18:46:36.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:36.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj29 td/osd-backfill-space/12kdata 2024-05-08T18:46:37.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:37.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj30 td/osd-backfill-space/12kdata 2024-05-08T18:46:37.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:37.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj31 td/osd-backfill-space/12kdata 2024-05-08T18:46:37.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:37.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj32 td/osd-backfill-space/12kdata 2024-05-08T18:46:37.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:37.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj33 td/osd-backfill-space/12kdata 2024-05-08T18:46:38.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:38.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj34 td/osd-backfill-space/12kdata 2024-05-08T18:46:38.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:38.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj35 td/osd-backfill-space/12kdata 2024-05-08T18:46:38.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:38.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj36 td/osd-backfill-space/12kdata 2024-05-08T18:46:39.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:39.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj37 td/osd-backfill-space/12kdata 2024-05-08T18:46:39.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:39.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj38 td/osd-backfill-space/12kdata 2024-05-08T18:46:39.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:39.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj39 td/osd-backfill-space/12kdata 2024-05-08T18:46:39.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:39.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj40 td/osd-backfill-space/12kdata 2024-05-08T18:46:40.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:40.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj41 td/osd-backfill-space/12kdata 2024-05-08T18:46:40.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:40.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj42 td/osd-backfill-space/12kdata 2024-05-08T18:46:40.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:40.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj43 td/osd-backfill-space/12kdata 2024-05-08T18:46:40.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:40.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj44 td/osd-backfill-space/12kdata 2024-05-08T18:46:41.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:41.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj45 td/osd-backfill-space/12kdata 2024-05-08T18:46:41.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:41.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj46 td/osd-backfill-space/12kdata 2024-05-08T18:46:41.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:41.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj47 td/osd-backfill-space/12kdata 2024-05-08T18:46:42.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:42.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj48 td/osd-backfill-space/12kdata 2024-05-08T18:46:42.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:42.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj49 td/osd-backfill-space/12kdata 2024-05-08T18:46:42.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:42.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj50 td/osd-backfill-space/12kdata 2024-05-08T18:46:42.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:42.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj51 td/osd-backfill-space/12kdata 2024-05-08T18:46:43.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:43.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj52 td/osd-backfill-space/12kdata 2024-05-08T18:46:43.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:43.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj53 td/osd-backfill-space/12kdata 2024-05-08T18:46:43.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:43.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj54 td/osd-backfill-space/12kdata 2024-05-08T18:46:44.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:44.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj55 td/osd-backfill-space/12kdata 2024-05-08T18:46:44.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:44.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj56 td/osd-backfill-space/12kdata 2024-05-08T18:46:44.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:44.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj57 td/osd-backfill-space/12kdata 2024-05-08T18:46:44.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:44.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj58 td/osd-backfill-space/12kdata 2024-05-08T18:46:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:45.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj59 td/osd-backfill-space/12kdata 2024-05-08T18:46:45.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:45.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj60 td/osd-backfill-space/12kdata 2024-05-08T18:46:45.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:45.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj61 td/osd-backfill-space/12kdata 2024-05-08T18:46:46.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:46.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj62 td/osd-backfill-space/12kdata 2024-05-08T18:46:46.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:46.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj63 td/osd-backfill-space/12kdata 2024-05-08T18:46:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj64 td/osd-backfill-space/12kdata 2024-05-08T18:46:46.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:46.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj65 td/osd-backfill-space/12kdata 2024-05-08T18:46:47.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:47.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj66 td/osd-backfill-space/12kdata 2024-05-08T18:46:47.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:47.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj67 td/osd-backfill-space/12kdata 2024-05-08T18:46:47.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:47.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj68 td/osd-backfill-space/12kdata 2024-05-08T18:46:48.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:48.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj69 td/osd-backfill-space/12kdata 2024-05-08T18:46:48.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:48.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj70 td/osd-backfill-space/12kdata 2024-05-08T18:46:48.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:48.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj71 td/osd-backfill-space/12kdata 2024-05-08T18:46:48.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:48.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj72 td/osd-backfill-space/12kdata 2024-05-08T18:46:49.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:49.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj73 td/osd-backfill-space/12kdata 2024-05-08T18:46:49.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:49.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj74 td/osd-backfill-space/12kdata 2024-05-08T18:46:49.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:49.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj75 td/osd-backfill-space/12kdata 2024-05-08T18:46:50.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:50.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj76 td/osd-backfill-space/12kdata 2024-05-08T18:46:50.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:50.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj77 td/osd-backfill-space/12kdata 2024-05-08T18:46:50.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:50.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj78 td/osd-backfill-space/12kdata 2024-05-08T18:46:51.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:51.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj79 td/osd-backfill-space/12kdata 2024-05-08T18:46:51.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:51.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj80 td/osd-backfill-space/12kdata 2024-05-08T18:46:51.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:51.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj81 td/osd-backfill-space/12kdata 2024-05-08T18:46:51.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:51.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj82 td/osd-backfill-space/12kdata 2024-05-08T18:46:52.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:52.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj83 td/osd-backfill-space/12kdata 2024-05-08T18:46:52.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:52.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj84 td/osd-backfill-space/12kdata 2024-05-08T18:46:52.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:52.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj85 td/osd-backfill-space/12kdata 2024-05-08T18:46:53.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:53.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj86 td/osd-backfill-space/12kdata 2024-05-08T18:46:53.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:53.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj87 td/osd-backfill-space/12kdata 2024-05-08T18:46:53.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:53.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj88 td/osd-backfill-space/12kdata 2024-05-08T18:46:53.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:53.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj89 td/osd-backfill-space/12kdata 2024-05-08T18:46:54.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:54.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj90 td/osd-backfill-space/12kdata 2024-05-08T18:46:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj91 td/osd-backfill-space/12kdata 2024-05-08T18:46:54.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:54.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj92 td/osd-backfill-space/12kdata 2024-05-08T18:46:54.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:54.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj93 td/osd-backfill-space/12kdata 2024-05-08T18:46:55.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:55.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj94 td/osd-backfill-space/12kdata 2024-05-08T18:46:55.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:55.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj95 td/osd-backfill-space/12kdata 2024-05-08T18:46:55.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:55.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj96 td/osd-backfill-space/12kdata 2024-05-08T18:46:56.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:56.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj97 td/osd-backfill-space/12kdata 2024-05-08T18:46:56.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:56.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj98 td/osd-backfill-space/12kdata 2024-05-08T18:46:56.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:56.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj99 td/osd-backfill-space/12kdata 2024-05-08T18:46:56.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:56.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj100 td/osd-backfill-space/12kdata 2024-05-08T18:46:57.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:57.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj101 td/osd-backfill-space/12kdata 2024-05-08T18:46:57.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:57.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj102 td/osd-backfill-space/12kdata 2024-05-08T18:46:57.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:57.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj103 td/osd-backfill-space/12kdata 2024-05-08T18:46:58.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:58.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj104 td/osd-backfill-space/12kdata 2024-05-08T18:46:58.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:58.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj105 td/osd-backfill-space/12kdata 2024-05-08T18:46:58.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:58.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj106 td/osd-backfill-space/12kdata 2024-05-08T18:46:58.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:58.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj107 td/osd-backfill-space/12kdata 2024-05-08T18:46:59.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:59.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj108 td/osd-backfill-space/12kdata 2024-05-08T18:46:59.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:59.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj109 td/osd-backfill-space/12kdata 2024-05-08T18:46:59.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:59.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj110 td/osd-backfill-space/12kdata 2024-05-08T18:46:59.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:46:59.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj111 td/osd-backfill-space/12kdata 2024-05-08T18:47:00.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:00.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj112 td/osd-backfill-space/12kdata 2024-05-08T18:47:00.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:00.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj113 td/osd-backfill-space/12kdata 2024-05-08T18:47:01.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:01.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj114 td/osd-backfill-space/12kdata 2024-05-08T18:47:01.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:01.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj115 td/osd-backfill-space/12kdata 2024-05-08T18:47:01.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:01.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj116 td/osd-backfill-space/12kdata 2024-05-08T18:47:01.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:01.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj117 td/osd-backfill-space/12kdata 2024-05-08T18:47:02.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:02.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj118 td/osd-backfill-space/12kdata 2024-05-08T18:47:02.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:02.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj119 td/osd-backfill-space/12kdata 2024-05-08T18:47:02.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:02.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj120 td/osd-backfill-space/12kdata 2024-05-08T18:47:03.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:03.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj121 td/osd-backfill-space/12kdata 2024-05-08T18:47:03.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:03.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj122 td/osd-backfill-space/12kdata 2024-05-08T18:47:03.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:03.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj123 td/osd-backfill-space/12kdata 2024-05-08T18:47:03.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:03.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj124 td/osd-backfill-space/12kdata 2024-05-08T18:47:04.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:04.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj125 td/osd-backfill-space/12kdata 2024-05-08T18:47:04.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:04.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj126 td/osd-backfill-space/12kdata 2024-05-08T18:47:04.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:04.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj127 td/osd-backfill-space/12kdata 2024-05-08T18:47:05.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:05.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj128 td/osd-backfill-space/12kdata 2024-05-08T18:47:05.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:05.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj129 td/osd-backfill-space/12kdata 2024-05-08T18:47:05.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:05.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj130 td/osd-backfill-space/12kdata 2024-05-08T18:47:05.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:05.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj131 td/osd-backfill-space/12kdata 2024-05-08T18:47:06.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:06.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj132 td/osd-backfill-space/12kdata 2024-05-08T18:47:06.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:06.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj133 td/osd-backfill-space/12kdata 2024-05-08T18:47:06.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:06.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj134 td/osd-backfill-space/12kdata 2024-05-08T18:47:07.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:07.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj135 td/osd-backfill-space/12kdata 2024-05-08T18:47:07.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:07.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj136 td/osd-backfill-space/12kdata 2024-05-08T18:47:07.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:07.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj137 td/osd-backfill-space/12kdata 2024-05-08T18:47:07.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:07.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj138 td/osd-backfill-space/12kdata 2024-05-08T18:47:08.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:08.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj139 td/osd-backfill-space/12kdata 2024-05-08T18:47:08.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:08.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj140 td/osd-backfill-space/12kdata 2024-05-08T18:47:08.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:08.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj141 td/osd-backfill-space/12kdata 2024-05-08T18:47:09.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:09.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj142 td/osd-backfill-space/12kdata 2024-05-08T18:47:09.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:09.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj143 td/osd-backfill-space/12kdata 2024-05-08T18:47:09.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:09.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj144 td/osd-backfill-space/12kdata 2024-05-08T18:47:09.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:09.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj145 td/osd-backfill-space/12kdata 2024-05-08T18:47:10.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:10.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj146 td/osd-backfill-space/12kdata 2024-05-08T18:47:10.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:10.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj147 td/osd-backfill-space/12kdata 2024-05-08T18:47:10.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:10.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj148 td/osd-backfill-space/12kdata 2024-05-08T18:47:11.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:11.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj149 td/osd-backfill-space/12kdata 2024-05-08T18:47:11.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:11.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj150 td/osd-backfill-space/12kdata 2024-05-08T18:47:11.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:11.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj151 td/osd-backfill-space/12kdata 2024-05-08T18:47:11.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:11.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj152 td/osd-backfill-space/12kdata 2024-05-08T18:47:12.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:12.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj153 td/osd-backfill-space/12kdata 2024-05-08T18:47:12.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:12.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj154 td/osd-backfill-space/12kdata 2024-05-08T18:47:12.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:12.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj155 td/osd-backfill-space/12kdata 2024-05-08T18:47:13.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:13.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj156 td/osd-backfill-space/12kdata 2024-05-08T18:47:13.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:13.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj157 td/osd-backfill-space/12kdata 2024-05-08T18:47:13.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:13.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj158 td/osd-backfill-space/12kdata 2024-05-08T18:47:13.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:13.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj159 td/osd-backfill-space/12kdata 2024-05-08T18:47:14.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:14.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj160 td/osd-backfill-space/12kdata 2024-05-08T18:47:14.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:14.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj161 td/osd-backfill-space/12kdata 2024-05-08T18:47:14.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:14.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj162 td/osd-backfill-space/12kdata 2024-05-08T18:47:15.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:15.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj163 td/osd-backfill-space/12kdata 2024-05-08T18:47:15.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:15.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj164 td/osd-backfill-space/12kdata 2024-05-08T18:47:15.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:15.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj165 td/osd-backfill-space/12kdata 2024-05-08T18:47:15.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:15.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj166 td/osd-backfill-space/12kdata 2024-05-08T18:47:16.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:16.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj167 td/osd-backfill-space/12kdata 2024-05-08T18:47:16.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:16.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj168 td/osd-backfill-space/12kdata 2024-05-08T18:47:16.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:16.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj169 td/osd-backfill-space/12kdata 2024-05-08T18:47:17.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:17.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj170 td/osd-backfill-space/12kdata 2024-05-08T18:47:17.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:17.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj171 td/osd-backfill-space/12kdata 2024-05-08T18:47:17.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:17.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj172 td/osd-backfill-space/12kdata 2024-05-08T18:47:17.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:17.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj173 td/osd-backfill-space/12kdata 2024-05-08T18:47:18.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:18.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj174 td/osd-backfill-space/12kdata 2024-05-08T18:47:18.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:18.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj175 td/osd-backfill-space/12kdata 2024-05-08T18:47:18.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:18.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj176 td/osd-backfill-space/12kdata 2024-05-08T18:47:18.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:18.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj177 td/osd-backfill-space/12kdata 2024-05-08T18:47:19.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:19.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj178 td/osd-backfill-space/12kdata 2024-05-08T18:47:19.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:19.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj179 td/osd-backfill-space/12kdata 2024-05-08T18:47:19.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:19.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj180 td/osd-backfill-space/12kdata 2024-05-08T18:47:20.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:20.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj181 td/osd-backfill-space/12kdata 2024-05-08T18:47:20.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:20.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj182 td/osd-backfill-space/12kdata 2024-05-08T18:47:20.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:20.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj183 td/osd-backfill-space/12kdata 2024-05-08T18:47:20.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:20.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj184 td/osd-backfill-space/12kdata 2024-05-08T18:47:21.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:21.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj185 td/osd-backfill-space/12kdata 2024-05-08T18:47:21.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:21.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj186 td/osd-backfill-space/12kdata 2024-05-08T18:47:21.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:21.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj187 td/osd-backfill-space/12kdata 2024-05-08T18:47:21.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:21.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj188 td/osd-backfill-space/12kdata 2024-05-08T18:47:22.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:22.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj189 td/osd-backfill-space/12kdata 2024-05-08T18:47:22.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:22.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj190 td/osd-backfill-space/12kdata 2024-05-08T18:47:22.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:22.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj191 td/osd-backfill-space/12kdata 2024-05-08T18:47:23.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:23.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj192 td/osd-backfill-space/12kdata 2024-05-08T18:47:23.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:23.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj193 td/osd-backfill-space/12kdata 2024-05-08T18:47:23.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:23.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj194 td/osd-backfill-space/12kdata 2024-05-08T18:47:23.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:23.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj195 td/osd-backfill-space/12kdata 2024-05-08T18:47:24.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:24.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj196 td/osd-backfill-space/12kdata 2024-05-08T18:47:24.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:24.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj197 td/osd-backfill-space/12kdata 2024-05-08T18:47:24.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:24.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj198 td/osd-backfill-space/12kdata 2024-05-08T18:47:25.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:25.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj199 td/osd-backfill-space/12kdata 2024-05-08T18:47:25.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-05-08T18:47:25.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj200 td/osd-backfill-space/12kdata 2024-05-08T18:47:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1140: TEST_ec_backfill_grow: get_pg test obj1 2024-05-08T18:47:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T18:47:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T18:47:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T18:47:25.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T18:47:26.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1140: TEST_ec_backfill_grow: local PG=1.0 2024-05-08T18:47:26.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1142: TEST_ec_backfill_grow: get_primary test obj1 2024-05-08T18:47:26.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T18:47:26.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T18:47:26.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T18:47:26.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T18:47:26.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1142: TEST_ec_backfill_grow: local primary=1 2024-05-08T18:47:26.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1143: TEST_ec_backfill_grow: get_not_primary test obj1 2024-05-08T18:47:26.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T18:47:26.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T18:47:26.710 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T18:47:26.710 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T18:47:26.710 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T18:47:26.710 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T18:47:26.711 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T18:47:27.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T18:47:27.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T18:47:27.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T18:47:27.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1143: TEST_ec_backfill_grow: local otherosd=0 2024-05-08T18:47:27.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1145: TEST_ec_backfill_grow: ceph osd set noout 2024-05-08T18:47:28.276 INFO:tasks.workunit.client.0.smithi117.stderr:noout is set 2024-05-08T18:47:28.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1146: TEST_ec_backfill_grow: kill_daemons td/osd-backfill-space TERM 0 2024-05-08T18:47:28.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:47:28.300 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:47:28.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:47:28.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:47:28.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:47:28.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:47:28.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: expr 200 / 4 2024-05-08T18:47:28.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: rmobjects=50 2024-05-08T18:47:28.613 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: seq 1 50 2024-05-08T18:47:28.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:28.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj1 2024-05-08T18:47:29.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:29.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj2 2024-05-08T18:47:29.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:29.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj3 2024-05-08T18:47:29.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:29.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj4 2024-05-08T18:47:30.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:30.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj5 2024-05-08T18:47:30.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:30.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj6 2024-05-08T18:47:30.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:30.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj7 2024-05-08T18:47:30.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:30.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj8 2024-05-08T18:47:31.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:31.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj9 2024-05-08T18:47:31.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:31.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj10 2024-05-08T18:47:31.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:31.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj11 2024-05-08T18:47:31.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:31.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj12 2024-05-08T18:47:32.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:32.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj13 2024-05-08T18:47:32.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:32.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj14 2024-05-08T18:47:32.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:32.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj15 2024-05-08T18:47:32.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:32.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj16 2024-05-08T18:47:32.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:32.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj17 2024-05-08T18:47:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:33.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj18 2024-05-08T18:47:33.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:33.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj19 2024-05-08T18:47:33.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:33.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj20 2024-05-08T18:47:33.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:33.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj21 2024-05-08T18:47:34.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:34.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj22 2024-05-08T18:47:34.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:34.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj23 2024-05-08T18:47:34.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:34.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj24 2024-05-08T18:47:34.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:34.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj25 2024-05-08T18:47:34.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:34.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj26 2024-05-08T18:47:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:35.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj27 2024-05-08T18:47:35.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:35.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj28 2024-05-08T18:47:35.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:35.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj29 2024-05-08T18:47:35.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:35.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj30 2024-05-08T18:47:36.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:36.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj31 2024-05-08T18:47:36.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:36.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj32 2024-05-08T18:47:36.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:36.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj33 2024-05-08T18:47:36.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:36.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj34 2024-05-08T18:47:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj35 2024-05-08T18:47:37.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:37.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj36 2024-05-08T18:47:37.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:37.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj37 2024-05-08T18:47:37.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:37.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj38 2024-05-08T18:47:37.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:37.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj39 2024-05-08T18:47:38.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:38.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj40 2024-05-08T18:47:38.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:38.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj41 2024-05-08T18:47:38.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:38.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj42 2024-05-08T18:47:38.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:38.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj43 2024-05-08T18:47:39.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:39.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj44 2024-05-08T18:47:39.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:39.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj45 2024-05-08T18:47:39.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:39.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj46 2024-05-08T18:47:39.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:39.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj47 2024-05-08T18:47:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj48 2024-05-08T18:47:40.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:40.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj49 2024-05-08T18:47:40.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-05-08T18:47:40.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj50 2024-05-08T18:47:40.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/36kdata bs=1k count=36 2024-05-08T18:47:40.550 INFO:tasks.workunit.client.0.smithi117.stderr:36+0 records in 2024-05-08T18:47:40.550 INFO:tasks.workunit.client.0.smithi117.stderr:36+0 records out 2024-05-08T18:47:40.550 INFO:tasks.workunit.client.0.smithi117.stderr:36864 bytes (37 kB, 36 KiB) copied, 0.000379367 s, 97.2 MB/s 2024-05-08T18:47:40.551 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: expr 50 + 1 2024-05-08T18:47:40.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: seq 51 200 2024-05-08T18:47:40.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:40.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj51 td/osd-backfill-space/36kdata 2024-05-08T18:47:40.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:40.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj52 td/osd-backfill-space/36kdata 2024-05-08T18:47:41.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:41.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj53 td/osd-backfill-space/36kdata 2024-05-08T18:47:41.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:41.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj54 td/osd-backfill-space/36kdata 2024-05-08T18:47:41.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:41.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj55 td/osd-backfill-space/36kdata 2024-05-08T18:47:41.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:41.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj56 td/osd-backfill-space/36kdata 2024-05-08T18:47:41.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:41.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj57 td/osd-backfill-space/36kdata 2024-05-08T18:47:42.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:42.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj58 td/osd-backfill-space/36kdata 2024-05-08T18:47:42.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:42.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj59 td/osd-backfill-space/36kdata 2024-05-08T18:47:42.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:42.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj60 td/osd-backfill-space/36kdata 2024-05-08T18:47:42.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:42.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj61 td/osd-backfill-space/36kdata 2024-05-08T18:47:43.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:43.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj62 td/osd-backfill-space/36kdata 2024-05-08T18:47:43.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:43.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj63 td/osd-backfill-space/36kdata 2024-05-08T18:47:43.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:43.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj64 td/osd-backfill-space/36kdata 2024-05-08T18:47:43.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:43.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj65 td/osd-backfill-space/36kdata 2024-05-08T18:47:44.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:44.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj66 td/osd-backfill-space/36kdata 2024-05-08T18:47:44.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:44.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj67 td/osd-backfill-space/36kdata 2024-05-08T18:47:44.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:44.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj68 td/osd-backfill-space/36kdata 2024-05-08T18:47:44.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:44.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj69 td/osd-backfill-space/36kdata 2024-05-08T18:47:45.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:45.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj70 td/osd-backfill-space/36kdata 2024-05-08T18:47:45.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:45.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj71 td/osd-backfill-space/36kdata 2024-05-08T18:47:45.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:45.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj72 td/osd-backfill-space/36kdata 2024-05-08T18:47:45.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:45.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj73 td/osd-backfill-space/36kdata 2024-05-08T18:47:45.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:45.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj74 td/osd-backfill-space/36kdata 2024-05-08T18:47:46.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:46.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj75 td/osd-backfill-space/36kdata 2024-05-08T18:47:46.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:46.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj76 td/osd-backfill-space/36kdata 2024-05-08T18:47:46.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:46.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj77 td/osd-backfill-space/36kdata 2024-05-08T18:47:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:46.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj78 td/osd-backfill-space/36kdata 2024-05-08T18:47:47.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:47.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj79 td/osd-backfill-space/36kdata 2024-05-08T18:47:47.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:47.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj80 td/osd-backfill-space/36kdata 2024-05-08T18:47:47.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:47.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj81 td/osd-backfill-space/36kdata 2024-05-08T18:47:48.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:48.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj82 td/osd-backfill-space/36kdata 2024-05-08T18:47:48.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:48.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj83 td/osd-backfill-space/36kdata 2024-05-08T18:47:48.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:48.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj84 td/osd-backfill-space/36kdata 2024-05-08T18:47:48.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:48.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj85 td/osd-backfill-space/36kdata 2024-05-08T18:47:49.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:49.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj86 td/osd-backfill-space/36kdata 2024-05-08T18:47:49.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:49.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj87 td/osd-backfill-space/36kdata 2024-05-08T18:47:49.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:49.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj88 td/osd-backfill-space/36kdata 2024-05-08T18:47:49.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj89 td/osd-backfill-space/36kdata 2024-05-08T18:47:49.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:49.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj90 td/osd-backfill-space/36kdata 2024-05-08T18:47:50.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:50.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj91 td/osd-backfill-space/36kdata 2024-05-08T18:47:50.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:50.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj92 td/osd-backfill-space/36kdata 2024-05-08T18:47:50.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:50.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj93 td/osd-backfill-space/36kdata 2024-05-08T18:47:50.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:50.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj94 td/osd-backfill-space/36kdata 2024-05-08T18:47:51.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:51.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj95 td/osd-backfill-space/36kdata 2024-05-08T18:47:51.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:51.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj96 td/osd-backfill-space/36kdata 2024-05-08T18:47:51.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:51.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj97 td/osd-backfill-space/36kdata 2024-05-08T18:47:51.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:51.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj98 td/osd-backfill-space/36kdata 2024-05-08T18:47:52.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:52.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj99 td/osd-backfill-space/36kdata 2024-05-08T18:47:52.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:52.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj100 td/osd-backfill-space/36kdata 2024-05-08T18:47:52.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:52.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj101 td/osd-backfill-space/36kdata 2024-05-08T18:47:52.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:52.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj102 td/osd-backfill-space/36kdata 2024-05-08T18:47:53.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:53.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj103 td/osd-backfill-space/36kdata 2024-05-08T18:47:53.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:53.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj104 td/osd-backfill-space/36kdata 2024-05-08T18:47:53.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:53.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj105 td/osd-backfill-space/36kdata 2024-05-08T18:47:53.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:53.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj106 td/osd-backfill-space/36kdata 2024-05-08T18:47:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:54.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj107 td/osd-backfill-space/36kdata 2024-05-08T18:47:54.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj108 td/osd-backfill-space/36kdata 2024-05-08T18:47:54.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:54.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj109 td/osd-backfill-space/36kdata 2024-05-08T18:47:54.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:54.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj110 td/osd-backfill-space/36kdata 2024-05-08T18:47:55.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:55.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj111 td/osd-backfill-space/36kdata 2024-05-08T18:47:55.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:55.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj112 td/osd-backfill-space/36kdata 2024-05-08T18:47:55.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:55.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj113 td/osd-backfill-space/36kdata 2024-05-08T18:47:55.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:55.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj114 td/osd-backfill-space/36kdata 2024-05-08T18:47:56.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:56.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj115 td/osd-backfill-space/36kdata 2024-05-08T18:47:56.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:56.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj116 td/osd-backfill-space/36kdata 2024-05-08T18:47:56.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:56.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj117 td/osd-backfill-space/36kdata 2024-05-08T18:47:56.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:56.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj118 td/osd-backfill-space/36kdata 2024-05-08T18:47:57.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:57.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj119 td/osd-backfill-space/36kdata 2024-05-08T18:47:57.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:57.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj120 td/osd-backfill-space/36kdata 2024-05-08T18:47:57.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:57.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj121 td/osd-backfill-space/36kdata 2024-05-08T18:47:57.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:57.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj122 td/osd-backfill-space/36kdata 2024-05-08T18:47:58.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:58.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj123 td/osd-backfill-space/36kdata 2024-05-08T18:47:58.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:58.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj124 td/osd-backfill-space/36kdata 2024-05-08T18:47:58.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:58.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj125 td/osd-backfill-space/36kdata 2024-05-08T18:47:58.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:58.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj126 td/osd-backfill-space/36kdata 2024-05-08T18:47:59.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:59.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj127 td/osd-backfill-space/36kdata 2024-05-08T18:47:59.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:59.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj128 td/osd-backfill-space/36kdata 2024-05-08T18:47:59.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:59.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj129 td/osd-backfill-space/36kdata 2024-05-08T18:47:59.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:59.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj130 td/osd-backfill-space/36kdata 2024-05-08T18:47:59.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:47:59.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj131 td/osd-backfill-space/36kdata 2024-05-08T18:48:00.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:00.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj132 td/osd-backfill-space/36kdata 2024-05-08T18:48:00.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:00.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj133 td/osd-backfill-space/36kdata 2024-05-08T18:48:00.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:00.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj134 td/osd-backfill-space/36kdata 2024-05-08T18:48:00.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:00.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj135 td/osd-backfill-space/36kdata 2024-05-08T18:48:01.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:01.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj136 td/osd-backfill-space/36kdata 2024-05-08T18:48:01.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:01.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj137 td/osd-backfill-space/36kdata 2024-05-08T18:48:01.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:01.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj138 td/osd-backfill-space/36kdata 2024-05-08T18:48:01.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:01.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj139 td/osd-backfill-space/36kdata 2024-05-08T18:48:01.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:01.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj140 td/osd-backfill-space/36kdata 2024-05-08T18:48:02.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:02.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj141 td/osd-backfill-space/36kdata 2024-05-08T18:48:02.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:02.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj142 td/osd-backfill-space/36kdata 2024-05-08T18:48:02.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:02.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj143 td/osd-backfill-space/36kdata 2024-05-08T18:48:02.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:02.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj144 td/osd-backfill-space/36kdata 2024-05-08T18:48:02.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:02.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj145 td/osd-backfill-space/36kdata 2024-05-08T18:48:03.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:03.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj146 td/osd-backfill-space/36kdata 2024-05-08T18:48:03.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:03.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj147 td/osd-backfill-space/36kdata 2024-05-08T18:48:03.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:03.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj148 td/osd-backfill-space/36kdata 2024-05-08T18:48:03.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:03.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj149 td/osd-backfill-space/36kdata 2024-05-08T18:48:03.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:03.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj150 td/osd-backfill-space/36kdata 2024-05-08T18:48:04.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:04.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj151 td/osd-backfill-space/36kdata 2024-05-08T18:48:04.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:04.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj152 td/osd-backfill-space/36kdata 2024-05-08T18:48:04.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:04.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj153 td/osd-backfill-space/36kdata 2024-05-08T18:48:04.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:04.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj154 td/osd-backfill-space/36kdata 2024-05-08T18:48:04.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:04.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj155 td/osd-backfill-space/36kdata 2024-05-08T18:48:04.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:04.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj156 td/osd-backfill-space/36kdata 2024-05-08T18:48:05.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:05.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj157 td/osd-backfill-space/36kdata 2024-05-08T18:48:05.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:05.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj158 td/osd-backfill-space/36kdata 2024-05-08T18:48:05.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:05.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj159 td/osd-backfill-space/36kdata 2024-05-08T18:48:05.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:05.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj160 td/osd-backfill-space/36kdata 2024-05-08T18:48:05.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:05.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj161 td/osd-backfill-space/36kdata 2024-05-08T18:48:06.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:06.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj162 td/osd-backfill-space/36kdata 2024-05-08T18:48:06.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:06.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj163 td/osd-backfill-space/36kdata 2024-05-08T18:48:06.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:06.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj164 td/osd-backfill-space/36kdata 2024-05-08T18:48:06.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:06.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj165 td/osd-backfill-space/36kdata 2024-05-08T18:48:06.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:06.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj166 td/osd-backfill-space/36kdata 2024-05-08T18:48:07.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:07.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj167 td/osd-backfill-space/36kdata 2024-05-08T18:48:07.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:07.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj168 td/osd-backfill-space/36kdata 2024-05-08T18:48:07.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:07.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj169 td/osd-backfill-space/36kdata 2024-05-08T18:48:07.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:07.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj170 td/osd-backfill-space/36kdata 2024-05-08T18:48:07.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:07.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj171 td/osd-backfill-space/36kdata 2024-05-08T18:48:08.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:08.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj172 td/osd-backfill-space/36kdata 2024-05-08T18:48:08.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:08.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj173 td/osd-backfill-space/36kdata 2024-05-08T18:48:08.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:08.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj174 td/osd-backfill-space/36kdata 2024-05-08T18:48:08.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:08.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj175 td/osd-backfill-space/36kdata 2024-05-08T18:48:08.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:08.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj176 td/osd-backfill-space/36kdata 2024-05-08T18:48:09.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:09.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj177 td/osd-backfill-space/36kdata 2024-05-08T18:48:09.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:09.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj178 td/osd-backfill-space/36kdata 2024-05-08T18:48:09.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:09.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj179 td/osd-backfill-space/36kdata 2024-05-08T18:48:09.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:09.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj180 td/osd-backfill-space/36kdata 2024-05-08T18:48:09.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:09.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj181 td/osd-backfill-space/36kdata 2024-05-08T18:48:09.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:09.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj182 td/osd-backfill-space/36kdata 2024-05-08T18:48:10.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:10.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj183 td/osd-backfill-space/36kdata 2024-05-08T18:48:10.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:10.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj184 td/osd-backfill-space/36kdata 2024-05-08T18:48:10.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:10.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj185 td/osd-backfill-space/36kdata 2024-05-08T18:48:10.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:10.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj186 td/osd-backfill-space/36kdata 2024-05-08T18:48:10.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:10.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj187 td/osd-backfill-space/36kdata 2024-05-08T18:48:11.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:11.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj188 td/osd-backfill-space/36kdata 2024-05-08T18:48:11.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:11.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj189 td/osd-backfill-space/36kdata 2024-05-08T18:48:11.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:11.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj190 td/osd-backfill-space/36kdata 2024-05-08T18:48:11.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:11.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj191 td/osd-backfill-space/36kdata 2024-05-08T18:48:11.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:11.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj192 td/osd-backfill-space/36kdata 2024-05-08T18:48:11.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:11.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj193 td/osd-backfill-space/36kdata 2024-05-08T18:48:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj194 td/osd-backfill-space/36kdata 2024-05-08T18:48:12.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:12.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj195 td/osd-backfill-space/36kdata 2024-05-08T18:48:12.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:12.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj196 td/osd-backfill-space/36kdata 2024-05-08T18:48:12.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:12.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj197 td/osd-backfill-space/36kdata 2024-05-08T18:48:12.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:12.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj198 td/osd-backfill-space/36kdata 2024-05-08T18:48:12.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:12.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj199 td/osd-backfill-space/36kdata 2024-05-08T18:48:12.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-05-08T18:48:12.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj200 td/osd-backfill-space/36kdata 2024-05-08T18:48:13.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1160: TEST_ec_backfill_grow: activate_osd td/osd-backfill-space 0 2024-05-08T18:48:13.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/osd-backfill-space 2024-05-08T18:48:13.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2024-05-08T18:48:13.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2024-05-08T18:48:13.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2024-05-08T18:48:13.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T18:48:13.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2024-05-08T18:48:13.024 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:48:13.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:48:13.025 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:48:13.025 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:13.025 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:13.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:48:13.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:48:13.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:48:13.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:48:13.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:48:13.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:48:13.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:48:13.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:48:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:48:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2024-05-08T18:48:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2024-05-08T18:48:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T18:48:13.027 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T18:48:13.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2024-05-08T18:48:13.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:48:13.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/osd-backfill-space/0/whoami 2024-05-08T18:48:13.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2024-05-08T18:48:13.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2024-05-08T18:48:13.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2024-05-08T18:48:13.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2024-05-08T18:48:13.066 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:13.069+0000 7f79c10247c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:13.068 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:13.069+0000 7f79c10247c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:13.070 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:13.073+0000 7f79c10247c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:13.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2024-05-08T18:48:13.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:48:13.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T18:48:13.466 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:48:13.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:48:13.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:48:13.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:48:13.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:48:13.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:48:13.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:48:13.647 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:13.649+0000 7f79c10247c0 -1 Falling back to public interface 2024-05-08T18:48:13.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:48:14.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:48:14.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:48:14.900 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:48:14.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:48:14.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:48:14.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:48:15.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:48:16.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:48:16.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:48:16.307 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:48:16.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:48:16.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:48:16.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:48:16.706 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:16.709+0000 7f79c10247c0 -1 osd.0 40 log_to_monitors true 2024-05-08T18:48:16.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:48:17.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:48:17.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:48:17.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:48:17.774 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:48:17.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:48:17.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:48:18.541 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 46 up_thru 0 down_at 43 last_clean_interval [5,40) [v2:127.0.0.1:6802/1539253142,v1:127.0.0.1:6803/1539253142] [v2:127.0.0.1:6804/1539253142,v1:127.0.0.1:6805/1539253142] exists,up 72472a31-4897-4220-8434-7a8b73bcb276 2024-05-08T18:48:18.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:48:18.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:48:18.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:48:18.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1162: TEST_ec_backfill_grow: ceph tell osd.1 debug kick_recovery_wq 0 2024-05-08T18:48:18.724 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T18:48:18.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1164: TEST_ec_backfill_grow: sleep 2 2024-05-08T18:48:20.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1166: TEST_ec_backfill_grow: wait_for_clean 2024-05-08T18:48:20.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T18:48:20.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T18:48:20.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T18:48:20.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T18:48:20.743 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:48:20.743 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:48:20.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:48:20.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:48:20.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:48:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T18:48:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T18:48:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T18:48:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T18:48:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:48:20.871 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:48:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:48:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:48:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:48:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:48:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T18:48:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T18:48:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:48:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:48:21.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:48:21.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=197568495619 2024-05-08T18:48:21.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 197568495619 2024-05-08T18:48:21.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-197568495619' 2024-05-08T18:48:21.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:48:21.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:48:21.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673023 2024-05-08T18:48:21.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673023 2024-05-08T18:48:21.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-197568495619 1-42949673023' 2024-05-08T18:48:21.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:48:21.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:48:21.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509492 2024-05-08T18:48:21.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509492 2024-05-08T18:48:21.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-197568495619 1-42949673023 2-64424509492' 2024-05-08T18:48:21.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:48:21.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:48:22.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345965 2024-05-08T18:48:22.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345965 2024-05-08T18:48:22.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-197568495619 1-42949673023 2-64424509492 3-85899345965' 2024-05-08T18:48:22.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:48:22.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:48:22.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182440 2024-05-08T18:48:22.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182440 2024-05-08T18:48:22.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-197568495619 1-42949673023 2-64424509492 3-85899345965 4-107374182440' 2024-05-08T18:48:22.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:48:22.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T18:48:22.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018915 2024-05-08T18:48:22.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018915 2024-05-08T18:48:22.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-197568495619 1-42949673023 2-64424509492 3-85899345965 4-107374182440 5-128849018915' 2024-05-08T18:48:22.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:48:22.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-197568495619 2024-05-08T18:48:22.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:48:22.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:48:22.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-197568495619 2024-05-08T18:48:22.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:48:22.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=197568495619 2024-05-08T18:48:22.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 197568495619' 2024-05-08T18:48:22.409 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 197568495619 2024-05-08T18:48:22.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:48:22.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 197568495619 -lt 197568495619 2024-05-08T18:48:22.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:48:22.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673023 2024-05-08T18:48:22.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:48:22.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:48:22.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673023 2024-05-08T18:48:22.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:48:22.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673023 2024-05-08T18:48:22.922 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673023 2024-05-08T18:48:22.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673023' 2024-05-08T18:48:22.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:48:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673023 -lt 42949673023 2024-05-08T18:48:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:48:23.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509492 2024-05-08T18:48:23.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:48:23.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:48:23.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509492 2024-05-08T18:48:23.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:48:23.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509492 2024-05-08T18:48:23.386 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509492 2024-05-08T18:48:23.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509492' 2024-05-08T18:48:23.387 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:48:23.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509491 -lt 64424509492 2024-05-08T18:48:23.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:48:24.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:48:24.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:48:25.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509492 -lt 64424509492 2024-05-08T18:48:25.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:48:25.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345965 2024-05-08T18:48:25.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:48:25.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:48:25.300 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345965 2024-05-08T18:48:25.300 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:48:25.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345965 2024-05-08T18:48:25.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345965' 2024-05-08T18:48:25.302 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345965 2024-05-08T18:48:25.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:48:25.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345966 -lt 85899345965 2024-05-08T18:48:25.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:48:25.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182440 2024-05-08T18:48:25.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:48:25.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:48:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182440 2024-05-08T18:48:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:48:25.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182440 2024-05-08T18:48:25.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182440' 2024-05-08T18:48:25.742 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182440 2024-05-08T18:48:25.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:48:26.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182441 -lt 107374182440 2024-05-08T18:48:26.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:48:26.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:48:26.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018915 2024-05-08T18:48:26.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T18:48:26.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018915 2024-05-08T18:48:26.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:48:26.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018915 2024-05-08T18:48:26.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018915' 2024-05-08T18:48:26.208 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018915 2024-05-08T18:48:26.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T18:48:26.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018915 -lt 128849018915 2024-05-08T18:48:26.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T18:48:26.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:26.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:27.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T18:48:27.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:48:27.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:48:27.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:48:27.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:48:27.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:48:27.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:48:27.335 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:48:27.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:48:27.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:48:27.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:27.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:28.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:48:28.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T18:48:28.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T18:48:28.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T18:48:28.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:48:28.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T18:48:28.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:48:28.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:48:28.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:48:28.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:48:28.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:48:28.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:48:28.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:48:28.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:48:28.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:48:28.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:48:28.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:28.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:29.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:48:29.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T18:48:29.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T18:48:29.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T18:48:29.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T18:48:29.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T18:48:29.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T18:48:29.489 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T18:48:29.489 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T18:48:30.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=249303 2024-05-08T18:48:30.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 249303 '!=' null 2024-05-08T18:48:30.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T18:48:30.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:48:30.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T18:48:30.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:48:30.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:48:30.180 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:48:30.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:48:30.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:48:30.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:48:30.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:48:30.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:48:30.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:48:30.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:48:30.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:30.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:31.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:48:31.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T18:48:31.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T18:48:31.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T18:48:31.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T18:48:31.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T18:48:31.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T18:48:31.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T18:48:31.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T18:48:31.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=249303 2024-05-08T18:48:31.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 249303 '!=' null 2024-05-08T18:48:31.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T18:48:31.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:48:31.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T18:48:31.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:48:31.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:48:31.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:48:31.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:48:31.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:48:31.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:48:31.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:48:31.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:48:32.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:48:32.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:48:32.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:32.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:33.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:48:33.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T18:48:33.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T18:48:33.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T18:48:33.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T18:48:33.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T18:48:33.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T18:48:33.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T18:48:33.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T18:48:33.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=405415 2024-05-08T18:48:33.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 405415 '!=' null 2024-05-08T18:48:33.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T18:48:33.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:48:33.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T18:48:34.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:48:34.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:48:34.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:48:34.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:48:34.079 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:48:34.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:48:34.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:48:34.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:48:34.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:48:34.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:48:34.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:34.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:35.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:48:35.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T18:48:35.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T18:48:35.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T18:48:35.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T18:48:35.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T18:48:35.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T18:48:35.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T18:48:35.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T18:48:35.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=469905 2024-05-08T18:48:35.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 469905 '!=' null 2024-05-08T18:48:35.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T18:48:35.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:48:35.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T18:48:35.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:48:35.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:48:35.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:48:35.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:48:35.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:48:35.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:48:35.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:48:35.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:48:36.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:48:36.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:48:36.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:36.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:36.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:48:36.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T18:48:36.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T18:48:36.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T18:48:36.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T18:48:36.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T18:48:36.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T18:48:36.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T18:48:36.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T18:48:37.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=253372 2024-05-08T18:48:37.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 253372 '!=' null 2024-05-08T18:48:37.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T18:48:37.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:48:37.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T18:48:37.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:48:37.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:48:37.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:48:37.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:48:37.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:48:37.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:48:37.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:48:37.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:48:37.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T18:48:37.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:48:37.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:37.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:38.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T18:48:38.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T18:48:38.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T18:48:38.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T18:48:38.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T18:48:38.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T18:48:38.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T18:48:38.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T18:48:38.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T18:48:38.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=336298 2024-05-08T18:48:38.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 336298 '!=' null 2024-05-08T18:48:38.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T18:48:38.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T18:48:38.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T18:48:38.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T18:48:38.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T18:48:38.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T18:48:38.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T18:48:38.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T18:48:38.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T18:48:38.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T18:48:38.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T18:48:39.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T18:48:39.180 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T18:48:39.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:48:39.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:48:39.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T18:48:39.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T18:48:39.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T18:48:39.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1168: TEST_ec_backfill_grow: delete_pool test 2024-05-08T18:48:39.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T18:48:39.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T18:48:40.385 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T18:48:40.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1169: TEST_ec_backfill_grow: kill_daemons td/osd-backfill-space 2024-05-08T18:48:40.406 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:48:40.406 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:48:40.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:48:40.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:48:40.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:48:45.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:48:45.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:48:45.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:48:45.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:48:45.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:48:45.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:48:45.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:48:45.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:48:45.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:48:45.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:48:45.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:48:45.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:48:45.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:48:45.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:48:45.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:48:45.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:48:45.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:48:45.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:45.801 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:45.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:48:45.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:48:45.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:48:45.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:48:45.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:48:45.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:48:45.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:48:45.804 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:48:45.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:48:45.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:48:45.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:48:45.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:48:45.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:48:45.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:48:45.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:48:45.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:48:45.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:48:45.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:48:45.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:48:45.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:48:45.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:48:45.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:45.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:45.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:48:45.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:48:45.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:48:45.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2024-05-08T18:48:45.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T18:48:45.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:45.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:45.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.109971 2024-05-08T18:48:45.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T18:48:45.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T18:48:45.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T18:48:45.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-05-08T18:48:45.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_ec_backfill_multi td/osd-backfill-space 2024-05-08T18:48:45.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:749: TEST_ec_backfill_multi: local dir=td/osd-backfill-space 2024-05-08T18:48:45.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:750: TEST_ec_backfill_multi: local EC= 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:751: TEST_ec_backfill_multi: local pools=2 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:752: TEST_ec_backfill_multi: local OSDS=6 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:753: TEST_ec_backfill_multi: local k=3 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:754: TEST_ec_backfill_multi: local m=2 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:755: TEST_ec_backfill_multi: expr 600 / 3 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:755: TEST_ec_backfill_multi: local ecobjects=200 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:757: TEST_ec_backfill_multi: run_mon td/osd-backfill-space a 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2024-05-08T18:48:45.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-05-08T18:48:46.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T18:48:46.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:48:46.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:48:46.188 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:48:46.188 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:46.188 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:46.188 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:48:46.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T18:48:46.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T18:48:46.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T18:48:46.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:48:46.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:48:46.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T18:48:46.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T18:48:46.400 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:48:46.400 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:48:46.401 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:48:46.401 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:48:46.401 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:46.402 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:46.402 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:48:46.402 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:48:46.402 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get fsid 2024-05-08T18:48:46.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T18:48:46.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:48:46.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:48:46.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T18:48:46.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T18:48:46.519 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:48:46.519 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:48:46.519 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:48:46.519 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:48:46.519 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:46.519 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:46.519 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:48:46.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:48:46.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get mon_host 2024-05-08T18:48:46.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:758: TEST_ec_backfill_multi: run_mgr td/osd-backfill-space x 2024-05-08T18:48:46.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-space 2024-05-08T18:48:46.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T18:48:46.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T18:48:46.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T18:48:46.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-space/x 2024-05-08T18:48:46.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T18:48:47.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T18:48:47.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:48:47.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:48:47.534 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:48:47.534 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:47.534 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:47.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:48:47.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:48:47.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:48:47.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:759: TEST_ec_backfill_multi: export CEPH_ARGS 2024-05-08T18:48:47.572 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: expr 6 - 1 2024-05-08T18:48:47.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: seq 0 5 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 0 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:48:47.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:48:47.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:48:47.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T18:48:47.580 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:48:47.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=a385df9b-fead-4795-b1b3-adc2c5c74e52 2024-05-08T18:48:47.580 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 a385df9b-fead-4795-b1b3-adc2c5c74e52 2024-05-08T18:48:47.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 a385df9b-fead-4795-b1b3-adc2c5c74e52' 2024-05-08T18:48:47.580 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:48:47.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAPyTtmDSkVJBAAUYrua1yLLtGFOM+kprLczA== 2024-05-08T18:48:47.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAPyTtmDSkVJBAAUYrua1yLLtGFOM+kprLczA=="}' 2024-05-08T18:48:47.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new a385df9b-fead-4795-b1b3-adc2c5c74e52 -i td/osd-backfill-space/0/new.json 2024-05-08T18:48:47.893 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:48:47.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/0/new.json 2024-05-08T18:48:47.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAPyTtmDSkVJBAAUYrua1yLLtGFOM+kprLczA== --osd-uuid a385df9b-fead-4795-b1b3-adc2c5c74e52 2024-05-08T18:48:47.946 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:47.949+0000 7fd8d089e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:47.961 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:47.961+0000 7fd8d089e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:47.962 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:47.965+0000 7fd8d089e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:47.963 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:47.965+0000 7fd8d089e7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:48:47.963 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:47.965+0000 7fd8d089e7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:48:47.963 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:47.965+0000 7fd8d089e7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:48:48.018 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:48.021+0000 7fd8d089e7c0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-05-08T18:48:53.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-05-08T18:48:53.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:48:53.966 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T18:48:53.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T18:48:53.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:48:54.592 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T18:48:54.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T18:48:54.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:48:54.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:48:54.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:48:54.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:48:54.633 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:54.632+0000 7fa7e1bc37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:54.652 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:54.652+0000 7fa7e1bc37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:54.653 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:54.652+0000 7fa7e1bc37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:48:55.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T18:48:55.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:48:55.030 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:48:55.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T18:48:55.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:48:55.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:48:55.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:48:55.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:48:55.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:48:55.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:48:55.227 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:55.228+0000 7fa7e1bc37c0 -1 Falling back to public interface 2024-05-08T18:48:55.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:48:56.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:48:56.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:48:56.467 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:48:56.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:48:56.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:48:56.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:48:56.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:48:57.742 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:48:57.744+0000 7fa7e1bc37c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:48:57.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:48:57.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:48:57.902 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:48:57.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:48:57.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:48:57.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:48:58.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:48:59.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:48:59.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:48:59.475 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:48:59.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:48:59.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:48:59.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:48:59.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:00.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:00.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:00.961 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:49:00.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:49:00.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:00.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:01.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:02.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:02.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:02.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:49:02.516 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:49:02.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:02.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:02.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:03.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:03.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:03.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:49:03.928 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:49:03.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:03.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:04.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:05.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:05.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:05.516 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:49:05.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:49:05.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:05.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:05.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:06.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:06.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:06.972 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:49:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:49:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:07.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:08.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:08.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:08.493 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:49:08.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:49:08.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:08.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:09.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:10.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:10.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:10.094 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:49:10.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:49:10.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:10.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:11.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:12.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:12.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:12.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:49:12.095 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:49:12.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:12.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:13.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:14.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:14.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:14.118 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:49:14.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:49:14.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:14.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:15.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:16.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:16.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:16.454 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:49:16.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:49:16.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:16.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:17.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:18.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:18.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:18.342 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:49:18.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:49:18.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:18.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:19.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:20.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:20.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:20.126 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:49:20.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:49:20.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:20.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:49:20.599 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3279630575,v1:127.0.0.1:6803/3279630575] [v2:127.0.0.1:6804/3279630575,v1:127.0.0.1:6805/3279630575] exists,up a385df9b-fead-4795-b1b3-adc2c5c74e52 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 1 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:49:20.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T18:49:20.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:49:20.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:49:20.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:49:20.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:49:20.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T18:49:20.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T18:49:20.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:49:20.606 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:49:20.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T18:49:20.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:49:20.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e40aeab4-8a73-4967-83aa-19db64018c9a 2024-05-08T18:49:20.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 e40aeab4-8a73-4967-83aa-19db64018c9a' 2024-05-08T18:49:20.609 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 e40aeab4-8a73-4967-83aa-19db64018c9a 2024-05-08T18:49:20.609 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:49:20.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAwyTtmPj3UJRAAkuF1RBmEI8EyBFgGmsoUAw== 2024-05-08T18:49:20.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAwyTtmPj3UJRAAkuF1RBmEI8EyBFgGmsoUAw=="}' 2024-05-08T18:49:20.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e40aeab4-8a73-4967-83aa-19db64018c9a -i td/osd-backfill-space/1/new.json 2024-05-08T18:49:21.126 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:49:21.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/1/new.json 2024-05-08T18:49:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAwyTtmPj3UJRAAkuF1RBmEI8EyBFgGmsoUAw== --osd-uuid e40aeab4-8a73-4967-83aa-19db64018c9a 2024-05-08T18:49:21.187 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:21.188+0000 7f4a1af457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:21.223 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:21.224+0000 7f4a1af457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:21.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:21.224+0000 7f4a1af457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:21.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:21.224+0000 7f4a1af457c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:49:21.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:21.224+0000 7f4a1af457c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:49:21.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:21.224+0000 7f4a1af457c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:49:21.306 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:21.308+0000 7f4a1af457c0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-05-08T18:49:26.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-05-08T18:49:26.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:49:26.894 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T18:49:26.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T18:49:26.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:49:27.467 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T18:49:27.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T18:49:27.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:49:27.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:49:27.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:49:27.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:49:27.507 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:27.508+0000 7f4e2d1517c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:27.511 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:27.512+0000 7f4e2d1517c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:27.512 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:27.512+0000 7f4e2d1517c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:27.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T18:49:27.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:49:27.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T18:49:27.924 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:49:27.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:49:27.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:49:27.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:27.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:49:27.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:27.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:28.075 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:28.076+0000 7f4e2d1517c0 -1 Falling back to public interface 2024-05-08T18:49:28.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:29.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:29.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:29.365 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:49:29.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:49:29.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:29.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:29.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:30.773 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:30.772+0000 7f4e2d1517c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:49:30.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:30.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:30.782 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:49:30.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:49:30.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:30.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:31.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:32.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:32.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:32.478 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:49:32.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:49:32.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:32.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:33.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:34.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:34.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:34.038 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:49:34.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:49:34.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:34.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:34.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:35.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:35.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:35.600 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:49:35.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:49:35.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:35.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:36.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:37.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:37.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:37.059 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:49:37.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:49:37.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:37.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:37.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:38.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:38.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:38.615 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:49:38.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:49:38.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:38.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:39.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:40.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:40.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:40.163 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:49:40.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:49:40.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:40.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:40.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:41.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:41.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:41.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:49:41.696 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:49:41.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:41.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:42.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:43.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:43.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:43.314 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:49:43.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:49:43.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:43.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:43.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:44.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:44.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:44.910 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:49:44.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:49:44.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:44.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:45.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:46.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:46.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:46.846 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:49:46.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:49:46.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:46.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:47.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:48.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:48.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:48.747 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:49:48.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:49:48.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:48.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:49.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:50.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:50.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:50.646 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:49:50.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:49:50.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:50.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:51.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:52.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:52.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:52.117 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:49:52.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:49:52.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:52.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:52.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:49:53.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:49:53.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:49:53.703 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:49:53.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:49:53.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:49:53.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:49:54.145 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1166079046,v1:127.0.0.1:6811/1166079046] [v2:127.0.0.1:6812/1166079046,v1:127.0.0.1:6813/1166079046] exists,up e40aeab4-8a73-4967-83aa-19db64018c9a 2024-05-08T18:49:54.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:49:54.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 2 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T18:49:54.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T18:49:54.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:49:54.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:49:54.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:49:54.149 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:49:54.149 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:49:54.149 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:49:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:49:54.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=093fe72f-0808-4313-a683-526f040e2c84 2024-05-08T18:49:54.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 093fe72f-0808-4313-a683-526f040e2c84' 2024-05-08T18:49:54.153 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 093fe72f-0808-4313-a683-526f040e2c84 2024-05-08T18:49:54.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:49:54.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBSyTtmpuztChAAmZRxPPjwrlRefJrWHblIsg== 2024-05-08T18:49:54.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBSyTtmpuztChAAmZRxPPjwrlRefJrWHblIsg=="}' 2024-05-08T18:49:54.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 093fe72f-0808-4313-a683-526f040e2c84 -i td/osd-backfill-space/2/new.json 2024-05-08T18:49:54.718 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:49:54.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/2/new.json 2024-05-08T18:49:54.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBSyTtmpuztChAAmZRxPPjwrlRefJrWHblIsg== --osd-uuid 093fe72f-0808-4313-a683-526f040e2c84 2024-05-08T18:49:54.777 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:54.775+0000 7fda6881f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:54.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:54.779+0000 7fda6881f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:54.780 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:54.779+0000 7fda6881f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:49:54.780 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:54.779+0000 7fda6881f7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:49:54.781 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:54.779+0000 7fda6881f7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:49:54.781 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:54.779+0000 7fda6881f7c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:49:54.870 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:49:54.871+0000 7fda6881f7c0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-05-08T18:50:00.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-05-08T18:50:00.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:50:00.392 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T18:50:00.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T18:50:00.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:50:00.947 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T18:50:00.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T18:50:00.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:50:00.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:50:00.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:50:00.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:50:00.985 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:00.983+0000 7fa84e7977c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:00.987 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:00.987+0000 7fa84e7977c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:00.988 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:00.987+0000 7fa84e7977c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:01.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T18:50:01.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:50:01.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T18:50:01.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:50:01.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:50:01.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:01.408 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:50:01.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:50:01.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:01.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:01.543 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:01.543+0000 7fa84e7977c0 -1 Falling back to public interface 2024-05-08T18:50:01.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:02.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:02.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:02.852 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:50:02.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:50:02.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:02.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:03.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:04.070 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:04.067+0000 7fa84e7977c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:50:04.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:04.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:04.268 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:50:04.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:50:04.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:04.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:04.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:05.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:05.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:05.829 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:50:05.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:50:05.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:05.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:06.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:07.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:07.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:07.260 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:50:07.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:50:07.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:07.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:07.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:08.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:08.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:08.872 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:50:08.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:50:08.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:08.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:09.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:10.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:10.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:10.309 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:50:10.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:50:10.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:10.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:10.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:11.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:11.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:11.830 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:50:11.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:50:11.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:11.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:12.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:13.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:13.268 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:50:13.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:13.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:50:13.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:13.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:13.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:14.842 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:50:14.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:50:14.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:14.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:15.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:16.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:16.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:16.491 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:50:16.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:50:16.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:16.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:17.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:18.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:18.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:18.607 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:50:18.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:50:18.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:18.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:19.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:20.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:20.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:20.623 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:50:20.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:50:20.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:20.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:21.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:22.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:22.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:22.438 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:50:22.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:50:22.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:22.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:23.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:24.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:24.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:24.157 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:50:24.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:50:24.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:24.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:24.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:25.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:25.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:25.592 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:50:25.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:50:25.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:25.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:26.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:27.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:27.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:27.089 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:50:27.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:50:27.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:27.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:50:27.534 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3826365695,v1:127.0.0.1:6819/3826365695] [v2:127.0.0.1:6820/3826365695,v1:127.0.0.1:6821/3826365695] exists,up 093fe72f-0808-4313-a683-526f040e2c84 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 3 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/3 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:50:27.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:50:27.538 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:50:27.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:50:27.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:50:27.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:50:27.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:50:27.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/3 2024-05-08T18:50:27.541 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:50:27.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8a048740-9748-4bf9-9d91-0fca50290465 2024-05-08T18:50:27.541 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 8a048740-9748-4bf9-9d91-0fca50290465 2024-05-08T18:50:27.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 8a048740-9748-4bf9-9d91-0fca50290465' 2024-05-08T18:50:27.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:50:27.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBzyTtm9ssOIhAAbyVJ4Im7hEENRWPPxhfy4w== 2024-05-08T18:50:27.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBzyTtm9ssOIhAAbyVJ4Im7hEENRWPPxhfy4w=="}' 2024-05-08T18:50:27.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8a048740-9748-4bf9-9d91-0fca50290465 -i td/osd-backfill-space/3/new.json 2024-05-08T18:50:28.037 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:50:28.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/3/new.json 2024-05-08T18:50:28.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBzyTtm9ssOIhAAbyVJ4Im7hEENRWPPxhfy4w== --osd-uuid 8a048740-9748-4bf9-9d91-0fca50290465 2024-05-08T18:50:28.087 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:28.086+0000 7f31c62177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:28.089 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:28.086+0000 7f31c62177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:28.090 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:28.090+0000 7f31c62177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:28.090 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:28.090+0000 7f31c62177c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:50:28.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:28.090+0000 7f31c62177c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:50:28.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:28.090+0000 7f31c62177c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:50:28.170 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:28.170+0000 7f31c62177c0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-05-08T18:50:34.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-05-08T18:50:34.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:50:34.236 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T18:50:34.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T18:50:34.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:50:34.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T18:50:34.784 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T18:50:34.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:50:34.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:50:34.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:50:34.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:50:34.823 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:34.822+0000 7fbd06b797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:34.825 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:34.822+0000 7fbd06b797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:34.826 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:34.826+0000 7fbd06b797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:50:35.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T18:50:35.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:50:35.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T18:50:35.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:50:35.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:50:35.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:35.206 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:50:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:50:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:35.392 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:35.390+0000 7fbd06b797c0 -1 Falling back to public interface 2024-05-08T18:50:35.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:36.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:36.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:36.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:50:36.606 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:50:36.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:36.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:37.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:37.874 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:50:37.874+0000 7fbd06b797c0 -1 osd.3 0 log_to_monitors true 2024-05-08T18:50:38.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:38.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:38.034 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:50:38.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:50:38.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:38.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:38.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:39.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:39.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:39.611 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:50:39.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:50:39.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:39.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:40.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:41.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:41.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:41.048 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:50:41.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:50:41.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:41.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:41.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:42.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:42.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:42.484 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:50:42.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:50:42.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:42.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:42.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:43.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:43.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:43.993 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:50:43.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:50:43.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:43.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:44.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:45.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:45.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:45.411 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:50:45.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:50:45.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:45.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:45.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:46.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:46.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:46.842 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:50:46.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:50:46.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:46.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:47.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:48.333 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:50:48.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:50:48.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:48.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:48.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:49.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:49.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:49.772 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:50:49.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:50:49.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:49.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:50.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:51.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:51.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:51.391 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:50:51.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:50:51.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:51.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:52.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:53.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:53.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:53.165 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:50:53.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:50:53.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:53.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:53.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:54.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:54.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:54.997 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:50:54.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:50:54.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:54.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:56.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:57.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:57.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:57.128 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:50:57.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:50:57.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:57.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:58.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:50:59.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:50:59.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:50:59.122 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:50:59.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:50:59.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:50:59.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:50:59.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:00.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:00.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:00.857 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:51:00.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:51:00.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:00.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:51:01.268 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/469077793,v1:127.0.0.1:6827/469077793] [v2:127.0.0.1:6828/469077793,v1:127.0.0.1:6829/469077793] exists,up 8a048740-9748-4bf9-9d91-0fca50290465 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 4 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:51:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/4 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:51:01.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:51:01.273 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:51:01.273 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:51:01.273 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:51:01.273 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:51:01.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:51:01.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/4 2024-05-08T18:51:01.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:51:01.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5ce944b5-a2ea-4242-b24d-8e526a9932d6 2024-05-08T18:51:01.276 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 5ce944b5-a2ea-4242-b24d-8e526a9932d6 2024-05-08T18:51:01.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 5ce944b5-a2ea-4242-b24d-8e526a9932d6' 2024-05-08T18:51:01.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:51:01.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCVyTtmG7vqERAAec3ry65acztgjuIBs4Cs2w== 2024-05-08T18:51:01.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCVyTtmG7vqERAAec3ry65acztgjuIBs4Cs2w=="}' 2024-05-08T18:51:01.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5ce944b5-a2ea-4242-b24d-8e526a9932d6 -i td/osd-backfill-space/4/new.json 2024-05-08T18:51:01.869 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:51:01.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/4/new.json 2024-05-08T18:51:01.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCVyTtmG7vqERAAec3ry65acztgjuIBs4Cs2w== --osd-uuid 5ce944b5-a2ea-4242-b24d-8e526a9932d6 2024-05-08T18:51:01.929 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:01.930+0000 7ff86b9057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:01.931 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:01.934+0000 7ff86b9057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:01.932 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:01.934+0000 7ff86b9057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:01.933 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:01.934+0000 7ff86b9057c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:51:01.933 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:01.934+0000 7ff86b9057c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:51:01.933 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:01.934+0000 7ff86b9057c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:51:02.060 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:02.062+0000 7ff86b9057c0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-05-08T18:51:07.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-05-08T18:51:07.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:51:07.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T18:51:07.883 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T18:51:07.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:51:08.458 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T18:51:08.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T18:51:08.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:51:08.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:51:08.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:51:08.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:51:08.490 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:08.494+0000 7fa6070797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:08.492 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:08.494+0000 7fa6070797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:08.493 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:08.494+0000 7fa6070797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:08.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T18:51:08.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:51:08.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T18:51:08.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:51:08.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:51:08.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:08.921 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:51:08.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:51:08.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:08.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:09.071 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:09.074+0000 7fa6070797c0 -1 Falling back to public interface 2024-05-08T18:51:09.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:10.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:10.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:10.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:51:10.351 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:51:10.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:10.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:10.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:11.631 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:11.634+0000 7fa6070797c0 -1 osd.4 0 log_to_monitors true 2024-05-08T18:51:11.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:11.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:11.802 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:51:11.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:51:11.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:11.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:12.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:13.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:13.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:13.417 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:51:13.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:51:13.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:13.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:13.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:14.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:14.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:14.836 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:51:14.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:51:14.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:14.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:15.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:16.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:16.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:16.490 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:51:16.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:51:16.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:16.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:17.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:18.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:18.068 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:51:18.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:18.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:51:18.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:18.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:18.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:19.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:19.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:19.619 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:51:19.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:51:19.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:19.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:20.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:21.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:21.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:21.073 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:51:21.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:51:21.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:21.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:21.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:22.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:22.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:22.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:51:22.608 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:51:22.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:22.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:23.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:24.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:24.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:24.125 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:51:24.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:51:24.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:24.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:25.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:26.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:26.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:26.059 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:51:26.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:51:26.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:26.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:26.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:27.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:27.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:27.950 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:51:27.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:51:27.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:27.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:28.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:29.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:29.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:29.814 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:51:29.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:51:29.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:29.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:30.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:31.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:31.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:31.497 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:51:31.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:51:31.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:31.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:32.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:33.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:33.155 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:51:33.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:33.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:51:33.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:33.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:33.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:34.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:34.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:34.991 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:51:34.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:51:34.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:34.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:51:35.424 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3106389107,v1:127.0.0.1:6835/3106389107] [v2:127.0.0.1:6836/3106389107,v1:127.0.0.1:6837/3106389107] exists,up 5ce944b5-a2ea-4242-b24d-8e526a9932d6 2024-05-08T18:51:35.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:51:35.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:51:35.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:51:35.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:51:35.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 5 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/5 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:51:35.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:51:35.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:51:35.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:51:35.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:51:35.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:51:35.428 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:51:35.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:51:35.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:51:35.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/5 2024-05-08T18:51:35.430 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:51:35.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=38c37b95-c48f-4e27-938c-5449d34d3e8c 2024-05-08T18:51:35.431 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 38c37b95-c48f-4e27-938c-5449d34d3e8c 2024-05-08T18:51:35.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 38c37b95-c48f-4e27-938c-5449d34d3e8c' 2024-05-08T18:51:35.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:51:35.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC3yTtm9/uYGxAANLK/g2CiU3QfRHacKHQTbw== 2024-05-08T18:51:35.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC3yTtm9/uYGxAANLK/g2CiU3QfRHacKHQTbw=="}' 2024-05-08T18:51:35.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 38c37b95-c48f-4e27-938c-5449d34d3e8c -i td/osd-backfill-space/5/new.json 2024-05-08T18:51:36.039 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:51:36.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/5/new.json 2024-05-08T18:51:36.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC3yTtm9/uYGxAANLK/g2CiU3QfRHacKHQTbw== --osd-uuid 38c37b95-c48f-4e27-938c-5449d34d3e8c 2024-05-08T18:51:36.100 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:36.101+0000 7f233d3787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:36.131 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:36.133+0000 7f233d3787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:36.132 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:36.133+0000 7f233d3787c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:36.133 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:36.133+0000 7f233d3787c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:51:36.133 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:36.133+0000 7f233d3787c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:51:36.133 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:36.133+0000 7f233d3787c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:51:36.170 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:36.169+0000 7f233d3787c0 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2024-05-08T18:51:42.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2024-05-08T18:51:42.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:51:42.041 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T18:51:42.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T18:51:42.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:51:42.605 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T18:51:42.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T18:51:42.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:51:42.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:51:42.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:51:42.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:51:42.643 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:42.645+0000 7f94aa6737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:42.645 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:42.645+0000 7f94aa6737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:42.647 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:42.649+0000 7f94aa6737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:51:43.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T18:51:43.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:51:43.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T18:51:43.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:51:43.006 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:51:43.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:51:43.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:43.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:51:43.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:43.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:43.200 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:43.201+0000 7f94aa6737c0 -1 Falling back to public interface 2024-05-08T18:51:43.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:44.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:44.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:44.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:51:44.421 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:51:44.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:44.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:44.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:45.702 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:51:45.705+0000 7f94aa6737c0 -1 osd.5 0 log_to_monitors true 2024-05-08T18:51:45.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:45.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:45.864 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:51:45.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:51:45.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:45.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:46.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:47.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:47.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:47.358 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:51:47.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:51:47.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:47.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:47.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:48.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:48.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:48.774 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:51:48.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:51:48.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:48.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:49.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:50.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:50.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:50.253 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:51:50.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:51:50.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:50.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:50.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:51.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:51.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:51.948 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:51:51.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:51:51.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:51.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:52.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:53.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:53.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:53.496 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:51:53.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:51:53.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:53.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:54.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:55.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:55.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:55.079 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:51:55.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:51:55.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:55.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:55.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:56.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:56.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:56.622 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:51:56.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:51:56.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:56.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:57.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:58.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:58.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:58.089 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:51:58.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:51:58.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:58.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:51:58.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:51:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:51:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:51:59.942 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:51:59.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:51:59.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:51:59.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:52:00.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:52:01.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:52:01.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:52:01.677 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:52:01.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:52:01.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:52:01.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:52:02.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:52:03.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:52:03.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:52:03.547 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:52:03.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:52:03.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:52:03.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:52:04.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:52:05.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:52:05.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:52:05.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:52:05.343 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:52:05.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:52:05.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:52:06.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:52:07.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:52:07.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:52:07.119 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:52:07.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:52:07.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:52:07.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:52:08.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:52:09.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:52:09.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:52:09.037 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:52:09.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:52:09.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:52:09.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:52:09.505 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/362396583,v1:127.0.0.1:6843/362396583] [v2:127.0.0.1:6844/362396583,v1:127.0.0.1:6845/362396583] exists,up 38c37b95-c48f-4e27-938c-5449d34d3e8c 2024-05-08T18:52:09.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:52:09.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:52:09.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:52:09.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:770: TEST_ec_backfill_multi: ceph osd set-backfillfull-ratio .85 2024-05-08T18:52:10.226 INFO:tasks.workunit.client.0.smithi117.stderr:osd set-backfillfull-ratio 0.85 2024-05-08T18:52:10.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:772: TEST_ec_backfill_multi: ceph osd set-require-min-compat-client luminous 2024-05-08T18:52:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:set require_min_compat_client to luminous 2024-05-08T18:52:11.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:773: TEST_ec_backfill_multi: create_pool fillpool 1 1 2024-05-08T18:52:11.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create fillpool 1 1 2024-05-08T18:52:11.642 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'fillpool' already exists 2024-05-08T18:52:11.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:52:12.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:774: TEST_ec_backfill_multi: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2024-05-08T18:52:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T18:52:13.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:782: TEST_ec_backfill_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=9 2024-05-08T18:52:13.564 INFO:tasks.workunit.client.0.smithi117.stderr:9+0 records in 2024-05-08T18:52:13.564 INFO:tasks.workunit.client.0.smithi117.stderr:9+0 records out 2024-05-08T18:52:13.564 INFO:tasks.workunit.client.0.smithi117.stderr:9216 bytes (9.2 kB, 9.0 KiB) copied, 0.000184651 s, 49.9 MB/s 2024-05-08T18:52:13.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: seq 1 200 2024-05-08T18:52:13.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:13.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj1 td/osd-backfill-space/datafile 2024-05-08T18:52:14.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:14.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj2 td/osd-backfill-space/datafile 2024-05-08T18:52:14.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:14.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj3 td/osd-backfill-space/datafile 2024-05-08T18:52:14.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:14.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj4 td/osd-backfill-space/datafile 2024-05-08T18:52:14.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:14.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj5 td/osd-backfill-space/datafile 2024-05-08T18:52:14.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:14.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj6 td/osd-backfill-space/datafile 2024-05-08T18:52:14.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:14.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj7 td/osd-backfill-space/datafile 2024-05-08T18:52:14.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:14.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj8 td/osd-backfill-space/datafile 2024-05-08T18:52:15.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj9 td/osd-backfill-space/datafile 2024-05-08T18:52:15.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj10 td/osd-backfill-space/datafile 2024-05-08T18:52:15.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj11 td/osd-backfill-space/datafile 2024-05-08T18:52:15.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj12 td/osd-backfill-space/datafile 2024-05-08T18:52:15.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj13 td/osd-backfill-space/datafile 2024-05-08T18:52:15.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj14 td/osd-backfill-space/datafile 2024-05-08T18:52:15.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj15 td/osd-backfill-space/datafile 2024-05-08T18:52:15.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj16 td/osd-backfill-space/datafile 2024-05-08T18:52:15.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj17 td/osd-backfill-space/datafile 2024-05-08T18:52:15.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:15.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj18 td/osd-backfill-space/datafile 2024-05-08T18:52:16.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj19 td/osd-backfill-space/datafile 2024-05-08T18:52:16.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj20 td/osd-backfill-space/datafile 2024-05-08T18:52:16.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj21 td/osd-backfill-space/datafile 2024-05-08T18:52:16.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj22 td/osd-backfill-space/datafile 2024-05-08T18:52:16.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj23 td/osd-backfill-space/datafile 2024-05-08T18:52:16.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj24 td/osd-backfill-space/datafile 2024-05-08T18:52:16.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj25 td/osd-backfill-space/datafile 2024-05-08T18:52:16.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj26 td/osd-backfill-space/datafile 2024-05-08T18:52:16.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj27 td/osd-backfill-space/datafile 2024-05-08T18:52:16.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:16.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj28 td/osd-backfill-space/datafile 2024-05-08T18:52:17.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj29 td/osd-backfill-space/datafile 2024-05-08T18:52:17.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj30 td/osd-backfill-space/datafile 2024-05-08T18:52:17.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj31 td/osd-backfill-space/datafile 2024-05-08T18:52:17.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj32 td/osd-backfill-space/datafile 2024-05-08T18:52:17.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj33 td/osd-backfill-space/datafile 2024-05-08T18:52:17.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj34 td/osd-backfill-space/datafile 2024-05-08T18:52:17.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj35 td/osd-backfill-space/datafile 2024-05-08T18:52:17.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj36 td/osd-backfill-space/datafile 2024-05-08T18:52:17.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj37 td/osd-backfill-space/datafile 2024-05-08T18:52:17.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj38 td/osd-backfill-space/datafile 2024-05-08T18:52:17.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:17.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj39 td/osd-backfill-space/datafile 2024-05-08T18:52:18.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj40 td/osd-backfill-space/datafile 2024-05-08T18:52:18.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj41 td/osd-backfill-space/datafile 2024-05-08T18:52:18.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj42 td/osd-backfill-space/datafile 2024-05-08T18:52:18.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj43 td/osd-backfill-space/datafile 2024-05-08T18:52:18.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj44 td/osd-backfill-space/datafile 2024-05-08T18:52:18.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj45 td/osd-backfill-space/datafile 2024-05-08T18:52:18.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj46 td/osd-backfill-space/datafile 2024-05-08T18:52:18.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj47 td/osd-backfill-space/datafile 2024-05-08T18:52:18.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj48 td/osd-backfill-space/datafile 2024-05-08T18:52:18.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj49 td/osd-backfill-space/datafile 2024-05-08T18:52:18.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:18.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj50 td/osd-backfill-space/datafile 2024-05-08T18:52:19.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj51 td/osd-backfill-space/datafile 2024-05-08T18:52:19.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj52 td/osd-backfill-space/datafile 2024-05-08T18:52:19.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj53 td/osd-backfill-space/datafile 2024-05-08T18:52:19.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj54 td/osd-backfill-space/datafile 2024-05-08T18:52:19.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj55 td/osd-backfill-space/datafile 2024-05-08T18:52:19.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj56 td/osd-backfill-space/datafile 2024-05-08T18:52:19.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj57 td/osd-backfill-space/datafile 2024-05-08T18:52:19.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj58 td/osd-backfill-space/datafile 2024-05-08T18:52:19.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj59 td/osd-backfill-space/datafile 2024-05-08T18:52:19.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj60 td/osd-backfill-space/datafile 2024-05-08T18:52:19.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:19.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj61 td/osd-backfill-space/datafile 2024-05-08T18:52:20.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj62 td/osd-backfill-space/datafile 2024-05-08T18:52:20.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj63 td/osd-backfill-space/datafile 2024-05-08T18:52:20.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj64 td/osd-backfill-space/datafile 2024-05-08T18:52:20.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj65 td/osd-backfill-space/datafile 2024-05-08T18:52:20.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj66 td/osd-backfill-space/datafile 2024-05-08T18:52:20.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj67 td/osd-backfill-space/datafile 2024-05-08T18:52:20.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj68 td/osd-backfill-space/datafile 2024-05-08T18:52:20.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj69 td/osd-backfill-space/datafile 2024-05-08T18:52:20.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj70 td/osd-backfill-space/datafile 2024-05-08T18:52:20.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:20.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj71 td/osd-backfill-space/datafile 2024-05-08T18:52:21.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj72 td/osd-backfill-space/datafile 2024-05-08T18:52:21.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj73 td/osd-backfill-space/datafile 2024-05-08T18:52:21.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj74 td/osd-backfill-space/datafile 2024-05-08T18:52:21.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj75 td/osd-backfill-space/datafile 2024-05-08T18:52:21.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj76 td/osd-backfill-space/datafile 2024-05-08T18:52:21.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj77 td/osd-backfill-space/datafile 2024-05-08T18:52:21.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj78 td/osd-backfill-space/datafile 2024-05-08T18:52:21.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj79 td/osd-backfill-space/datafile 2024-05-08T18:52:21.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj80 td/osd-backfill-space/datafile 2024-05-08T18:52:21.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj81 td/osd-backfill-space/datafile 2024-05-08T18:52:21.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:21.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj82 td/osd-backfill-space/datafile 2024-05-08T18:52:22.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj83 td/osd-backfill-space/datafile 2024-05-08T18:52:22.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj84 td/osd-backfill-space/datafile 2024-05-08T18:52:22.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj85 td/osd-backfill-space/datafile 2024-05-08T18:52:22.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj86 td/osd-backfill-space/datafile 2024-05-08T18:52:22.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj87 td/osd-backfill-space/datafile 2024-05-08T18:52:22.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj88 td/osd-backfill-space/datafile 2024-05-08T18:52:22.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj89 td/osd-backfill-space/datafile 2024-05-08T18:52:22.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj90 td/osd-backfill-space/datafile 2024-05-08T18:52:22.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj91 td/osd-backfill-space/datafile 2024-05-08T18:52:22.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:22.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj92 td/osd-backfill-space/datafile 2024-05-08T18:52:23.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj93 td/osd-backfill-space/datafile 2024-05-08T18:52:23.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj94 td/osd-backfill-space/datafile 2024-05-08T18:52:23.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj95 td/osd-backfill-space/datafile 2024-05-08T18:52:23.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj96 td/osd-backfill-space/datafile 2024-05-08T18:52:23.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj97 td/osd-backfill-space/datafile 2024-05-08T18:52:23.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj98 td/osd-backfill-space/datafile 2024-05-08T18:52:23.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj99 td/osd-backfill-space/datafile 2024-05-08T18:52:23.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj100 td/osd-backfill-space/datafile 2024-05-08T18:52:23.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj101 td/osd-backfill-space/datafile 2024-05-08T18:52:23.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj102 td/osd-backfill-space/datafile 2024-05-08T18:52:23.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:23.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj103 td/osd-backfill-space/datafile 2024-05-08T18:52:24.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:24.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj104 td/osd-backfill-space/datafile 2024-05-08T18:52:24.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:24.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj105 td/osd-backfill-space/datafile 2024-05-08T18:52:24.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:24.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj106 td/osd-backfill-space/datafile 2024-05-08T18:52:24.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:24.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj107 td/osd-backfill-space/datafile 2024-05-08T18:52:24.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:24.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj108 td/osd-backfill-space/datafile 2024-05-08T18:52:24.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:24.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj109 td/osd-backfill-space/datafile 2024-05-08T18:52:24.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:24.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj110 td/osd-backfill-space/datafile 2024-05-08T18:52:25.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj111 td/osd-backfill-space/datafile 2024-05-08T18:52:25.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj112 td/osd-backfill-space/datafile 2024-05-08T18:52:25.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj113 td/osd-backfill-space/datafile 2024-05-08T18:52:25.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj114 td/osd-backfill-space/datafile 2024-05-08T18:52:25.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj115 td/osd-backfill-space/datafile 2024-05-08T18:52:25.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj116 td/osd-backfill-space/datafile 2024-05-08T18:52:25.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj117 td/osd-backfill-space/datafile 2024-05-08T18:52:25.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj118 td/osd-backfill-space/datafile 2024-05-08T18:52:25.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj119 td/osd-backfill-space/datafile 2024-05-08T18:52:25.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj120 td/osd-backfill-space/datafile 2024-05-08T18:52:25.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:25.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj121 td/osd-backfill-space/datafile 2024-05-08T18:52:26.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj122 td/osd-backfill-space/datafile 2024-05-08T18:52:26.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj123 td/osd-backfill-space/datafile 2024-05-08T18:52:26.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj124 td/osd-backfill-space/datafile 2024-05-08T18:52:26.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj125 td/osd-backfill-space/datafile 2024-05-08T18:52:26.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj126 td/osd-backfill-space/datafile 2024-05-08T18:52:26.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj127 td/osd-backfill-space/datafile 2024-05-08T18:52:26.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj128 td/osd-backfill-space/datafile 2024-05-08T18:52:26.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj129 td/osd-backfill-space/datafile 2024-05-08T18:52:26.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj130 td/osd-backfill-space/datafile 2024-05-08T18:52:26.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:26.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj131 td/osd-backfill-space/datafile 2024-05-08T18:52:27.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj132 td/osd-backfill-space/datafile 2024-05-08T18:52:27.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj133 td/osd-backfill-space/datafile 2024-05-08T18:52:27.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj134 td/osd-backfill-space/datafile 2024-05-08T18:52:27.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj135 td/osd-backfill-space/datafile 2024-05-08T18:52:27.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj136 td/osd-backfill-space/datafile 2024-05-08T18:52:27.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj137 td/osd-backfill-space/datafile 2024-05-08T18:52:27.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj138 td/osd-backfill-space/datafile 2024-05-08T18:52:27.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj139 td/osd-backfill-space/datafile 2024-05-08T18:52:27.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj140 td/osd-backfill-space/datafile 2024-05-08T18:52:27.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj141 td/osd-backfill-space/datafile 2024-05-08T18:52:27.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj142 td/osd-backfill-space/datafile 2024-05-08T18:52:27.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:27.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj143 td/osd-backfill-space/datafile 2024-05-08T18:52:28.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj144 td/osd-backfill-space/datafile 2024-05-08T18:52:28.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj145 td/osd-backfill-space/datafile 2024-05-08T18:52:28.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj146 td/osd-backfill-space/datafile 2024-05-08T18:52:28.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj147 td/osd-backfill-space/datafile 2024-05-08T18:52:28.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj148 td/osd-backfill-space/datafile 2024-05-08T18:52:28.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj149 td/osd-backfill-space/datafile 2024-05-08T18:52:28.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj150 td/osd-backfill-space/datafile 2024-05-08T18:52:28.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj151 td/osd-backfill-space/datafile 2024-05-08T18:52:28.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:28.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj152 td/osd-backfill-space/datafile 2024-05-08T18:52:29.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj153 td/osd-backfill-space/datafile 2024-05-08T18:52:29.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj154 td/osd-backfill-space/datafile 2024-05-08T18:52:29.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj155 td/osd-backfill-space/datafile 2024-05-08T18:52:29.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj156 td/osd-backfill-space/datafile 2024-05-08T18:52:29.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj157 td/osd-backfill-space/datafile 2024-05-08T18:52:29.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj158 td/osd-backfill-space/datafile 2024-05-08T18:52:29.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj159 td/osd-backfill-space/datafile 2024-05-08T18:52:29.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj160 td/osd-backfill-space/datafile 2024-05-08T18:52:29.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj161 td/osd-backfill-space/datafile 2024-05-08T18:52:29.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj162 td/osd-backfill-space/datafile 2024-05-08T18:52:29.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:29.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj163 td/osd-backfill-space/datafile 2024-05-08T18:52:30.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj164 td/osd-backfill-space/datafile 2024-05-08T18:52:30.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj165 td/osd-backfill-space/datafile 2024-05-08T18:52:30.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj166 td/osd-backfill-space/datafile 2024-05-08T18:52:30.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj167 td/osd-backfill-space/datafile 2024-05-08T18:52:30.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj168 td/osd-backfill-space/datafile 2024-05-08T18:52:30.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj169 td/osd-backfill-space/datafile 2024-05-08T18:52:30.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj170 td/osd-backfill-space/datafile 2024-05-08T18:52:30.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj171 td/osd-backfill-space/datafile 2024-05-08T18:52:30.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj172 td/osd-backfill-space/datafile 2024-05-08T18:52:30.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:30.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj173 td/osd-backfill-space/datafile 2024-05-08T18:52:31.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj174 td/osd-backfill-space/datafile 2024-05-08T18:52:31.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj175 td/osd-backfill-space/datafile 2024-05-08T18:52:31.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj176 td/osd-backfill-space/datafile 2024-05-08T18:52:31.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj177 td/osd-backfill-space/datafile 2024-05-08T18:52:31.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj178 td/osd-backfill-space/datafile 2024-05-08T18:52:31.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj179 td/osd-backfill-space/datafile 2024-05-08T18:52:31.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj180 td/osd-backfill-space/datafile 2024-05-08T18:52:31.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj181 td/osd-backfill-space/datafile 2024-05-08T18:52:31.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj182 td/osd-backfill-space/datafile 2024-05-08T18:52:31.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj183 td/osd-backfill-space/datafile 2024-05-08T18:52:31.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:31.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj184 td/osd-backfill-space/datafile 2024-05-08T18:52:32.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj185 td/osd-backfill-space/datafile 2024-05-08T18:52:32.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj186 td/osd-backfill-space/datafile 2024-05-08T18:52:32.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj187 td/osd-backfill-space/datafile 2024-05-08T18:52:32.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj188 td/osd-backfill-space/datafile 2024-05-08T18:52:32.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj189 td/osd-backfill-space/datafile 2024-05-08T18:52:32.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj190 td/osd-backfill-space/datafile 2024-05-08T18:52:32.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj191 td/osd-backfill-space/datafile 2024-05-08T18:52:32.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj192 td/osd-backfill-space/datafile 2024-05-08T18:52:32.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj193 td/osd-backfill-space/datafile 2024-05-08T18:52:32.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj194 td/osd-backfill-space/datafile 2024-05-08T18:52:32.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:32.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj195 td/osd-backfill-space/datafile 2024-05-08T18:52:33.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:33.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj196 td/osd-backfill-space/datafile 2024-05-08T18:52:33.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:33.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj197 td/osd-backfill-space/datafile 2024-05-08T18:52:33.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:33.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj198 td/osd-backfill-space/datafile 2024-05-08T18:52:33.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:33.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj199 td/osd-backfill-space/datafile 2024-05-08T18:52:33.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:33.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj200 td/osd-backfill-space/datafile 2024-05-08T18:52:33.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:788: TEST_ec_backfill_multi: get_primary fillpool obj1 2024-05-08T18:52:33.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=fillpool 2024-05-08T18:52:33.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T18:52:33.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map fillpool obj1 2024-05-08T18:52:33.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T18:52:33.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:788: TEST_ec_backfill_multi: local fillosd=1 2024-05-08T18:52:33.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:789: TEST_ec_backfill_multi: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2024-05-08T18:52:34.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:791: TEST_ec_backfill_multi: osdlist 6 1 2024-05-08T18:52:34.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:724: osdlist: local OSDS=6 2024-05-08T18:52:34.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:725: osdlist: local excludeosd=1 2024-05-08T18:52:34.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:727: osdlist: osds= 2024-05-08T18:52:34.512 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: expr 6 - 1 2024-05-08T18:52:34.513 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: seq 0 5 2024-05-08T18:52:34.516 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 0 = 1 ']' 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n '' ']' 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds=0 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 1 = 1 ']' 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:732: osdlist: continue 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 2 = 1 ']' 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n 0 ']' 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:735: osdlist: osds='0 ' 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds='0 2' 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:52:34.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 3 = 1 ']' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n '0 2' ']' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:735: osdlist: osds='0 2 ' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds='0 2 3' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 4 = 1 ']' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n '0 2 3' ']' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:735: osdlist: osds='0 2 3 ' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds='0 2 3 4' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 5 = 1 ']' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n '0 2 3 4' ']' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:735: osdlist: osds='0 2 3 4 ' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds='0 2 3 4 5' 2024-05-08T18:52:34.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:739: osdlist: echo 0 2 3 4 5 2024-05-08T18:52:34.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:791: TEST_ec_backfill_multi: nonfillosds='0 2 3 4 5' 2024-05-08T18:52:34.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:793: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:34.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:793: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:34.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:795: TEST_ec_backfill_multi: ceph osd pool create test1 1 1 erasure ec-profile 2024-05-08T18:52:35.434 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' already exists 2024-05-08T18:52:35.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:796: TEST_ec_backfill_multi: expr 1 + 1 2024-05-08T18:52:35.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:796: TEST_ec_backfill_multi: ceph osd pg-upmap 2.0 0 2 3 4 5 2024-05-08T18:52:36.104 INFO:tasks.workunit.client.0.smithi117.stderr:set 2.0 pg_upmap mapping to [0,2,3,4,5] 2024-05-08T18:52:36.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:793: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:36.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:795: TEST_ec_backfill_multi: ceph osd pool create test2 1 1 erasure ec-profile 2024-05-08T18:52:37.172 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' already exists 2024-05-08T18:52:37.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:796: TEST_ec_backfill_multi: expr 2 + 1 2024-05-08T18:52:37.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:796: TEST_ec_backfill_multi: ceph osd pg-upmap 3.0 0 2 3 4 5 2024-05-08T18:52:38.640 INFO:tasks.workunit.client.0.smithi117.stderr:set 3.0 pg_upmap mapping to [0,2,3,4,5] 2024-05-08T18:52:38.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:801: TEST_ec_backfill_multi: sleep 15 2024-05-08T18:52:53.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:803: TEST_ec_backfill_multi: ceph pg dump pgs 2024-05-08T18:52:54.073 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:52:54.073 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:52:39.878403+0000 0'0 53:17 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2024-05-08T18:52:36.854017+0000 0'0 2024-05-08T18:52:36.854017+0000 0 0 periodic scrub scheduled @ 2024-05-10T06:08:50.357480+0000 0 0 2024-05-08T18:52:54.073 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:52:37.738098+0000 0'0 53:26 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2024-05-08T18:52:35.186356+0000 0'0 2024-05-08T18:52:35.186356+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:10:57.561273+0000 0 0 2024-05-08T18:52:54.073 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 100 active+clean 2024-05-08T18:52:14.042577+0000 41'200 53:241 [1] 1 [1] 1 0'0 2024-05-08T18:52:11.458368+0000 0'0 2024-05-08T18:52:11.458368+0000 0 0 periodic scrub scheduled @ 2024-05-10T01:22:29.155641+0000 0 0 2024-05-08T18:52:54.073 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:52:54.073 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:52:54.074 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:52:54.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:805: TEST_ec_backfill_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=12 2024-05-08T18:52:54.090 INFO:tasks.workunit.client.0.smithi117.stderr:12+0 records in 2024-05-08T18:52:54.090 INFO:tasks.workunit.client.0.smithi117.stderr:12+0 records out 2024-05-08T18:52:54.090 INFO:tasks.workunit.client.0.smithi117.stderr:12288 bytes (12 kB, 12 KiB) copied, 0.000286413 s, 42.9 MB/s 2024-05-08T18:52:54.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: seq 1 200 2024-05-08T18:52:54.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:54.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:54.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:54.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj1-1 td/osd-backfill-space/datafile 2024-05-08T18:52:54.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:54.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj1-2 td/osd-backfill-space/datafile 2024-05-08T18:52:54.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:54.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:54.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:54.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj2-1 td/osd-backfill-space/datafile 2024-05-08T18:52:54.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:54.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj2-2 td/osd-backfill-space/datafile 2024-05-08T18:52:55.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:55.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:55.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:55.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj3-1 td/osd-backfill-space/datafile 2024-05-08T18:52:55.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:55.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj3-2 td/osd-backfill-space/datafile 2024-05-08T18:52:55.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:55.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:55.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:55.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj4-1 td/osd-backfill-space/datafile 2024-05-08T18:52:56.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:56.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj4-2 td/osd-backfill-space/datafile 2024-05-08T18:52:56.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:56.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:56.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:56.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj5-1 td/osd-backfill-space/datafile 2024-05-08T18:52:56.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:56.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj5-2 td/osd-backfill-space/datafile 2024-05-08T18:52:56.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:56.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:56.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:56.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj6-1 td/osd-backfill-space/datafile 2024-05-08T18:52:57.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:57.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj6-2 td/osd-backfill-space/datafile 2024-05-08T18:52:57.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:57.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:57.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:57.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj7-1 td/osd-backfill-space/datafile 2024-05-08T18:52:57.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:57.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj7-2 td/osd-backfill-space/datafile 2024-05-08T18:52:57.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:57.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:57.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:57.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj8-1 td/osd-backfill-space/datafile 2024-05-08T18:52:58.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:58.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj8-2 td/osd-backfill-space/datafile 2024-05-08T18:52:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:58.508 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:58.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:58.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj9-1 td/osd-backfill-space/datafile 2024-05-08T18:52:58.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:58.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj9-2 td/osd-backfill-space/datafile 2024-05-08T18:52:59.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:59.013 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:59.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:59.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj10-1 td/osd-backfill-space/datafile 2024-05-08T18:52:59.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:59.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj10-2 td/osd-backfill-space/datafile 2024-05-08T18:52:59.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:52:59.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:52:59.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:59.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj11-1 td/osd-backfill-space/datafile 2024-05-08T18:52:59.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:52:59.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj11-2 td/osd-backfill-space/datafile 2024-05-08T18:53:00.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:00.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:00.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:00.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj12-1 td/osd-backfill-space/datafile 2024-05-08T18:53:00.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:00.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj12-2 td/osd-backfill-space/datafile 2024-05-08T18:53:00.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:00.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:00.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:00.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj13-1 td/osd-backfill-space/datafile 2024-05-08T18:53:00.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:00.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj13-2 td/osd-backfill-space/datafile 2024-05-08T18:53:01.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:01.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:01.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:01.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj14-1 td/osd-backfill-space/datafile 2024-05-08T18:53:01.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:01.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj14-2 td/osd-backfill-space/datafile 2024-05-08T18:53:01.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:01.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:01.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:01.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj15-1 td/osd-backfill-space/datafile 2024-05-08T18:53:01.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:01.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj15-2 td/osd-backfill-space/datafile 2024-05-08T18:53:02.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:02.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:02.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:02.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj16-1 td/osd-backfill-space/datafile 2024-05-08T18:53:02.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:02.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj16-2 td/osd-backfill-space/datafile 2024-05-08T18:53:02.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:02.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:02.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:02.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj17-1 td/osd-backfill-space/datafile 2024-05-08T18:53:02.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:02.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj17-2 td/osd-backfill-space/datafile 2024-05-08T18:53:03.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:03.168 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:03.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:03.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj18-1 td/osd-backfill-space/datafile 2024-05-08T18:53:03.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:03.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj18-2 td/osd-backfill-space/datafile 2024-05-08T18:53:03.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:03.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:03.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:03.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj19-1 td/osd-backfill-space/datafile 2024-05-08T18:53:03.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:03.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj19-2 td/osd-backfill-space/datafile 2024-05-08T18:53:04.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:04.176 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:04.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:04.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj20-1 td/osd-backfill-space/datafile 2024-05-08T18:53:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj20-2 td/osd-backfill-space/datafile 2024-05-08T18:53:04.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:04.706 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:04.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:04.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj21-1 td/osd-backfill-space/datafile 2024-05-08T18:53:04.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:04.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj21-2 td/osd-backfill-space/datafile 2024-05-08T18:53:05.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:05.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:05.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:05.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj22-1 td/osd-backfill-space/datafile 2024-05-08T18:53:05.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:05.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj22-2 td/osd-backfill-space/datafile 2024-05-08T18:53:05.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:05.755 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:05.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:05.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj23-1 td/osd-backfill-space/datafile 2024-05-08T18:53:06.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:06.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj23-2 td/osd-backfill-space/datafile 2024-05-08T18:53:06.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:06.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:06.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:06.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj24-1 td/osd-backfill-space/datafile 2024-05-08T18:53:06.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:06.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj24-2 td/osd-backfill-space/datafile 2024-05-08T18:53:06.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:06.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:06.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:06.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj25-1 td/osd-backfill-space/datafile 2024-05-08T18:53:07.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:07.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj25-2 td/osd-backfill-space/datafile 2024-05-08T18:53:07.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:07.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:07.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:07.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj26-1 td/osd-backfill-space/datafile 2024-05-08T18:53:07.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:07.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj26-2 td/osd-backfill-space/datafile 2024-05-08T18:53:07.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:07.879 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:07.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:07.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj27-1 td/osd-backfill-space/datafile 2024-05-08T18:53:08.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:08.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj27-2 td/osd-backfill-space/datafile 2024-05-08T18:53:08.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:08.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:08.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:08.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj28-1 td/osd-backfill-space/datafile 2024-05-08T18:53:08.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:08.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj28-2 td/osd-backfill-space/datafile 2024-05-08T18:53:08.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:08.913 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:08.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:08.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj29-1 td/osd-backfill-space/datafile 2024-05-08T18:53:09.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:09.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj29-2 td/osd-backfill-space/datafile 2024-05-08T18:53:09.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:09.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:09.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:09.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj30-1 td/osd-backfill-space/datafile 2024-05-08T18:53:09.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:09.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj30-2 td/osd-backfill-space/datafile 2024-05-08T18:53:09.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:09.860 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:09.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:09.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj31-1 td/osd-backfill-space/datafile 2024-05-08T18:53:10.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:10.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj31-2 td/osd-backfill-space/datafile 2024-05-08T18:53:10.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:10.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj32-1 td/osd-backfill-space/datafile 2024-05-08T18:53:10.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:10.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj32-2 td/osd-backfill-space/datafile 2024-05-08T18:53:10.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:10.953 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:10.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:10.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj33-1 td/osd-backfill-space/datafile 2024-05-08T18:53:11.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:11.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj33-2 td/osd-backfill-space/datafile 2024-05-08T18:53:11.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:11.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:11.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:11.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj34-1 td/osd-backfill-space/datafile 2024-05-08T18:53:11.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:11.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj34-2 td/osd-backfill-space/datafile 2024-05-08T18:53:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:11.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj35-1 td/osd-backfill-space/datafile 2024-05-08T18:53:12.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:12.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj35-2 td/osd-backfill-space/datafile 2024-05-08T18:53:12.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:12.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:12.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:12.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj36-1 td/osd-backfill-space/datafile 2024-05-08T18:53:12.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:12.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj36-2 td/osd-backfill-space/datafile 2024-05-08T18:53:13.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:13.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:13.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:13.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj37-1 td/osd-backfill-space/datafile 2024-05-08T18:53:13.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:13.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj37-2 td/osd-backfill-space/datafile 2024-05-08T18:53:13.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:13.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:13.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj38-1 td/osd-backfill-space/datafile 2024-05-08T18:53:13.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:13.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj38-2 td/osd-backfill-space/datafile 2024-05-08T18:53:14.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:14.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:14.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:14.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj39-1 td/osd-backfill-space/datafile 2024-05-08T18:53:14.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:14.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj39-2 td/osd-backfill-space/datafile 2024-05-08T18:53:14.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:14.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:14.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:14.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj40-1 td/osd-backfill-space/datafile 2024-05-08T18:53:14.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:14.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj40-2 td/osd-backfill-space/datafile 2024-05-08T18:53:15.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:15.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:15.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:15.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj41-1 td/osd-backfill-space/datafile 2024-05-08T18:53:15.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:15.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj41-2 td/osd-backfill-space/datafile 2024-05-08T18:53:15.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:15.653 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:15.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:15.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj42-1 td/osd-backfill-space/datafile 2024-05-08T18:53:15.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:15.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj42-2 td/osd-backfill-space/datafile 2024-05-08T18:53:16.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:16.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:16.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:16.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj43-1 td/osd-backfill-space/datafile 2024-05-08T18:53:16.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:16.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj43-2 td/osd-backfill-space/datafile 2024-05-08T18:53:16.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:16.712 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:16.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj44-1 td/osd-backfill-space/datafile 2024-05-08T18:53:17.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:17.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj44-2 td/osd-backfill-space/datafile 2024-05-08T18:53:17.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:17.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:17.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:17.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj45-1 td/osd-backfill-space/datafile 2024-05-08T18:53:17.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:17.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj45-2 td/osd-backfill-space/datafile 2024-05-08T18:53:17.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:17.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:17.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:17.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj46-1 td/osd-backfill-space/datafile 2024-05-08T18:53:18.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:18.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj46-2 td/osd-backfill-space/datafile 2024-05-08T18:53:18.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:18.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:18.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:18.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj47-1 td/osd-backfill-space/datafile 2024-05-08T18:53:18.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:18.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj47-2 td/osd-backfill-space/datafile 2024-05-08T18:53:18.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:18.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:18.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:18.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj48-1 td/osd-backfill-space/datafile 2024-05-08T18:53:19.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:19.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj48-2 td/osd-backfill-space/datafile 2024-05-08T18:53:19.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:19.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:19.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:19.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj49-1 td/osd-backfill-space/datafile 2024-05-08T18:53:19.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:19.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj49-2 td/osd-backfill-space/datafile 2024-05-08T18:53:19.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:19.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:19.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:19.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj50-1 td/osd-backfill-space/datafile 2024-05-08T18:53:20.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:20.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj50-2 td/osd-backfill-space/datafile 2024-05-08T18:53:20.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:20.331 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:20.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:20.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj51-1 td/osd-backfill-space/datafile 2024-05-08T18:53:20.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:20.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj51-2 td/osd-backfill-space/datafile 2024-05-08T18:53:20.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:20.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:20.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:20.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj52-1 td/osd-backfill-space/datafile 2024-05-08T18:53:21.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:21.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj52-2 td/osd-backfill-space/datafile 2024-05-08T18:53:21.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:21.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:21.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:21.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj53-1 td/osd-backfill-space/datafile 2024-05-08T18:53:21.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:21.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj53-2 td/osd-backfill-space/datafile 2024-05-08T18:53:21.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:21.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:21.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:21.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj54-1 td/osd-backfill-space/datafile 2024-05-08T18:53:22.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:22.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj54-2 td/osd-backfill-space/datafile 2024-05-08T18:53:22.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:22.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:22.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:22.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj55-1 td/osd-backfill-space/datafile 2024-05-08T18:53:22.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:22.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj55-2 td/osd-backfill-space/datafile 2024-05-08T18:53:22.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:22.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:22.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:22.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj56-1 td/osd-backfill-space/datafile 2024-05-08T18:53:23.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:23.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj56-2 td/osd-backfill-space/datafile 2024-05-08T18:53:23.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:23.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:23.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:23.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj57-1 td/osd-backfill-space/datafile 2024-05-08T18:53:23.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:23.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj57-2 td/osd-backfill-space/datafile 2024-05-08T18:53:23.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:23.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:23.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:23.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj58-1 td/osd-backfill-space/datafile 2024-05-08T18:53:24.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:24.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj58-2 td/osd-backfill-space/datafile 2024-05-08T18:53:24.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:24.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:24.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:24.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj59-1 td/osd-backfill-space/datafile 2024-05-08T18:53:24.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:24.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj59-2 td/osd-backfill-space/datafile 2024-05-08T18:53:24.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:24.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:24.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:24.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj60-1 td/osd-backfill-space/datafile 2024-05-08T18:53:25.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:25.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj60-2 td/osd-backfill-space/datafile 2024-05-08T18:53:25.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:25.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:25.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:25.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj61-1 td/osd-backfill-space/datafile 2024-05-08T18:53:25.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:25.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj61-2 td/osd-backfill-space/datafile 2024-05-08T18:53:25.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:25.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:25.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:25.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj62-1 td/osd-backfill-space/datafile 2024-05-08T18:53:26.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:26.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj62-2 td/osd-backfill-space/datafile 2024-05-08T18:53:26.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:26.430 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:26.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:26.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj63-1 td/osd-backfill-space/datafile 2024-05-08T18:53:26.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:26.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj63-2 td/osd-backfill-space/datafile 2024-05-08T18:53:27.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:27.285 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:27.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:27.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj64-1 td/osd-backfill-space/datafile 2024-05-08T18:53:27.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:27.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj64-2 td/osd-backfill-space/datafile 2024-05-08T18:53:27.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:27.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:27.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:27.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj65-1 td/osd-backfill-space/datafile 2024-05-08T18:53:28.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:28.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj65-2 td/osd-backfill-space/datafile 2024-05-08T18:53:28.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:28.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:28.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:28.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj66-1 td/osd-backfill-space/datafile 2024-05-08T18:53:28.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:28.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj66-2 td/osd-backfill-space/datafile 2024-05-08T18:53:28.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:28.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:28.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:28.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj67-1 td/osd-backfill-space/datafile 2024-05-08T18:53:29.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:29.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj67-2 td/osd-backfill-space/datafile 2024-05-08T18:53:29.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:29.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:29.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:29.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj68-1 td/osd-backfill-space/datafile 2024-05-08T18:53:29.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:29.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj68-2 td/osd-backfill-space/datafile 2024-05-08T18:53:29.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:29.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:29.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:29.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj69-1 td/osd-backfill-space/datafile 2024-05-08T18:53:30.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:30.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj69-2 td/osd-backfill-space/datafile 2024-05-08T18:53:30.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:30.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:30.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:30.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj70-1 td/osd-backfill-space/datafile 2024-05-08T18:53:30.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:30.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj70-2 td/osd-backfill-space/datafile 2024-05-08T18:53:30.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:30.914 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj71-1 td/osd-backfill-space/datafile 2024-05-08T18:53:31.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:31.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj71-2 td/osd-backfill-space/datafile 2024-05-08T18:53:31.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:31.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:31.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:31.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj72-1 td/osd-backfill-space/datafile 2024-05-08T18:53:31.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:31.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj72-2 td/osd-backfill-space/datafile 2024-05-08T18:53:31.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:31.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:31.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:31.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj73-1 td/osd-backfill-space/datafile 2024-05-08T18:53:32.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:32.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj73-2 td/osd-backfill-space/datafile 2024-05-08T18:53:32.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:32.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:32.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:32.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj74-1 td/osd-backfill-space/datafile 2024-05-08T18:53:32.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:32.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj74-2 td/osd-backfill-space/datafile 2024-05-08T18:53:32.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:32.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:32.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:32.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj75-1 td/osd-backfill-space/datafile 2024-05-08T18:53:33.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:33.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj75-2 td/osd-backfill-space/datafile 2024-05-08T18:53:33.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:33.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:33.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:33.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj76-1 td/osd-backfill-space/datafile 2024-05-08T18:53:33.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:33.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj76-2 td/osd-backfill-space/datafile 2024-05-08T18:53:34.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:34.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:34.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:34.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj77-1 td/osd-backfill-space/datafile 2024-05-08T18:53:34.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:34.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj77-2 td/osd-backfill-space/datafile 2024-05-08T18:53:34.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:34.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:34.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:34.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj78-1 td/osd-backfill-space/datafile 2024-05-08T18:53:34.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:34.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj78-2 td/osd-backfill-space/datafile 2024-05-08T18:53:35.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:35.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:35.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:35.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj79-1 td/osd-backfill-space/datafile 2024-05-08T18:53:35.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:35.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj79-2 td/osd-backfill-space/datafile 2024-05-08T18:53:35.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:35.668 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:35.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:35.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj80-1 td/osd-backfill-space/datafile 2024-05-08T18:53:35.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:35.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj80-2 td/osd-backfill-space/datafile 2024-05-08T18:53:36.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:36.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:36.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:36.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj81-1 td/osd-backfill-space/datafile 2024-05-08T18:53:36.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:36.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj81-2 td/osd-backfill-space/datafile 2024-05-08T18:53:36.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:36.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:36.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:36.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj82-1 td/osd-backfill-space/datafile 2024-05-08T18:53:36.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:36.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj82-2 td/osd-backfill-space/datafile 2024-05-08T18:53:37.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:37.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:37.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:37.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj83-1 td/osd-backfill-space/datafile 2024-05-08T18:53:37.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:37.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj83-2 td/osd-backfill-space/datafile 2024-05-08T18:53:37.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:37.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:37.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:37.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj84-1 td/osd-backfill-space/datafile 2024-05-08T18:53:37.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:37.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj84-2 td/osd-backfill-space/datafile 2024-05-08T18:53:38.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:38.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:38.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:38.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj85-1 td/osd-backfill-space/datafile 2024-05-08T18:53:38.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:38.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj85-2 td/osd-backfill-space/datafile 2024-05-08T18:53:38.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:38.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:38.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:38.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj86-1 td/osd-backfill-space/datafile 2024-05-08T18:53:39.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:39.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj86-2 td/osd-backfill-space/datafile 2024-05-08T18:53:39.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:39.278 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:39.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:39.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj87-1 td/osd-backfill-space/datafile 2024-05-08T18:53:39.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:39.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj87-2 td/osd-backfill-space/datafile 2024-05-08T18:53:39.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:39.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:39.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:39.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj88-1 td/osd-backfill-space/datafile 2024-05-08T18:53:40.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:40.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj88-2 td/osd-backfill-space/datafile 2024-05-08T18:53:40.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:40.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:40.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:40.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj89-1 td/osd-backfill-space/datafile 2024-05-08T18:53:40.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:40.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj89-2 td/osd-backfill-space/datafile 2024-05-08T18:53:40.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:40.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:40.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:40.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj90-1 td/osd-backfill-space/datafile 2024-05-08T18:53:41.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:41.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj90-2 td/osd-backfill-space/datafile 2024-05-08T18:53:41.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:41.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:41.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:41.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj91-1 td/osd-backfill-space/datafile 2024-05-08T18:53:41.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:41.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj91-2 td/osd-backfill-space/datafile 2024-05-08T18:53:41.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:41.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:41.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:41.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj92-1 td/osd-backfill-space/datafile 2024-05-08T18:53:42.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:42.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj92-2 td/osd-backfill-space/datafile 2024-05-08T18:53:42.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:42.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:42.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:42.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj93-1 td/osd-backfill-space/datafile 2024-05-08T18:53:42.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:42.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj93-2 td/osd-backfill-space/datafile 2024-05-08T18:53:42.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:42.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:42.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:42.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj94-1 td/osd-backfill-space/datafile 2024-05-08T18:53:43.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:43.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj94-2 td/osd-backfill-space/datafile 2024-05-08T18:53:43.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:43.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:43.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:43.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj95-1 td/osd-backfill-space/datafile 2024-05-08T18:53:43.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:43.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj95-2 td/osd-backfill-space/datafile 2024-05-08T18:53:43.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:43.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:43.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:43.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj96-1 td/osd-backfill-space/datafile 2024-05-08T18:53:44.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:44.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj96-2 td/osd-backfill-space/datafile 2024-05-08T18:53:44.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:44.353 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:44.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:44.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj97-1 td/osd-backfill-space/datafile 2024-05-08T18:53:44.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:44.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj97-2 td/osd-backfill-space/datafile 2024-05-08T18:53:44.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:44.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:44.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:44.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj98-1 td/osd-backfill-space/datafile 2024-05-08T18:53:45.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:45.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj98-2 td/osd-backfill-space/datafile 2024-05-08T18:53:45.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:45.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:45.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:45.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj99-1 td/osd-backfill-space/datafile 2024-05-08T18:53:45.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:45.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj99-2 td/osd-backfill-space/datafile 2024-05-08T18:53:45.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:45.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:45.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:45.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj100-1 td/osd-backfill-space/datafile 2024-05-08T18:53:46.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:46.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj100-2 td/osd-backfill-space/datafile 2024-05-08T18:53:46.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:46.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:46.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:46.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj101-1 td/osd-backfill-space/datafile 2024-05-08T18:53:46.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:46.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj101-2 td/osd-backfill-space/datafile 2024-05-08T18:53:46.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:46.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:46.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:46.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj102-1 td/osd-backfill-space/datafile 2024-05-08T18:53:47.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:47.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj102-2 td/osd-backfill-space/datafile 2024-05-08T18:53:47.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:47.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:47.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:47.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj103-1 td/osd-backfill-space/datafile 2024-05-08T18:53:47.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:47.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj103-2 td/osd-backfill-space/datafile 2024-05-08T18:53:47.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:47.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:47.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:47.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj104-1 td/osd-backfill-space/datafile 2024-05-08T18:53:48.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:48.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj104-2 td/osd-backfill-space/datafile 2024-05-08T18:53:48.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:48.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:48.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:48.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj105-1 td/osd-backfill-space/datafile 2024-05-08T18:53:48.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:48.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj105-2 td/osd-backfill-space/datafile 2024-05-08T18:53:48.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:48.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:48.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:48.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj106-1 td/osd-backfill-space/datafile 2024-05-08T18:53:49.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:49.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj106-2 td/osd-backfill-space/datafile 2024-05-08T18:53:49.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:49.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:49.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:49.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj107-1 td/osd-backfill-space/datafile 2024-05-08T18:53:49.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:49.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj107-2 td/osd-backfill-space/datafile 2024-05-08T18:53:49.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:49.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:49.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:49.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj108-1 td/osd-backfill-space/datafile 2024-05-08T18:53:50.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:50.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj108-2 td/osd-backfill-space/datafile 2024-05-08T18:53:50.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:50.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:50.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:50.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj109-1 td/osd-backfill-space/datafile 2024-05-08T18:53:50.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:50.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj109-2 td/osd-backfill-space/datafile 2024-05-08T18:53:51.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:51.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:51.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:51.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj110-1 td/osd-backfill-space/datafile 2024-05-08T18:53:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj110-2 td/osd-backfill-space/datafile 2024-05-08T18:53:51.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:51.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:51.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:51.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj111-1 td/osd-backfill-space/datafile 2024-05-08T18:53:51.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:51.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj111-2 td/osd-backfill-space/datafile 2024-05-08T18:53:52.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:52.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:52.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:52.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj112-1 td/osd-backfill-space/datafile 2024-05-08T18:53:52.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:52.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj112-2 td/osd-backfill-space/datafile 2024-05-08T18:53:52.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:52.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:52.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:52.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj113-1 td/osd-backfill-space/datafile 2024-05-08T18:53:52.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:52.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj113-2 td/osd-backfill-space/datafile 2024-05-08T18:53:53.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:53.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:53.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:53.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj114-1 td/osd-backfill-space/datafile 2024-05-08T18:53:53.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:53.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj114-2 td/osd-backfill-space/datafile 2024-05-08T18:53:53.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:53.509 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:53.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:53.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj115-1 td/osd-backfill-space/datafile 2024-05-08T18:53:53.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:53.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj115-2 td/osd-backfill-space/datafile 2024-05-08T18:53:53.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:53.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:53.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:53.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj116-1 td/osd-backfill-space/datafile 2024-05-08T18:53:54.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:54.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj116-2 td/osd-backfill-space/datafile 2024-05-08T18:53:54.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:54.477 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:54.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:54.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj117-1 td/osd-backfill-space/datafile 2024-05-08T18:53:54.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:54.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj117-2 td/osd-backfill-space/datafile 2024-05-08T18:53:54.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:54.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:54.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:54.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj118-1 td/osd-backfill-space/datafile 2024-05-08T18:53:55.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:55.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj118-2 td/osd-backfill-space/datafile 2024-05-08T18:53:55.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:55.468 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:55.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:55.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj119-1 td/osd-backfill-space/datafile 2024-05-08T18:53:55.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:55.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj119-2 td/osd-backfill-space/datafile 2024-05-08T18:53:55.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:55.988 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:55.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:55.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj120-1 td/osd-backfill-space/datafile 2024-05-08T18:53:56.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:56.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj120-2 td/osd-backfill-space/datafile 2024-05-08T18:53:56.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:56.477 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:56.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:56.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj121-1 td/osd-backfill-space/datafile 2024-05-08T18:53:56.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:56.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj121-2 td/osd-backfill-space/datafile 2024-05-08T18:53:57.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:57.029 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:57.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:57.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj122-1 td/osd-backfill-space/datafile 2024-05-08T18:53:57.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:57.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj122-2 td/osd-backfill-space/datafile 2024-05-08T18:53:57.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:57.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:57.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:57.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj123-1 td/osd-backfill-space/datafile 2024-05-08T18:53:57.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:57.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj123-2 td/osd-backfill-space/datafile 2024-05-08T18:53:58.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:58.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:58.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:58.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj124-1 td/osd-backfill-space/datafile 2024-05-08T18:53:58.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:58.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj124-2 td/osd-backfill-space/datafile 2024-05-08T18:53:58.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:58.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:58.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:58.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj125-1 td/osd-backfill-space/datafile 2024-05-08T18:53:59.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:59.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj125-2 td/osd-backfill-space/datafile 2024-05-08T18:53:59.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:59.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:59.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:59.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj126-1 td/osd-backfill-space/datafile 2024-05-08T18:53:59.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:59.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj126-2 td/osd-backfill-space/datafile 2024-05-08T18:53:59.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:53:59.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:53:59.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:53:59.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj127-1 td/osd-backfill-space/datafile 2024-05-08T18:54:00.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:00.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj127-2 td/osd-backfill-space/datafile 2024-05-08T18:54:00.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:00.523 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:00.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:00.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj128-1 td/osd-backfill-space/datafile 2024-05-08T18:54:00.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:00.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj128-2 td/osd-backfill-space/datafile 2024-05-08T18:54:01.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:01.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:01.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:01.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj129-1 td/osd-backfill-space/datafile 2024-05-08T18:54:01.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:01.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj129-2 td/osd-backfill-space/datafile 2024-05-08T18:54:01.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:01.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:01.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:01.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj130-1 td/osd-backfill-space/datafile 2024-05-08T18:54:01.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:01.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj130-2 td/osd-backfill-space/datafile 2024-05-08T18:54:02.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:02.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:02.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:02.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj131-1 td/osd-backfill-space/datafile 2024-05-08T18:54:02.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:02.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj131-2 td/osd-backfill-space/datafile 2024-05-08T18:54:02.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:02.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:02.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:02.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj132-1 td/osd-backfill-space/datafile 2024-05-08T18:54:02.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:02.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj132-2 td/osd-backfill-space/datafile 2024-05-08T18:54:03.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:03.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:03.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:03.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj133-1 td/osd-backfill-space/datafile 2024-05-08T18:54:03.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:03.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj133-2 td/osd-backfill-space/datafile 2024-05-08T18:54:03.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:03.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:03.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:03.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj134-1 td/osd-backfill-space/datafile 2024-05-08T18:54:03.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:03.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj134-2 td/osd-backfill-space/datafile 2024-05-08T18:54:04.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:04.132 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:04.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:04.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj135-1 td/osd-backfill-space/datafile 2024-05-08T18:54:04.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:04.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj135-2 td/osd-backfill-space/datafile 2024-05-08T18:54:04.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:04.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:04.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:04.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj136-1 td/osd-backfill-space/datafile 2024-05-08T18:54:04.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:04.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj136-2 td/osd-backfill-space/datafile 2024-05-08T18:54:05.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:05.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:05.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:05.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj137-1 td/osd-backfill-space/datafile 2024-05-08T18:54:05.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:05.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj137-2 td/osd-backfill-space/datafile 2024-05-08T18:54:05.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:05.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:05.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:05.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj138-1 td/osd-backfill-space/datafile 2024-05-08T18:54:05.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:05.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj138-2 td/osd-backfill-space/datafile 2024-05-08T18:54:06.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:06.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:06.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:06.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj139-1 td/osd-backfill-space/datafile 2024-05-08T18:54:06.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:06.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj139-2 td/osd-backfill-space/datafile 2024-05-08T18:54:06.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:06.685 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:06.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:06.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj140-1 td/osd-backfill-space/datafile 2024-05-08T18:54:06.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:06.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj140-2 td/osd-backfill-space/datafile 2024-05-08T18:54:07.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:07.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:07.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:07.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj141-1 td/osd-backfill-space/datafile 2024-05-08T18:54:07.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:07.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj141-2 td/osd-backfill-space/datafile 2024-05-08T18:54:07.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:07.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:07.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:07.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj142-1 td/osd-backfill-space/datafile 2024-05-08T18:54:07.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:07.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj142-2 td/osd-backfill-space/datafile 2024-05-08T18:54:08.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:08.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:08.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:08.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj143-1 td/osd-backfill-space/datafile 2024-05-08T18:54:08.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:08.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj143-2 td/osd-backfill-space/datafile 2024-05-08T18:54:08.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:08.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:08.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:08.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj144-1 td/osd-backfill-space/datafile 2024-05-08T18:54:09.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:09.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj144-2 td/osd-backfill-space/datafile 2024-05-08T18:54:09.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:09.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:09.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:09.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj145-1 td/osd-backfill-space/datafile 2024-05-08T18:54:09.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:09.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj145-2 td/osd-backfill-space/datafile 2024-05-08T18:54:09.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:09.809 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:09.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:09.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj146-1 td/osd-backfill-space/datafile 2024-05-08T18:54:10.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:10.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj146-2 td/osd-backfill-space/datafile 2024-05-08T18:54:10.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:10.280 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:10.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:10.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj147-1 td/osd-backfill-space/datafile 2024-05-08T18:54:10.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:10.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj147-2 td/osd-backfill-space/datafile 2024-05-08T18:54:10.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:10.809 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:10.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:10.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj148-1 td/osd-backfill-space/datafile 2024-05-08T18:54:11.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:11.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj148-2 td/osd-backfill-space/datafile 2024-05-08T18:54:11.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:11.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:11.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:11.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj149-1 td/osd-backfill-space/datafile 2024-05-08T18:54:11.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:11.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj149-2 td/osd-backfill-space/datafile 2024-05-08T18:54:11.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:11.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:11.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:11.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj150-1 td/osd-backfill-space/datafile 2024-05-08T18:54:12.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:12.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj150-2 td/osd-backfill-space/datafile 2024-05-08T18:54:12.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:12.346 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:12.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:12.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj151-1 td/osd-backfill-space/datafile 2024-05-08T18:54:12.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:12.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj151-2 td/osd-backfill-space/datafile 2024-05-08T18:54:12.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:12.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:12.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:12.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj152-1 td/osd-backfill-space/datafile 2024-05-08T18:54:13.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:13.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj152-2 td/osd-backfill-space/datafile 2024-05-08T18:54:13.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:13.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:13.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:13.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj153-1 td/osd-backfill-space/datafile 2024-05-08T18:54:13.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:13.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj153-2 td/osd-backfill-space/datafile 2024-05-08T18:54:13.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:13.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:13.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:13.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj154-1 td/osd-backfill-space/datafile 2024-05-08T18:54:14.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:14.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj154-2 td/osd-backfill-space/datafile 2024-05-08T18:54:14.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:14.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:14.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:14.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj155-1 td/osd-backfill-space/datafile 2024-05-08T18:54:14.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:14.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj155-2 td/osd-backfill-space/datafile 2024-05-08T18:54:14.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:14.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:14.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:14.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj156-1 td/osd-backfill-space/datafile 2024-05-08T18:54:15.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:15.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj156-2 td/osd-backfill-space/datafile 2024-05-08T18:54:15.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:15.488 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:15.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:15.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj157-1 td/osd-backfill-space/datafile 2024-05-08T18:54:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj157-2 td/osd-backfill-space/datafile 2024-05-08T18:54:16.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:16.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:16.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:16.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj158-1 td/osd-backfill-space/datafile 2024-05-08T18:54:16.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj158-2 td/osd-backfill-space/datafile 2024-05-08T18:54:16.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:16.521 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:16.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:16.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj159-1 td/osd-backfill-space/datafile 2024-05-08T18:54:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj159-2 td/osd-backfill-space/datafile 2024-05-08T18:54:17.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:17.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:17.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:17.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj160-1 td/osd-backfill-space/datafile 2024-05-08T18:54:17.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:17.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj160-2 td/osd-backfill-space/datafile 2024-05-08T18:54:17.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:17.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:17.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:17.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj161-1 td/osd-backfill-space/datafile 2024-05-08T18:54:17.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:17.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj161-2 td/osd-backfill-space/datafile 2024-05-08T18:54:18.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:18.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:18.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:18.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj162-1 td/osd-backfill-space/datafile 2024-05-08T18:54:18.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:18.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj162-2 td/osd-backfill-space/datafile 2024-05-08T18:54:18.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:18.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:18.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:18.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj163-1 td/osd-backfill-space/datafile 2024-05-08T18:54:18.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:18.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj163-2 td/osd-backfill-space/datafile 2024-05-08T18:54:19.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:19.168 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:19.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:19.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj164-1 td/osd-backfill-space/datafile 2024-05-08T18:54:19.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:19.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj164-2 td/osd-backfill-space/datafile 2024-05-08T18:54:19.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:19.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:19.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:19.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj165-1 td/osd-backfill-space/datafile 2024-05-08T18:54:19.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:19.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj165-2 td/osd-backfill-space/datafile 2024-05-08T18:54:20.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:20.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:20.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:20.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj166-1 td/osd-backfill-space/datafile 2024-05-08T18:54:20.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:20.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj166-2 td/osd-backfill-space/datafile 2024-05-08T18:54:20.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:20.661 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:20.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:20.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj167-1 td/osd-backfill-space/datafile 2024-05-08T18:54:20.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:20.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj167-2 td/osd-backfill-space/datafile 2024-05-08T18:54:21.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:21.191 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:21.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:21.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj168-1 td/osd-backfill-space/datafile 2024-05-08T18:54:21.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:21.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj168-2 td/osd-backfill-space/datafile 2024-05-08T18:54:21.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:21.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:21.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:21.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj169-1 td/osd-backfill-space/datafile 2024-05-08T18:54:21.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:21.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj169-2 td/osd-backfill-space/datafile 2024-05-08T18:54:22.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:22.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:22.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:22.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj170-1 td/osd-backfill-space/datafile 2024-05-08T18:54:22.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:22.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj170-2 td/osd-backfill-space/datafile 2024-05-08T18:54:22.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:22.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:22.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:22.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj171-1 td/osd-backfill-space/datafile 2024-05-08T18:54:22.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:22.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj171-2 td/osd-backfill-space/datafile 2024-05-08T18:54:23.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:23.250 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:23.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:23.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj172-1 td/osd-backfill-space/datafile 2024-05-08T18:54:23.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:23.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj172-2 td/osd-backfill-space/datafile 2024-05-08T18:54:23.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:23.712 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:23.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:23.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj173-1 td/osd-backfill-space/datafile 2024-05-08T18:54:23.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:23.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj173-2 td/osd-backfill-space/datafile 2024-05-08T18:54:24.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:24.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:24.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:24.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj174-1 td/osd-backfill-space/datafile 2024-05-08T18:54:24.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:24.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj174-2 td/osd-backfill-space/datafile 2024-05-08T18:54:24.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:24.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:24.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:24.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj175-1 td/osd-backfill-space/datafile 2024-05-08T18:54:25.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:25.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj175-2 td/osd-backfill-space/datafile 2024-05-08T18:54:25.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:25.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:25.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:25.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj176-1 td/osd-backfill-space/datafile 2024-05-08T18:54:25.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:25.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj176-2 td/osd-backfill-space/datafile 2024-05-08T18:54:25.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:25.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:25.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:25.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj177-1 td/osd-backfill-space/datafile 2024-05-08T18:54:26.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:26.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj177-2 td/osd-backfill-space/datafile 2024-05-08T18:54:26.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:26.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:26.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:26.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj178-1 td/osd-backfill-space/datafile 2024-05-08T18:54:26.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:26.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj178-2 td/osd-backfill-space/datafile 2024-05-08T18:54:26.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:26.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:26.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:26.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj179-1 td/osd-backfill-space/datafile 2024-05-08T18:54:27.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:27.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj179-2 td/osd-backfill-space/datafile 2024-05-08T18:54:27.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:27.315 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:27.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:27.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj180-1 td/osd-backfill-space/datafile 2024-05-08T18:54:27.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:27.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj180-2 td/osd-backfill-space/datafile 2024-05-08T18:54:27.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:27.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:27.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:27.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj181-1 td/osd-backfill-space/datafile 2024-05-08T18:54:28.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:28.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj181-2 td/osd-backfill-space/datafile 2024-05-08T18:54:28.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:28.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:28.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:28.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj182-1 td/osd-backfill-space/datafile 2024-05-08T18:54:28.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:28.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj182-2 td/osd-backfill-space/datafile 2024-05-08T18:54:28.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:28.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:28.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:28.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj183-1 td/osd-backfill-space/datafile 2024-05-08T18:54:29.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:29.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj183-2 td/osd-backfill-space/datafile 2024-05-08T18:54:29.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:29.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:29.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:29.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj184-1 td/osd-backfill-space/datafile 2024-05-08T18:54:29.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:29.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj184-2 td/osd-backfill-space/datafile 2024-05-08T18:54:30.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:30.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:30.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:30.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj185-1 td/osd-backfill-space/datafile 2024-05-08T18:54:30.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:30.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj185-2 td/osd-backfill-space/datafile 2024-05-08T18:54:30.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:30.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:30.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:30.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj186-1 td/osd-backfill-space/datafile 2024-05-08T18:54:31.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:31.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj186-2 td/osd-backfill-space/datafile 2024-05-08T18:54:31.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:31.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:31.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:31.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj187-1 td/osd-backfill-space/datafile 2024-05-08T18:54:31.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:31.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj187-2 td/osd-backfill-space/datafile 2024-05-08T18:54:31.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:31.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:31.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:31.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj188-1 td/osd-backfill-space/datafile 2024-05-08T18:54:31.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:31.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj188-2 td/osd-backfill-space/datafile 2024-05-08T18:54:32.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:32.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:32.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:32.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj189-1 td/osd-backfill-space/datafile 2024-05-08T18:54:32.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:32.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj189-2 td/osd-backfill-space/datafile 2024-05-08T18:54:32.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:32.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:32.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:32.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj190-1 td/osd-backfill-space/datafile 2024-05-08T18:54:33.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:33.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj190-2 td/osd-backfill-space/datafile 2024-05-08T18:54:33.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:33.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:33.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:33.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj191-1 td/osd-backfill-space/datafile 2024-05-08T18:54:33.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:33.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj191-2 td/osd-backfill-space/datafile 2024-05-08T18:54:33.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:33.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:33.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:33.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj192-1 td/osd-backfill-space/datafile 2024-05-08T18:54:33.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:33.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj192-2 td/osd-backfill-space/datafile 2024-05-08T18:54:34.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:34.289 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:34.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:34.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj193-1 td/osd-backfill-space/datafile 2024-05-08T18:54:34.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:34.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj193-2 td/osd-backfill-space/datafile 2024-05-08T18:54:34.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:34.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:34.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:34.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj194-1 td/osd-backfill-space/datafile 2024-05-08T18:54:35.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:35.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj194-2 td/osd-backfill-space/datafile 2024-05-08T18:54:35.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:35.296 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:35.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:35.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj195-1 td/osd-backfill-space/datafile 2024-05-08T18:54:35.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:35.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj195-2 td/osd-backfill-space/datafile 2024-05-08T18:54:35.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:35.894 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:35.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:35.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj196-1 td/osd-backfill-space/datafile 2024-05-08T18:54:36.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:36.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj196-2 td/osd-backfill-space/datafile 2024-05-08T18:54:36.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:36.555 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:36.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:36.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj197-1 td/osd-backfill-space/datafile 2024-05-08T18:54:36.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:36.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj197-2 td/osd-backfill-space/datafile 2024-05-08T18:54:37.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:37.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:37.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:37.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj198-1 td/osd-backfill-space/datafile 2024-05-08T18:54:37.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:37.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj198-2 td/osd-backfill-space/datafile 2024-05-08T18:54:37.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:37.453 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:37.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:37.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj199-1 td/osd-backfill-space/datafile 2024-05-08T18:54:37.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:37.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj199-2 td/osd-backfill-space/datafile 2024-05-08T18:54:37.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-05-08T18:54:37.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:37.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:37.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj200-1 td/osd-backfill-space/datafile 2024-05-08T18:54:37.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:37.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj200-2 td/osd-backfill-space/datafile 2024-05-08T18:54:38.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:814: TEST_ec_backfill_multi: ceph pg dump pgs 2024-05-08T18:54:38.470 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:54:38.470 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 193 0 0 0 0 2371584 0 0 93 100 93 active+clean 2024-05-08T18:52:39.878403+0000 53'193 53:210 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2024-05-08T18:52:36.854017+0000 0'0 2024-05-08T18:52:36.854017+0000 0 0 periodic scrub scheduled @ 2024-05-10T06:08:50.357480+0000 0 0 2024-05-08T18:54:38.470 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 194 0 0 0 0 2383872 0 0 94 100 94 active+clean 2024-05-08T18:52:37.738098+0000 53'194 53:220 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2024-05-08T18:52:35.186356+0000 0'0 2024-05-08T18:52:35.186356+0000 0 0 periodic scrub scheduled @ 2024-05-10T03:10:57.561273+0000 0 0 2024-05-08T18:54:38.471 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 100 active+clean 2024-05-08T18:52:14.042577+0000 41'200 53:242 [1] 1 [1] 1 0'0 2024-05-08T18:52:11.458368+0000 0'0 2024-05-08T18:52:11.458368+0000 0 0 periodic scrub scheduled @ 2024-05-10T01:22:29.155641+0000 0 0 2024-05-08T18:54:38.471 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:54:38.471 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:54:38.471 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:54:38.488 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:816: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:54:38.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:816: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:38.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:818: TEST_ec_backfill_multi: expr 1 + 1 2024-05-08T18:54:38.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:818: TEST_ec_backfill_multi: ceph osd pg-upmap 2.0 0 2 3 4 1 2024-05-08T18:54:39.610 INFO:tasks.workunit.client.0.smithi117.stderr:set 2.0 pg_upmap mapping to [0,2,3,4,1] 2024-05-08T18:54:39.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:816: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-05-08T18:54:39.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:818: TEST_ec_backfill_multi: expr 2 + 1 2024-05-08T18:54:39.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:818: TEST_ec_backfill_multi: ceph osd pg-upmap 3.0 0 2 3 4 1 2024-05-08T18:54:40.915 INFO:tasks.workunit.client.0.smithi117.stderr:set 3.0 pg_upmap mapping to [0,2,3,4,1] 2024-05-08T18:54:40.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:821: TEST_ec_backfill_multi: sleep 30 2024-05-08T18:55:10.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:823: TEST_ec_backfill_multi: wait_for_not_backfilling 1200 2024-05-08T18:55:10.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-05-08T18:55:10.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-05-08T18:55:10.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-05-08T18:55:10.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:55:10.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:55:10.944 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-05-08T18:55:10.945 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:55:10.945 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:55:10.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:55:10.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:55:10.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:55:11.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-05-08T18:55:11.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:55:11.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:55:11.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:55:11.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:55:11.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:55:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:55:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:55:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:55:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:55:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T18:55:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T18:55:12.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:55:12.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:12.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:55:12.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836553 2024-05-08T18:55:12.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836553 2024-05-08T18:55:12.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836553' 2024-05-08T18:55:12.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:12.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:55:12.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673031 2024-05-08T18:55:12.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673031 2024-05-08T18:55:12.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836553 1-42949673031' 2024-05-08T18:55:12.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:12.545 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:55:12.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509503 2024-05-08T18:55:12.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509503 2024-05-08T18:55:12.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836553 1-42949673031 2-64424509503' 2024-05-08T18:55:12.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:12.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:55:12.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345981 2024-05-08T18:55:12.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345981 2024-05-08T18:55:12.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836553 1-42949673031 2-64424509503 3-85899345981' 2024-05-08T18:55:12.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:12.873 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:55:13.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182450 2024-05-08T18:55:13.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182450 2024-05-08T18:55:13.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836553 1-42949673031 2-64424509503 3-85899345981 4-107374182450' 2024-05-08T18:55:13.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:13.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T18:55:13.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018924 2024-05-08T18:55:13.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018924 2024-05-08T18:55:13.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836553 1-42949673031 2-64424509503 3-85899345981 4-107374182450 5-128849018924' 2024-05-08T18:55:13.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:13.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836553 2024-05-08T18:55:13.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:13.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:55:13.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836553 2024-05-08T18:55:13.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:13.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836553 2024-05-08T18:55:13.199 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836553 2024-05-08T18:55:13.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836553' 2024-05-08T18:55:13.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:55:13.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836551 -lt 21474836553 2024-05-08T18:55:13.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:55:14.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:55:14.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:55:15.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836553 -lt 21474836553 2024-05-08T18:55:15.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:15.050 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:15.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673031 2024-05-08T18:55:15.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:55:15.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673031 2024-05-08T18:55:15.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:15.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673031 2024-05-08T18:55:15.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673031' 2024-05-08T18:55:15.054 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673031 2024-05-08T18:55:15.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:55:15.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673032 -lt 42949673031 2024-05-08T18:55:15.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:15.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:15.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509503 2024-05-08T18:55:15.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:55:15.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:15.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509503 2024-05-08T18:55:15.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509503 2024-05-08T18:55:15.539 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509503 2024-05-08T18:55:15.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509503' 2024-05-08T18:55:15.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:55:15.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509503 -lt 64424509503 2024-05-08T18:55:15.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:15.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:15.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345981 2024-05-08T18:55:15.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:55:15.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345981 2024-05-08T18:55:15.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:15.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345981 2024-05-08T18:55:15.957 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345981 2024-05-08T18:55:15.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345981' 2024-05-08T18:55:15.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:55:16.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345981 -lt 85899345981 2024-05-08T18:55:16.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:16.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182450 2024-05-08T18:55:16.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:16.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:55:16.422 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182450 2024-05-08T18:55:16.422 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:16.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182450 2024-05-08T18:55:16.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182450' 2024-05-08T18:55:16.423 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182450 2024-05-08T18:55:16.424 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:55:16.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182451 -lt 107374182450 2024-05-08T18:55:16.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:16.889 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018924 2024-05-08T18:55:16.889 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T18:55:16.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018924 2024-05-08T18:55:16.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:16.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018924 2024-05-08T18:55:16.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018924' 2024-05-08T18:55:16.893 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018924 2024-05-08T18:55:16.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T18:55:17.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018925 -lt 128849018924 2024-05-08T18:55:17.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:55:17.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:55:17.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:55:17.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 3 == 0 2024-05-08T18:55:17.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:55:17.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T18:55:17.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T18:55:17.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:55:17.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T18:55:17.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:55:17.955 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T18:55:18.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:55:18.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:55:18.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:55:18.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:55:18.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:824: TEST_ec_backfill_multi: wait_for_not_activating 60 2024-05-08T18:55:18.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-05-08T18:55:18.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-05-08T18:55:18.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-05-08T18:55:18.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T18:55:18.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T18:55:18.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-05-08T18:55:18.341 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T18:55:18.341 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T18:55:18.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T18:55:18.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T18:55:18.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T18:55:18.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-05-08T18:55:18.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T18:55:18.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T18:55:18.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T18:55:18.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T18:55:18.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T18:55:18.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T18:55:18.793 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T18:55:18.793 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T18:55:18.793 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T18:55:18.793 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T18:55:18.793 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T18:55:18.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T18:55:18.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:18.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T18:55:18.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836556 2024-05-08T18:55:18.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836556 2024-05-08T18:55:18.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556' 2024-05-08T18:55:18.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:18.988 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T18:55:19.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673035 2024-05-08T18:55:19.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673035 2024-05-08T18:55:19.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673035' 2024-05-08T18:55:19.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:19.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T18:55:19.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509506 2024-05-08T18:55:19.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509506 2024-05-08T18:55:19.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673035 2-64424509506' 2024-05-08T18:55:19.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:19.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T18:55:19.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345984 2024-05-08T18:55:19.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345984 2024-05-08T18:55:19.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673035 2-64424509506 3-85899345984' 2024-05-08T18:55:19.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:19.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T18:55:19.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182453 2024-05-08T18:55:19.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182453 2024-05-08T18:55:19.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673035 2-64424509506 3-85899345984 4-107374182453' 2024-05-08T18:55:19.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T18:55:19.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T18:55:19.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018928 2024-05-08T18:55:19.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018928 2024-05-08T18:55:19.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836556 1-42949673035 2-64424509506 3-85899345984 4-107374182453 5-128849018928' 2024-05-08T18:55:19.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:19.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836556 2024-05-08T18:55:19.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:19.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T18:55:19.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836556 2024-05-08T18:55:19.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:19.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836556 2024-05-08T18:55:19.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836556' 2024-05-08T18:55:19.783 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836556 2024-05-08T18:55:19.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:55:20.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836554 -lt 21474836556 2024-05-08T18:55:20.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T18:55:21.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T18:55:21.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T18:55:21.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836557 -lt 21474836556 2024-05-08T18:55:21.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:21.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673035 2024-05-08T18:55:21.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:21.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T18:55:21.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673035 2024-05-08T18:55:21.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:21.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673035 2024-05-08T18:55:21.624 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673035 2024-05-08T18:55:21.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673035' 2024-05-08T18:55:21.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T18:55:22.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673035 -lt 42949673035 2024-05-08T18:55:22.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:22.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509506 2024-05-08T18:55:22.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:22.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T18:55:22.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509506 2024-05-08T18:55:22.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:22.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509506 2024-05-08T18:55:22.108 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509506 2024-05-08T18:55:22.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509506' 2024-05-08T18:55:22.108 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T18:55:22.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509507 -lt 64424509506 2024-05-08T18:55:22.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:22.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345984 2024-05-08T18:55:22.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:22.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T18:55:22.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345984 2024-05-08T18:55:22.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:22.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345984 2024-05-08T18:55:22.543 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345984 2024-05-08T18:55:22.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345984' 2024-05-08T18:55:22.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T18:55:22.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345985 -lt 85899345984 2024-05-08T18:55:22.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:22.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182453 2024-05-08T18:55:22.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:22.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T18:55:22.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182453 2024-05-08T18:55:22.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:22.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182453 2024-05-08T18:55:22.974 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182453 2024-05-08T18:55:22.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182453' 2024-05-08T18:55:22.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T18:55:23.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182454 -lt 107374182453 2024-05-08T18:55:23.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T18:55:23.523 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018928 2024-05-08T18:55:23.523 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T18:55:23.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T18:55:23.523 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018928 2024-05-08T18:55:23.523 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T18:55:23.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018928 2024-05-08T18:55:23.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018928' 2024-05-08T18:55:23.524 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018928 2024-05-08T18:55:23.524 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T18:55:23.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018928 -lt 128849018928 2024-05-08T18:55:23.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T18:55:23.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T18:55:23.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T18:55:24.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 3 == 0 2024-05-08T18:55:24.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T18:55:24.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-05-08T18:55:24.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-05-08T18:55:24.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T18:55:24.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-05-08T18:55:24.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-05-08T18:55:24.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T18:55:24.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T18:55:24.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T18:55:24.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T18:55:24.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T18:55:24.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:826: TEST_ec_backfill_multi: ceph pg dump pgs 2024-05-08T18:55:25.331 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:55:25.331 INFO:tasks.workunit.client.0.smithi117.stdout:3.0 200 0 0 200 0 2457600 0 0 100 100 100 active+remapped+backfill_toofull 2024-05-08T18:55:11.968628+0000 56'200 69:263 [0,2,3,4,1] 0 [0,2,3,4,5] 0 0'0 2024-05-08T18:52:36.854017+0000 0'0 2024-05-08T18:52:36.854017+0000 0 0 no scrub is scheduled 0 0 2024-05-08T18:55:25.331 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 200 0 0 0 0 2457600 0 0 100 100 100 active+clean 2024-05-08T18:54:56.611268+0000 56'200 69:678 [0,2,3,4,1] 0 [0,2,3,4,1] 0 0'0 2024-05-08T18:52:35.186356+0000 0'0 2024-05-08T18:52:35.186356+0000 0 0 periodic scrub scheduled @ 2024-05-09T23:01:30.102821+0000 0 0 2024-05-08T18:55:25.331 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 100 active+clean 2024-05-08T18:52:14.042577+0000 41'200 69:273 [1] 1 [1] 1 0'0 2024-05-08T18:52:11.458368+0000 0'0 2024-05-08T18:52:11.458368+0000 0 0 periodic scrub scheduled @ 2024-05-10T00:05:44.301979+0000 0 0 2024-05-08T18:55:25.331 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:55:25.331 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:55:25.331 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:55:25.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:828: TEST_ec_backfill_multi: ERRORS=0 2024-05-08T18:55:25.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: ceph pg dump pgs 2024-05-08T18:55:25.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: grep +backfill_toofull 2024-05-08T18:55:25.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: grep -v '^1.0' 2024-05-08T18:55:25.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: wc -l 2024-05-08T18:55:25.747 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:55:25.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: '[' 1 '!=' 1 ']' 2024-05-08T18:55:25.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: ceph pg dump pgs 2024-05-08T18:55:25.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: grep -v '^1.0' 2024-05-08T18:55:25.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: grep active+clean 2024-05-08T18:55:25.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: wc -l 2024-05-08T18:55:26.143 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:55:26.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: '[' 1 '!=' 1 ']' 2024-05-08T18:55:26.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:841: TEST_ec_backfill_multi: '[' 0 '!=' 0 ']' 2024-05-08T18:55:26.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:846: TEST_ec_backfill_multi: delete_pool fillpool 2024-05-08T18:55:26.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=fillpool 2024-05-08T18:55:26.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2024-05-08T18:55:26.739 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'fillpool' does not exist 2024-05-08T18:55:26.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:847: TEST_ec_backfill_multi: seq 1 2 2024-05-08T18:55:26.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:847: TEST_ec_backfill_multi: for i in $(seq 1 $pools) 2024-05-08T18:55:26.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:849: TEST_ec_backfill_multi: delete_pool test1 2024-05-08T18:55:26.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test1 2024-05-08T18:55:26.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-05-08T18:55:27.318 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' does not exist 2024-05-08T18:55:27.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:847: TEST_ec_backfill_multi: for i in $(seq 1 $pools) 2024-05-08T18:55:27.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:849: TEST_ec_backfill_multi: delete_pool test2 2024-05-08T18:55:27.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test2 2024-05-08T18:55:27.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-05-08T18:55:28.003 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test2' does not exist 2024-05-08T18:55:28.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:851: TEST_ec_backfill_multi: kill_daemons td/osd-backfill-space 2024-05-08T18:55:28.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:55:28.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:55:28.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:55:28.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:55:28.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:55:33.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:55:33.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-05-08T18:55:33.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:55:33.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:55:33.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:55:33.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:55:33.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:55:33.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:55:33.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:55:33.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:55:33.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:55:33.352 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:55:33.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:55:33.353 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:55:33.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:55:33.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:55:33.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:55:33.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:55:33.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:55:33.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:55:33.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:55:33.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:55:33.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:55:33.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:55:33.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:55:33.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:55:33.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:55:33.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-space 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-space 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T18:55:33.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T18:55:33.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T18:55:33.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T18:55:33.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T18:55:33.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T18:55:33.427 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T18:55:33.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T18:55:33.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T18:55:33.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T18:55:33.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T18:55:33.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T18:55:33.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:55:33.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T18:55:33.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T18:55:33.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:55:33.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:55:33.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T18:55:33.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T18:55:33.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T18:55:33.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:55:33.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:55:33.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T18:55:33.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T18:55:33.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T18:55:33.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-space 2024-05-08T18:55:33.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T18:55:33.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:55:33.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:55:33.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.109971 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_ec_backfill_simple td/osd-backfill-space 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:624: TEST_ec_backfill_simple: local dir=td/osd-backfill-space 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:625: TEST_ec_backfill_simple: local EC= 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:626: TEST_ec_backfill_simple: local pools=1 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:627: TEST_ec_backfill_simple: local OSDS=6 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:628: TEST_ec_backfill_simple: local k=3 2024-05-08T18:55:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:629: TEST_ec_backfill_simple: local m=2 2024-05-08T18:55:33.439 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:630: TEST_ec_backfill_simple: expr 600 / 3 2024-05-08T18:55:33.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:630: TEST_ec_backfill_simple: local ecobjects=200 2024-05-08T18:55:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:632: TEST_ec_backfill_simple: run_mon td/osd-backfill-space a 2024-05-08T18:55:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-space 2024-05-08T18:55:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T18:55:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T18:55:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T18:55:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-space/a 2024-05-08T18:55:33.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-05-08T18:55:33.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T18:55:33.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:55:33.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:55:33.821 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:55:33.821 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:55:33.821 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:55:33.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:55:33.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T18:55:34.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T18:55:34.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T18:55:34.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:55:34.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:55:34.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T18:55:34.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T18:55:34.043 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:55:34.043 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:55:34.043 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:55:34.044 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:55:34.044 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:55:34.044 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:55:34.044 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:55:34.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:55:34.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get fsid 2024-05-08T18:55:34.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T18:55:34.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T18:55:34.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T18:55:34.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T18:55:34.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T18:55:34.162 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T18:55:34.162 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T18:55:34.163 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T18:55:34.163 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T18:55:34.163 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:55:34.163 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:55:34.163 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.109971/ceph-mon.a.asok 2024-05-08T18:55:34.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T18:55:34.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.109971/ceph-mon.a.asok config get mon_host 2024-05-08T18:55:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:633: TEST_ec_backfill_simple: run_mgr td/osd-backfill-space x 2024-05-08T18:55:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-space 2024-05-08T18:55:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T18:55:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T18:55:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T18:55:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-space/x 2024-05-08T18:55:34.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T18:55:35.186 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T18:55:35.186 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:55:35.186 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:55:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:55:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:55:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:55:35.186 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:55:35.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:55:35.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T18:55:35.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:634: TEST_ec_backfill_simple: export CEPH_ARGS 2024-05-08T18:55:35.221 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: expr 6 - 1 2024-05-08T18:55:35.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: seq 0 5 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 0 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/0 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:55:35.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:55:35.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:55:35.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/0 2024-05-08T18:55:35.228 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:55:35.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=eed70f25-cbd0-49ad-a45b-d5a72d3eb309 2024-05-08T18:55:35.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 eed70f25-cbd0-49ad-a45b-d5a72d3eb309' 2024-05-08T18:55:35.228 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 eed70f25-cbd0-49ad-a45b-d5a72d3eb309 2024-05-08T18:55:35.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:55:35.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCnyjtmGZ4JDxAAR/i/up2cOpOzyT1ao1Er2Q== 2024-05-08T18:55:35.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCnyjtmGZ4JDxAAR/i/up2cOpOzyT1ao1Er2Q=="}' 2024-05-08T18:55:35.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new eed70f25-cbd0-49ad-a45b-d5a72d3eb309 -i td/osd-backfill-space/0/new.json 2024-05-08T18:55:35.549 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:55:35.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/0/new.json 2024-05-08T18:55:35.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCnyjtmGZ4JDxAAR/i/up2cOpOzyT1ao1Er2Q== --osd-uuid eed70f25-cbd0-49ad-a45b-d5a72d3eb309 2024-05-08T18:55:35.598 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:35.596+0000 7f0310d3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:55:35.611 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:35.612+0000 7f0310d3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:55:35.612 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:35.612+0000 7f0310d3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:55:35.612 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:35.612+0000 7f0310d3a7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:55:35.613 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:35.612+0000 7f0310d3a7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:55:35.613 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:35.612+0000 7f0310d3a7c0 -1 bluestore(td/osd-backfill-space/0/block) _read_bdev_label failed to open td/osd-backfill-space/0/block: (2) No such file or directory 2024-05-08T18:55:35.642 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:35.644+0000 7f0310d3a7c0 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-05-08T18:55:41.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-05-08T18:55:41.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:55:41.438 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T18:55:41.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T18:55:41.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:55:42.009 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T18:55:42.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T18:55:42.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:55:42.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:55:42.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:55:42.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:55:42.049 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:42.048+0000 7fb27bc637c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:55:42.051 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:42.052+0000 7fb27bc637c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:55:42.053 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:42.052+0000 7fb27bc637c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:55:42.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T18:55:42.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:55:42.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T18:55:42.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:55:42.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:55:42.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:42.458 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:55:42.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:55:42.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:42.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:42.595 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:42.596+0000 7fb27bc637c0 -1 Falling back to public interface 2024-05-08T18:55:42.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:43.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:43.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:43.938 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:55:43.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:55:43.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:43.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:44.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:45.098 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:55:45.096+0000 7fb27bc637c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:55:45.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:45.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:45.423 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:55:45.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:55:45.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:45.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:45.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:46.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:46.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:46.855 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:55:46.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:55:46.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:46.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:47.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:48.333 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:55:48.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:55:48.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:48.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:48.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:49.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:49.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:49.808 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:55:49.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:55:49.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:49.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:50.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:51.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:51.226 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:55:51.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:51.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:55:51.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:51.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:51.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:52.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:52.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:52.667 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:55:52.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:55:52.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:52.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:53.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:54.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:54.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:54.114 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:55:54.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:55:54.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:54.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:54.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:55.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:55.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:55.584 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:55:55.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:55:55.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:55.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:56.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:57.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:57.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:57.133 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:55:57.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:55:57.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:57.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:57.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:55:58.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:55:58.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:55:58.692 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:55:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:55:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:55:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:55:59.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:00.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:00.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:00.432 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:56:00.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:56:00.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:00.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:56:01.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:02.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:02.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:02.407 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:56:02.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:56:02.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:02.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:56:03.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:04.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:56:04.376 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:56:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:56:05.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:06.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:06.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:06.072 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:56:06.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:56:06.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:06.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:56:06.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:07.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:07.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:07.527 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:56:07.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:56:07.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:07.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T18:56:07.986 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1351650500,v1:127.0.0.1:6803/1351650500] [v2:127.0.0.1:6804/1351650500,v1:127.0.0.1:6805/1351650500] exists,up eed70f25-cbd0-49ad-a45b-d5a72d3eb309 2024-05-08T18:56:07.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 1 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:56:07.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:56:07.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:56:07.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T18:56:07.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:56:07.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c8e04653-6b78-4b09-8e54-89402e70838c 2024-05-08T18:56:07.994 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 c8e04653-6b78-4b09-8e54-89402e70838c 2024-05-08T18:56:07.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 c8e04653-6b78-4b09-8e54-89402e70838c' 2024-05-08T18:56:07.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:56:08.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDIyjtmNScJARAAEdn0H6JQcfShMlF7Kd0z7w== 2024-05-08T18:56:08.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDIyjtmNScJARAAEdn0H6JQcfShMlF7Kd0z7w=="}' 2024-05-08T18:56:08.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c8e04653-6b78-4b09-8e54-89402e70838c -i td/osd-backfill-space/1/new.json 2024-05-08T18:56:08.598 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:56:08.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/1/new.json 2024-05-08T18:56:08.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDIyjtmNScJARAAEdn0H6JQcfShMlF7Kd0z7w== --osd-uuid c8e04653-6b78-4b09-8e54-89402e70838c 2024-05-08T18:56:08.658 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:08.655+0000 7f2256b7e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:08.660 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:08.659+0000 7f2256b7e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:08.662 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:08.659+0000 7f2256b7e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:08.662 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:08.659+0000 7f2256b7e7c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:56:08.663 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:08.663+0000 7f2256b7e7c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:56:08.663 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:08.663+0000 7f2256b7e7c0 -1 bluestore(td/osd-backfill-space/1/block) _read_bdev_label failed to open td/osd-backfill-space/1/block: (2) No such file or directory 2024-05-08T18:56:08.707 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:08.707+0000 7f2256b7e7c0 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-05-08T18:56:14.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-05-08T18:56:14.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:56:14.500 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T18:56:14.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T18:56:14.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:56:15.064 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T18:56:15.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T18:56:15.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:56:15.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:56:15.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:56:15.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:56:15.103 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:15.103+0000 7fa544f927c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:15.105 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:15.103+0000 7fa544f927c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:15.106 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:15.107+0000 7fa544f927c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:15.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T18:56:15.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:56:15.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T18:56:15.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:56:15.483 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:56:15.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:56:15.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:15.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:56:15.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:15.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:15.652 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:15.651+0000 7fa544f927c0 -1 Falling back to public interface 2024-05-08T18:56:15.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:56:16.891 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:56:16.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:16.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:17.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:18.170 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:18.167+0000 7fa544f927c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:56:18.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:18.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:18.302 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:56:18.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:56:18.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:18.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:18.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:19.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:19.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:19.858 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:56:19.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:56:19.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:19.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:20.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:21.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:21.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:21.323 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:56:21.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:56:21.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:21.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:21.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:22.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:22.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:22.770 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:56:22.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:56:22.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:22.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:23.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:24.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:24.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:24.274 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:56:24.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:56:24.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:24.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:24.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:25.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:25.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:25.808 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:56:25.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:56:25.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:25.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:26.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:27.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:27.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:27.395 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:56:27.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:56:27.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:27.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:27.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:28.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:28.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:28.828 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:56:28.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:56:28.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:28.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:29.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:30.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:30.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:30.324 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:56:30.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:56:30.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:30.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:31.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:32.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:32.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:32.346 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:56:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:56:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:33.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:34.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:34.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:34.101 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:56:34.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:56:34.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:34.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:34.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:35.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:35.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:35.977 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:56:35.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:56:35.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:35.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:36.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:37.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:37.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:37.768 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:56:37.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:56:37.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:37.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:38.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:39.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:39.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:39.370 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:56:39.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:56:39.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:39.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:40.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:41.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:41.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:41.185 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:56:41.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:56:41.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:41.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T18:56:41.616 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3174975096,v1:127.0.0.1:6811/3174975096] [v2:127.0.0.1:6812/3174975096,v1:127.0.0.1:6813/3174975096] exists,up c8e04653-6b78-4b09-8e54-89402e70838c 2024-05-08T18:56:41.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:56:41.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:56:41.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:56:41.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:56:41.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 2 2024-05-08T18:56:41.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:56:41.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:56:41.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T18:56:41.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:56:41.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/2 2024-05-08T18:56:41.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:56:41.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:56:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/2 2024-05-08T18:56:41.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:56:41.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=caf3625d-b126-4972-a2a5-c609e0b6a8cb 2024-05-08T18:56:41.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 caf3625d-b126-4972-a2a5-c609e0b6a8cb' 2024-05-08T18:56:41.627 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 caf3625d-b126-4972-a2a5-c609e0b6a8cb 2024-05-08T18:56:41.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:56:41.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDpyjtmc0wUJxAA+s5/RXCpx4NoAUWhCF5/6A== 2024-05-08T18:56:41.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDpyjtmc0wUJxAA+s5/RXCpx4NoAUWhCF5/6A=="}' 2024-05-08T18:56:41.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new caf3625d-b126-4972-a2a5-c609e0b6a8cb -i td/osd-backfill-space/2/new.json 2024-05-08T18:56:42.244 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:56:42.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/2/new.json 2024-05-08T18:56:42.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDpyjtmc0wUJxAA+s5/RXCpx4NoAUWhCF5/6A== --osd-uuid caf3625d-b126-4972-a2a5-c609e0b6a8cb 2024-05-08T18:56:42.300 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:42.299+0000 7f139f7457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:42.313 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:42.311+0000 7f139f7457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:42.314 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:42.315+0000 7f139f7457c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:42.315 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:42.315+0000 7f139f7457c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:56:42.315 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:42.315+0000 7f139f7457c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:56:42.315 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:42.315+0000 7f139f7457c0 -1 bluestore(td/osd-backfill-space/2/block) _read_bdev_label failed to open td/osd-backfill-space/2/block: (2) No such file or directory 2024-05-08T18:56:42.420 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:42.419+0000 7f139f7457c0 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-05-08T18:56:47.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-05-08T18:56:47.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:56:47.950 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T18:56:47.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T18:56:47.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:56:48.562 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T18:56:48.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T18:56:48.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:56:48.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:56:48.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:56:48.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:56:48.601 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:48.599+0000 7f6b9813c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:48.625 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:48.623+0000 7f6b9813c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:48.627 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:48.627+0000 7f6b9813c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:56:48.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T18:56:48.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:56:48.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T18:56:48.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:56:48.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:56:48.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:48.971 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:56:48.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:56:48.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:48.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:56:49.185 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:49.183+0000 7f6b9813c7c0 -1 Falling back to public interface 2024-05-08T18:56:49.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:50.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:50.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:50.396 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:56:50.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:56:50.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:50.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:56:50.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:51.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:56:51.699+0000 7f6b9813c7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:56:51.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:51.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:51.802 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:56:51.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:56:51.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:51.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:56:52.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:53.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:53.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:53.385 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:56:53.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:56:53.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:53.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:56:53.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:54.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:54.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:54.834 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:56:54.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:56:54.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:54.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:56:55.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:56.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:56.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:56.289 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:56:56.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:56:56.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:56.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:56:56.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:57.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:57.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:57.762 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:56:57.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:56:57.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:57.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:56:58.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:56:59.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:56:59.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:56:59.192 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:56:59.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:56:59.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:56:59.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:56:59.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:00.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:00.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:00.635 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:57:00.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:57:00.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:00.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:01.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:02.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:02.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:02.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:57:02.136 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:57:02.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:02.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:02.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:03.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:03.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:03.654 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:57:03.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:57:03.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:03.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:04.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:05.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:05.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:05.229 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:57:05.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:57:05.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:05.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:05.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:06.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:06.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:06.874 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:57:06.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:57:06.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:06.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:07.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:08.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:08.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:08.562 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:57:08.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:57:08.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:08.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:09.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:10.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:10.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:10.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:57:10.491 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:57:10.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:10.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:11.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:12.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:12.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:12.490 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:57:12.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:57:12.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:12.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:13.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:14.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:14.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:14.396 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:57:14.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:57:14.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:14.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T18:57:14.835 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1737486537,v1:127.0.0.1:6819/1737486537] [v2:127.0.0.1:6820/1737486537,v1:127.0.0.1:6821/1737486537] exists,up caf3625d-b126-4972-a2a5-c609e0b6a8cb 2024-05-08T18:57:14.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 3 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/3 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:57:14.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:57:14.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:57:14.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:57:14.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:57:14.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:57:14.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:57:14.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:57:14.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:57:14.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:57:14.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:57:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:57:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:57:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:57:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:57:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/3 2024-05-08T18:57:14.842 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:57:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=d7e386fe-c45b-49ef-9393-f4d5d0e19877 2024-05-08T18:57:14.842 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 d7e386fe-c45b-49ef-9393-f4d5d0e19877 2024-05-08T18:57:14.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 d7e386fe-c45b-49ef-9393-f4d5d0e19877' 2024-05-08T18:57:14.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:57:14.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAKyztmn7jvMxAA4oRgsMZSWngHUOhcganEVA== 2024-05-08T18:57:14.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAKyztmn7jvMxAA4oRgsMZSWngHUOhcganEVA=="}' 2024-05-08T18:57:14.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new d7e386fe-c45b-49ef-9393-f4d5d0e19877 -i td/osd-backfill-space/3/new.json 2024-05-08T18:57:15.443 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:57:15.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/3/new.json 2024-05-08T18:57:15.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAKyztmn7jvMxAA4oRgsMZSWngHUOhcganEVA== --osd-uuid d7e386fe-c45b-49ef-9393-f4d5d0e19877 2024-05-08T18:57:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:15.506+0000 7f18bc2187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:15.524 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:15.526+0000 7f18bc2187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:15.526 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:15.526+0000 7f18bc2187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:15.527 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:15.530+0000 7f18bc2187c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:57:15.527 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:15.530+0000 7f18bc2187c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:57:15.527 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:15.530+0000 7f18bc2187c0 -1 bluestore(td/osd-backfill-space/3/block) _read_bdev_label failed to open td/osd-backfill-space/3/block: (2) No such file or directory 2024-05-08T18:57:15.616 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:15.618+0000 7f18bc2187c0 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-05-08T18:57:21.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-05-08T18:57:21.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:57:21.469 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T18:57:21.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T18:57:21.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:57:22.032 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T18:57:22.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T18:57:22.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:57:22.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:57:22.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:57:22.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:57:22.071 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:22.074+0000 7f582116b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:22.090 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:22.090+0000 7f582116b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:22.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:22.094+0000 7f582116b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:22.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T18:57:22.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:57:22.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T18:57:22.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:57:22.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:57:22.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:22.555 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:57:22.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:57:22.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:22.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:22.657 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:22.658+0000 7f582116b7c0 -1 Falling back to public interface 2024-05-08T18:57:22.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:23.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:23.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:23.962 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:57:23.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:57:23.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:23.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:24.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:25.188 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:25.190+0000 7f582116b7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T18:57:25.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:25.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:25.413 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:57:25.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:57:25.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:25.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:25.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:26.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:26.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:26.965 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:57:26.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:57:26.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:26.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:27.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:28.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:28.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:28.440 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:57:28.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:57:28.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:28.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:29.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:30.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:30.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:30.062 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:57:30.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:57:30.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:30.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:30.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:31.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:31.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:31.593 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:57:31.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:57:31.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:31.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:32.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:33.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:33.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:33.160 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:57:33.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:57:33.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:33.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:33.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:34.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:34.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:34.602 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:57:34.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:57:34.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:34.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:35.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:36.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:36.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:36.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:57:36.061 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:57:36.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:36.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:36.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:37.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:37.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:37.575 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:57:37.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:57:37.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:37.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:38.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:39.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:39.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:39.423 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:57:39.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:57:39.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:39.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:40.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:41.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:41.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:41.120 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:57:41.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:57:41.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:41.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:41.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:42.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:42.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:42.850 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:57:42.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:57:42.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:42.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:43.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:44.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:44.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:44.553 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:57:44.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:57:44.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:44.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:45.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:46.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:46.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:46.581 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:57:46.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:57:46.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:46.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:47.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:48.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:48.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:48.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:57:48.537 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:57:48.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:48.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T18:57:49.015 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1253220562,v1:127.0.0.1:6827/1253220562] [v2:127.0.0.1:6828/1253220562,v1:127.0.0.1:6829/1253220562] exists,up d7e386fe-c45b-49ef-9393-f4d5d0e19877 2024-05-08T18:57:49.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:57:49.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:57:49.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:57:49.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:57:49.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 4 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/4 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:57:49.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:57:49.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:57:49.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:57:49.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:57:49.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:57:49.019 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:57:49.019 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:57:49.019 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:57:49.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:57:49.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:57:49.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/4 2024-05-08T18:57:49.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:57:49.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ec57de21-95d8-4f9c-aa75-cd9c279860a2 2024-05-08T18:57:49.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 ec57de21-95d8-4f9c-aa75-cd9c279860a2' 2024-05-08T18:57:49.022 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 ec57de21-95d8-4f9c-aa75-cd9c279860a2 2024-05-08T18:57:49.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:57:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAtyztmOMA+AxAAHvHsWY4dabcqzepaM/36Hw== 2024-05-08T18:57:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAtyztmOMA+AxAAHvHsWY4dabcqzepaM/36Hw=="}' 2024-05-08T18:57:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ec57de21-95d8-4f9c-aa75-cd9c279860a2 -i td/osd-backfill-space/4/new.json 2024-05-08T18:57:49.624 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:57:49.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/4/new.json 2024-05-08T18:57:49.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAtyztmOMA+AxAAHvHsWY4dabcqzepaM/36Hw== --osd-uuid ec57de21-95d8-4f9c-aa75-cd9c279860a2 2024-05-08T18:57:49.682 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:49.686+0000 7f7deed337c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:49.685 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:49.686+0000 7f7deed337c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:49.686 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:49.686+0000 7f7deed337c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:49.686 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:49.690+0000 7f7deed337c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:57:49.686 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:49.690+0000 7f7deed337c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:57:49.686 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:49.690+0000 7f7deed337c0 -1 bluestore(td/osd-backfill-space/4/block) _read_bdev_label failed to open td/osd-backfill-space/4/block: (2) No such file or directory 2024-05-08T18:57:49.723 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:49.726+0000 7f7deed337c0 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-05-08T18:57:55.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-05-08T18:57:55.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:57:55.547 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T18:57:55.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T18:57:55.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:57:56.110 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T18:57:56.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T18:57:56.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:57:56.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:57:56.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:57:56.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:57:56.148 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:56.149+0000 7faa9480e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:56.155 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:56.157+0000 7faa9480e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:56.156 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:56.157+0000 7faa9480e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:57:56.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T18:57:56.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:57:56.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T18:57:56.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:57:56.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:57:56.553 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:57:56.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:56.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:57:56.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:56.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:57:56.720 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:56.721+0000 7faa9480e7c0 -1 Falling back to public interface 2024-05-08T18:57:56.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:57.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:57.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:57.971 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:57:57.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:57:57.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:57.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:57:58.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:57:59.218 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:57:59.217+0000 7faa9480e7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T18:57:59.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:57:59.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:57:59.397 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:57:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:57:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:57:59.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:57:59.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:00.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:00.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:00.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:58:00.890 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:58:00.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:00.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:01.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:02.317 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:58:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:58:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:02.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:03.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:03.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:03.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:58:03.755 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:58:03.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:03.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:04.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:05.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:05.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:05.238 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:58:05.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:58:05.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:05.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:05.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:06.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:06.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:06.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:58:06.677 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:58:06.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:06.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:07.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:08.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:08.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:08.141 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:58:08.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:58:08.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:08.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:08.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:09.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:09.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:09.635 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:58:09.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:58:09.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:09.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:10.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:11.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:11.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:11.348 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:58:11.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:58:11.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:11.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:11.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:12.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:12.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:12.770 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:58:12.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:58:12.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:12.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:13.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:14.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:14.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:14.338 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:58:14.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:58:14.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:14.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:15.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:16.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:16.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:16.059 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:58:16.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:58:16.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:16.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:17.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:18.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:18.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:18.219 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:58:18.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:58:18.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:18.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:18.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:19.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:19.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:19.943 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:58:19.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:58:19.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:19.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:20.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:21.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:21.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:21.457 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:58:21.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:58:21.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:21.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:22.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:23.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:23.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:23.076 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:58:23.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:58:23.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:23.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T18:58:23.523 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/626808392,v1:127.0.0.1:6835/626808392] [v2:127.0.0.1:6836/626808392,v1:127.0.0.1:6837/626808392] exists,up ec57de21-95d8-4f9c-aa75-cd9c279860a2 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 5 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-space 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T18:58:23.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-space/5 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T18:58:23.528 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T18:58:23.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T18:58:23.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-space/5 2024-05-08T18:58:23.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T18:58:23.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9dd9093b-275c-4d96-8807-f509642725ca 2024-05-08T18:58:23.530 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 9dd9093b-275c-4d96-8807-f509642725ca 2024-05-08T18:58:23.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 9dd9093b-275c-4d96-8807-f509642725ca' 2024-05-08T18:58:23.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T18:58:23.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBPyztmRYhdIRAAQcdQdBvpCmcbni172ksapA== 2024-05-08T18:58:23.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBPyztmRYhdIRAAQcdQdBvpCmcbni172ksapA=="}' 2024-05-08T18:58:23.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9dd9093b-275c-4d96-8807-f509642725ca -i td/osd-backfill-space/5/new.json 2024-05-08T18:58:24.164 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:58:24.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-space/5/new.json 2024-05-08T18:58:24.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBPyztmRYhdIRAAQcdQdBvpCmcbni172ksapA== --osd-uuid 9dd9093b-275c-4d96-8807-f509642725ca 2024-05-08T18:58:24.222 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:24.225+0000 7fb9a83e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:58:24.230 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:24.229+0000 7fb9a83e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:58:24.230 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:24.229+0000 7fb9a83e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:58:24.230 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:24.229+0000 7fb9a83e07c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:58:24.230 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:24.229+0000 7fb9a83e07c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:58:24.230 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:24.229+0000 7fb9a83e07c0 -1 bluestore(td/osd-backfill-space/5/block) _read_bdev_label failed to open td/osd-backfill-space/5/block: (2) No such file or directory 2024-05-08T18:58:24.311 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:24.313+0000 7fb9a83e07c0 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2024-05-08T18:58:30.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2024-05-08T18:58:30.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T18:58:30.349 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T18:58:30.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T18:58:30.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T18:58:30.919 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T18:58:30.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T18:58:30.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T18:58:30.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T18:58:30.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T18:58:30.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T18:58:30.958 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:30.961+0000 7f64051ff7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:58:30.969 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:30.969+0000 7f64051ff7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:58:30.970 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:30.973+0000 7f64051ff7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T18:58:31.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T18:58:31.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T18:58:31.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T18:58:31.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T18:58:31.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T18:58:31.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:31.322 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T18:58:31.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T18:58:31.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:31.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:31.543 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:31.545+0000 7f64051ff7c0 -1 Falling back to public interface 2024-05-08T18:58:31.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:32.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:32.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:32.759 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T18:58:32.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T18:58:32.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:32.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:33.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:34.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T18:58:34.093+0000 7f64051ff7c0 -1 osd.5 0 log_to_monitors true 2024-05-08T18:58:34.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:34.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:34.184 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T18:58:34.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T18:58:34.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:34.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:34.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:35.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:35.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:35.787 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T18:58:35.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T18:58:35.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:35.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:36.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:37.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:37.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:37.261 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T18:58:37.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T18:58:37.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:37.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:37.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:38.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:38.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:38.697 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T18:58:38.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T18:58:38.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:38.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:39.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:40.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:40.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:40.230 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T18:58:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T18:58:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:40.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:40.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:41.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:41.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:41.749 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T18:58:41.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T18:58:41.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:41.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:42.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:43.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:43.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:43.234 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T18:58:43.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T18:58:43.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:43.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:43.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:44.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:44.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:44.693 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T18:58:44.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T18:58:44.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:44.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:45.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:46.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:46.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:46.242 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T18:58:46.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T18:58:46.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:46.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:46.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:47.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:47.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:47.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T18:58:47.689 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T18:58:47.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:47.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:48.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:49.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:49.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:49.734 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T18:58:49.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T18:58:49.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:49.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:50.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:51.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:51.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:51.485 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T18:58:51.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T18:58:51.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:51.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:52.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:53.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:53.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:53.137 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T18:58:53.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T18:58:53.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:53.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:53.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:54.846 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T18:58:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T18:58:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:55.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:56.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:56.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:56.507 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T18:58:56.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T18:58:56.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:56.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:57.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T18:58:58.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T18:58:58.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T18:58:58.297 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T18:58:58.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T18:58:58.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T18:58:58.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T18:58:58.834 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/665832928,v1:127.0.0.1:6843/665832928] [v2:127.0.0.1:6844/665832928,v1:127.0.0.1:6845/665832928] exists,up 9dd9093b-275c-4d96-8807-f509642725ca 2024-05-08T18:58:58.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T18:58:58.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T18:58:58.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T18:58:58.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:641: TEST_ec_backfill_simple: ceph osd set-backfillfull-ratio .85 2024-05-08T18:58:59.566 INFO:tasks.workunit.client.0.smithi117.stderr:osd set-backfillfull-ratio 0.85 2024-05-08T18:58:59.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:642: TEST_ec_backfill_simple: create_pool fillpool 1 1 2024-05-08T18:58:59.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create fillpool 1 1 2024-05-08T18:59:00.253 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'fillpool' already exists 2024-05-08T18:59:00.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T18:59:01.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:643: TEST_ec_backfill_simple: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2024-05-08T18:59:02.130 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T18:59:02.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:652: TEST_ec_backfill_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=13 2024-05-08T18:59:02.156 INFO:tasks.workunit.client.0.smithi117.stderr:13+0 records in 2024-05-08T18:59:02.156 INFO:tasks.workunit.client.0.smithi117.stderr:13+0 records out 2024-05-08T18:59:02.156 INFO:tasks.workunit.client.0.smithi117.stderr:13312 bytes (13 kB, 13 KiB) copied, 0.00037308 s, 35.7 MB/s 2024-05-08T18:59:02.156 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: seq 1 200 2024-05-08T18:59:02.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:02.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj1 td/osd-backfill-space/datafile 2024-05-08T18:59:02.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:02.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj2 td/osd-backfill-space/datafile 2024-05-08T18:59:02.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:02.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj3 td/osd-backfill-space/datafile 2024-05-08T18:59:02.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:02.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj4 td/osd-backfill-space/datafile 2024-05-08T18:59:03.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj5 td/osd-backfill-space/datafile 2024-05-08T18:59:03.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj6 td/osd-backfill-space/datafile 2024-05-08T18:59:03.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj7 td/osd-backfill-space/datafile 2024-05-08T18:59:03.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj8 td/osd-backfill-space/datafile 2024-05-08T18:59:03.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj9 td/osd-backfill-space/datafile 2024-05-08T18:59:03.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj10 td/osd-backfill-space/datafile 2024-05-08T18:59:03.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj11 td/osd-backfill-space/datafile 2024-05-08T18:59:03.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj12 td/osd-backfill-space/datafile 2024-05-08T18:59:03.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:03.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj13 td/osd-backfill-space/datafile 2024-05-08T18:59:04.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj14 td/osd-backfill-space/datafile 2024-05-08T18:59:04.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj15 td/osd-backfill-space/datafile 2024-05-08T18:59:04.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj16 td/osd-backfill-space/datafile 2024-05-08T18:59:04.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj17 td/osd-backfill-space/datafile 2024-05-08T18:59:04.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj18 td/osd-backfill-space/datafile 2024-05-08T18:59:04.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj19 td/osd-backfill-space/datafile 2024-05-08T18:59:04.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj20 td/osd-backfill-space/datafile 2024-05-08T18:59:04.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj21 td/osd-backfill-space/datafile 2024-05-08T18:59:04.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj22 td/osd-backfill-space/datafile 2024-05-08T18:59:04.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:04.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj23 td/osd-backfill-space/datafile 2024-05-08T18:59:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj24 td/osd-backfill-space/datafile 2024-05-08T18:59:05.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj25 td/osd-backfill-space/datafile 2024-05-08T18:59:05.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj26 td/osd-backfill-space/datafile 2024-05-08T18:59:05.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj27 td/osd-backfill-space/datafile 2024-05-08T18:59:05.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj28 td/osd-backfill-space/datafile 2024-05-08T18:59:05.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj29 td/osd-backfill-space/datafile 2024-05-08T18:59:05.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj30 td/osd-backfill-space/datafile 2024-05-08T18:59:05.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj31 td/osd-backfill-space/datafile 2024-05-08T18:59:05.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj32 td/osd-backfill-space/datafile 2024-05-08T18:59:05.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj33 td/osd-backfill-space/datafile 2024-05-08T18:59:05.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:05.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj34 td/osd-backfill-space/datafile 2024-05-08T18:59:06.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj35 td/osd-backfill-space/datafile 2024-05-08T18:59:06.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj36 td/osd-backfill-space/datafile 2024-05-08T18:59:06.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj37 td/osd-backfill-space/datafile 2024-05-08T18:59:06.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj38 td/osd-backfill-space/datafile 2024-05-08T18:59:06.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj39 td/osd-backfill-space/datafile 2024-05-08T18:59:06.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj40 td/osd-backfill-space/datafile 2024-05-08T18:59:06.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj41 td/osd-backfill-space/datafile 2024-05-08T18:59:06.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj42 td/osd-backfill-space/datafile 2024-05-08T18:59:06.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:06.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj43 td/osd-backfill-space/datafile 2024-05-08T18:59:07.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj44 td/osd-backfill-space/datafile 2024-05-08T18:59:07.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj45 td/osd-backfill-space/datafile 2024-05-08T18:59:07.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj46 td/osd-backfill-space/datafile 2024-05-08T18:59:07.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj47 td/osd-backfill-space/datafile 2024-05-08T18:59:07.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj48 td/osd-backfill-space/datafile 2024-05-08T18:59:07.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj49 td/osd-backfill-space/datafile 2024-05-08T18:59:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj50 td/osd-backfill-space/datafile 2024-05-08T18:59:07.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj51 td/osd-backfill-space/datafile 2024-05-08T18:59:07.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj52 td/osd-backfill-space/datafile 2024-05-08T18:59:07.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj53 td/osd-backfill-space/datafile 2024-05-08T18:59:07.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:07.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj54 td/osd-backfill-space/datafile 2024-05-08T18:59:08.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj55 td/osd-backfill-space/datafile 2024-05-08T18:59:08.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj56 td/osd-backfill-space/datafile 2024-05-08T18:59:08.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj57 td/osd-backfill-space/datafile 2024-05-08T18:59:08.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj58 td/osd-backfill-space/datafile 2024-05-08T18:59:08.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj59 td/osd-backfill-space/datafile 2024-05-08T18:59:08.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj60 td/osd-backfill-space/datafile 2024-05-08T18:59:08.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj61 td/osd-backfill-space/datafile 2024-05-08T18:59:08.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj62 td/osd-backfill-space/datafile 2024-05-08T18:59:08.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj63 td/osd-backfill-space/datafile 2024-05-08T18:59:08.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:08.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj64 td/osd-backfill-space/datafile 2024-05-08T18:59:09.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj65 td/osd-backfill-space/datafile 2024-05-08T18:59:09.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj66 td/osd-backfill-space/datafile 2024-05-08T18:59:09.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj67 td/osd-backfill-space/datafile 2024-05-08T18:59:09.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj68 td/osd-backfill-space/datafile 2024-05-08T18:59:09.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj69 td/osd-backfill-space/datafile 2024-05-08T18:59:09.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj70 td/osd-backfill-space/datafile 2024-05-08T18:59:09.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj71 td/osd-backfill-space/datafile 2024-05-08T18:59:09.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj72 td/osd-backfill-space/datafile 2024-05-08T18:59:09.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj73 td/osd-backfill-space/datafile 2024-05-08T18:59:09.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj74 td/osd-backfill-space/datafile 2024-05-08T18:59:09.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:09.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj75 td/osd-backfill-space/datafile 2024-05-08T18:59:10.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj76 td/osd-backfill-space/datafile 2024-05-08T18:59:10.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj77 td/osd-backfill-space/datafile 2024-05-08T18:59:10.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj78 td/osd-backfill-space/datafile 2024-05-08T18:59:10.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj79 td/osd-backfill-space/datafile 2024-05-08T18:59:10.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj80 td/osd-backfill-space/datafile 2024-05-08T18:59:10.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj81 td/osd-backfill-space/datafile 2024-05-08T18:59:10.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj82 td/osd-backfill-space/datafile 2024-05-08T18:59:10.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj83 td/osd-backfill-space/datafile 2024-05-08T18:59:10.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj84 td/osd-backfill-space/datafile 2024-05-08T18:59:10.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:10.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj85 td/osd-backfill-space/datafile 2024-05-08T18:59:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj86 td/osd-backfill-space/datafile 2024-05-08T18:59:11.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj87 td/osd-backfill-space/datafile 2024-05-08T18:59:11.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj88 td/osd-backfill-space/datafile 2024-05-08T18:59:11.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj89 td/osd-backfill-space/datafile 2024-05-08T18:59:11.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj90 td/osd-backfill-space/datafile 2024-05-08T18:59:11.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj91 td/osd-backfill-space/datafile 2024-05-08T18:59:11.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj92 td/osd-backfill-space/datafile 2024-05-08T18:59:11.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj93 td/osd-backfill-space/datafile 2024-05-08T18:59:11.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj94 td/osd-backfill-space/datafile 2024-05-08T18:59:11.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:11.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj95 td/osd-backfill-space/datafile 2024-05-08T18:59:12.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj96 td/osd-backfill-space/datafile 2024-05-08T18:59:12.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj97 td/osd-backfill-space/datafile 2024-05-08T18:59:12.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj98 td/osd-backfill-space/datafile 2024-05-08T18:59:12.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj99 td/osd-backfill-space/datafile 2024-05-08T18:59:12.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj100 td/osd-backfill-space/datafile 2024-05-08T18:59:12.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj101 td/osd-backfill-space/datafile 2024-05-08T18:59:12.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj102 td/osd-backfill-space/datafile 2024-05-08T18:59:12.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj103 td/osd-backfill-space/datafile 2024-05-08T18:59:12.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj104 td/osd-backfill-space/datafile 2024-05-08T18:59:12.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:12.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj105 td/osd-backfill-space/datafile 2024-05-08T18:59:13.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj106 td/osd-backfill-space/datafile 2024-05-08T18:59:13.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj107 td/osd-backfill-space/datafile 2024-05-08T18:59:13.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj108 td/osd-backfill-space/datafile 2024-05-08T18:59:13.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj109 td/osd-backfill-space/datafile 2024-05-08T18:59:13.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj110 td/osd-backfill-space/datafile 2024-05-08T18:59:13.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj111 td/osd-backfill-space/datafile 2024-05-08T18:59:13.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj112 td/osd-backfill-space/datafile 2024-05-08T18:59:13.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj113 td/osd-backfill-space/datafile 2024-05-08T18:59:13.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj114 td/osd-backfill-space/datafile 2024-05-08T18:59:13.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj115 td/osd-backfill-space/datafile 2024-05-08T18:59:13.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:13.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj116 td/osd-backfill-space/datafile 2024-05-08T18:59:14.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj117 td/osd-backfill-space/datafile 2024-05-08T18:59:14.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj118 td/osd-backfill-space/datafile 2024-05-08T18:59:14.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj119 td/osd-backfill-space/datafile 2024-05-08T18:59:14.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj120 td/osd-backfill-space/datafile 2024-05-08T18:59:14.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj121 td/osd-backfill-space/datafile 2024-05-08T18:59:14.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj122 td/osd-backfill-space/datafile 2024-05-08T18:59:14.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj123 td/osd-backfill-space/datafile 2024-05-08T18:59:14.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj124 td/osd-backfill-space/datafile 2024-05-08T18:59:14.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj125 td/osd-backfill-space/datafile 2024-05-08T18:59:14.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:14.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj126 td/osd-backfill-space/datafile 2024-05-08T18:59:15.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj127 td/osd-backfill-space/datafile 2024-05-08T18:59:15.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj128 td/osd-backfill-space/datafile 2024-05-08T18:59:15.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj129 td/osd-backfill-space/datafile 2024-05-08T18:59:15.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj130 td/osd-backfill-space/datafile 2024-05-08T18:59:15.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj131 td/osd-backfill-space/datafile 2024-05-08T18:59:15.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj132 td/osd-backfill-space/datafile 2024-05-08T18:59:15.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj133 td/osd-backfill-space/datafile 2024-05-08T18:59:15.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj134 td/osd-backfill-space/datafile 2024-05-08T18:59:15.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj135 td/osd-backfill-space/datafile 2024-05-08T18:59:15.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj136 td/osd-backfill-space/datafile 2024-05-08T18:59:15.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:15.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj137 td/osd-backfill-space/datafile 2024-05-08T18:59:16.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj138 td/osd-backfill-space/datafile 2024-05-08T18:59:16.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj139 td/osd-backfill-space/datafile 2024-05-08T18:59:16.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj140 td/osd-backfill-space/datafile 2024-05-08T18:59:16.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj141 td/osd-backfill-space/datafile 2024-05-08T18:59:16.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj142 td/osd-backfill-space/datafile 2024-05-08T18:59:16.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj143 td/osd-backfill-space/datafile 2024-05-08T18:59:16.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj144 td/osd-backfill-space/datafile 2024-05-08T18:59:16.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj145 td/osd-backfill-space/datafile 2024-05-08T18:59:16.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj146 td/osd-backfill-space/datafile 2024-05-08T18:59:16.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:16.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj147 td/osd-backfill-space/datafile 2024-05-08T18:59:17.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj148 td/osd-backfill-space/datafile 2024-05-08T18:59:17.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj149 td/osd-backfill-space/datafile 2024-05-08T18:59:17.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj150 td/osd-backfill-space/datafile 2024-05-08T18:59:17.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj151 td/osd-backfill-space/datafile 2024-05-08T18:59:17.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj152 td/osd-backfill-space/datafile 2024-05-08T18:59:17.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj153 td/osd-backfill-space/datafile 2024-05-08T18:59:17.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj154 td/osd-backfill-space/datafile 2024-05-08T18:59:17.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj155 td/osd-backfill-space/datafile 2024-05-08T18:59:17.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj156 td/osd-backfill-space/datafile 2024-05-08T18:59:17.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj157 td/osd-backfill-space/datafile 2024-05-08T18:59:17.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:17.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj158 td/osd-backfill-space/datafile 2024-05-08T18:59:18.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj159 td/osd-backfill-space/datafile 2024-05-08T18:59:18.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj160 td/osd-backfill-space/datafile 2024-05-08T18:59:18.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj161 td/osd-backfill-space/datafile 2024-05-08T18:59:18.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj162 td/osd-backfill-space/datafile 2024-05-08T18:59:18.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj163 td/osd-backfill-space/datafile 2024-05-08T18:59:18.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj164 td/osd-backfill-space/datafile 2024-05-08T18:59:18.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj165 td/osd-backfill-space/datafile 2024-05-08T18:59:18.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj166 td/osd-backfill-space/datafile 2024-05-08T18:59:18.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj167 td/osd-backfill-space/datafile 2024-05-08T18:59:18.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj168 td/osd-backfill-space/datafile 2024-05-08T18:59:18.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj169 td/osd-backfill-space/datafile 2024-05-08T18:59:18.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj170 td/osd-backfill-space/datafile 2024-05-08T18:59:18.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj171 td/osd-backfill-space/datafile 2024-05-08T18:59:18.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:18.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj172 td/osd-backfill-space/datafile 2024-05-08T18:59:19.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj173 td/osd-backfill-space/datafile 2024-05-08T18:59:19.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj174 td/osd-backfill-space/datafile 2024-05-08T18:59:19.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj175 td/osd-backfill-space/datafile 2024-05-08T18:59:19.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj176 td/osd-backfill-space/datafile 2024-05-08T18:59:19.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj177 td/osd-backfill-space/datafile 2024-05-08T18:59:19.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj178 td/osd-backfill-space/datafile 2024-05-08T18:59:19.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj179 td/osd-backfill-space/datafile 2024-05-08T18:59:19.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj180 td/osd-backfill-space/datafile 2024-05-08T18:59:19.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj181 td/osd-backfill-space/datafile 2024-05-08T18:59:19.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj182 td/osd-backfill-space/datafile 2024-05-08T18:59:19.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj183 td/osd-backfill-space/datafile 2024-05-08T18:59:19.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj184 td/osd-backfill-space/datafile 2024-05-08T18:59:19.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj185 td/osd-backfill-space/datafile 2024-05-08T18:59:19.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:19.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj186 td/osd-backfill-space/datafile 2024-05-08T18:59:20.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj187 td/osd-backfill-space/datafile 2024-05-08T18:59:20.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj188 td/osd-backfill-space/datafile 2024-05-08T18:59:20.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj189 td/osd-backfill-space/datafile 2024-05-08T18:59:20.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj190 td/osd-backfill-space/datafile 2024-05-08T18:59:20.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj191 td/osd-backfill-space/datafile 2024-05-08T18:59:20.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj192 td/osd-backfill-space/datafile 2024-05-08T18:59:20.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj193 td/osd-backfill-space/datafile 2024-05-08T18:59:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj194 td/osd-backfill-space/datafile 2024-05-08T18:59:20.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj195 td/osd-backfill-space/datafile 2024-05-08T18:59:20.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj196 td/osd-backfill-space/datafile 2024-05-08T18:59:20.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj197 td/osd-backfill-space/datafile 2024-05-08T18:59:20.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj198 td/osd-backfill-space/datafile 2024-05-08T18:59:20.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj199 td/osd-backfill-space/datafile 2024-05-08T18:59:20.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:20.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj200 td/osd-backfill-space/datafile 2024-05-08T18:59:21.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:658: TEST_ec_backfill_simple: get_primary fillpool obj1 2024-05-08T18:59:21.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=fillpool 2024-05-08T18:59:21.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T18:59:21.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map fillpool obj1 2024-05-08T18:59:21.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T18:59:21.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:658: TEST_ec_backfill_simple: local fillosd=1 2024-05-08T18:59:21.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:659: TEST_ec_backfill_simple: expr 1 + 1 2024-05-08T18:59:21.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:659: TEST_ec_backfill_simple: osd=2 2024-05-08T18:59:21.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:660: TEST_ec_backfill_simple: '[' 2 = 6 ']' 2024-05-08T18:59:21.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:664: TEST_ec_backfill_simple: sleep 5 2024-05-08T18:59:26.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:665: TEST_ec_backfill_simple: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2024-05-08T18:59:26.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=455740 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 455740 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T18:59:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2024-05-08T18:59:26.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:59:26.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 455740 2024-05-08T18:59:26.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T18:59:26.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T18:59:26.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.2 2024-05-08T18:59:26.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T18:59:26.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 455740 2024-05-08T18:59:26.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2024-05-08T18:59:26.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2024-05-08T18:59:26.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2024-05-08T18:59:26.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:666: TEST_ec_backfill_simple: ceph osd out osd.1 2024-05-08T18:59:27.313 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T18:59:27.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:667: TEST_ec_backfill_simple: sleep 2 2024-05-08T18:59:29.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:668: TEST_ec_backfill_simple: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2024-05-08T18:59:29.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:670: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:29.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:670: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:29.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:672: TEST_ec_backfill_simple: ceph osd pool create test1 1 1 erasure ec-profile 2024-05-08T18:59:30.588 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' already exists 2024-05-08T18:59:30.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:677: TEST_ec_backfill_simple: sleep 5 2024-05-08T18:59:35.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:679: TEST_ec_backfill_simple: ceph pg dump pgs 2024-05-08T18:59:36.025 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T18:59:36.026 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-05-08T18:59:31.971399+0000 0'0 46:15 [3,5,4,0,2] 3 [3,5,4,0,2] 3 0'0 2024-05-08T18:59:30.393247+0000 0'0 2024-05-08T18:59:30.393247+0000 0 0 periodic scrub scheduled @ 2024-05-10T00:00:59.129380+0000 0 0 2024-05-08T18:59:36.026 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 100 stale+active+clean 2024-05-08T18:59:02.553920+0000 39'200 39:220 [1] 1 [1] 1 0'0 2024-05-08T18:58:59.986407+0000 0'0 2024-05-08T18:58:59.986407+0000 0 0 periodic scrub scheduled @ 2024-05-09T22:27:32.278634+0000 0 0 2024-05-08T18:59:36.026 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T18:59:36.026 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T18:59:36.026 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T18:59:36.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:681: TEST_ec_backfill_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=18 2024-05-08T18:59:36.044 INFO:tasks.workunit.client.0.smithi117.stderr:18+0 records in 2024-05-08T18:59:36.044 INFO:tasks.workunit.client.0.smithi117.stderr:18+0 records out 2024-05-08T18:59:36.044 INFO:tasks.workunit.client.0.smithi117.stderr:18432 bytes (18 kB, 18 KiB) copied, 0.000291333 s, 63.3 MB/s 2024-05-08T18:59:36.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: seq 1 200 2024-05-08T18:59:36.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:36.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:36.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:36.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj1 td/osd-backfill-space/datafile 2024-05-08T18:59:36.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:36.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:36.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:36.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj2 td/osd-backfill-space/datafile 2024-05-08T18:59:36.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:36.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:36.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:36.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj3 td/osd-backfill-space/datafile 2024-05-08T18:59:36.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:36.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:36.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:36.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj4 td/osd-backfill-space/datafile 2024-05-08T18:59:36.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:36.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:36.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:36.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj5 td/osd-backfill-space/datafile 2024-05-08T18:59:37.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:37.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:37.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:37.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj6 td/osd-backfill-space/datafile 2024-05-08T18:59:37.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:37.486 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:37.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:37.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj7 td/osd-backfill-space/datafile 2024-05-08T18:59:37.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:37.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:37.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:37.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj8 td/osd-backfill-space/datafile 2024-05-08T18:59:37.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:37.989 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:37.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:37.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj9 td/osd-backfill-space/datafile 2024-05-08T18:59:38.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:38.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:38.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:38.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj10 td/osd-backfill-space/datafile 2024-05-08T18:59:38.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:38.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:38.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:38.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj11 td/osd-backfill-space/datafile 2024-05-08T18:59:38.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:38.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:38.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:38.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj12 td/osd-backfill-space/datafile 2024-05-08T18:59:39.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:39.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:39.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:39.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj13 td/osd-backfill-space/datafile 2024-05-08T18:59:39.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:39.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:39.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:39.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj14 td/osd-backfill-space/datafile 2024-05-08T18:59:39.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:39.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:39.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:39.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj15 td/osd-backfill-space/datafile 2024-05-08T18:59:39.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:39.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:39.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:39.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj16 td/osd-backfill-space/datafile 2024-05-08T18:59:40.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:40.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:40.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:40.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj17 td/osd-backfill-space/datafile 2024-05-08T18:59:40.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:40.300 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:40.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:40.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj18 td/osd-backfill-space/datafile 2024-05-08T18:59:40.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:40.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:40.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:40.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj19 td/osd-backfill-space/datafile 2024-05-08T18:59:40.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:40.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:40.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:40.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj20 td/osd-backfill-space/datafile 2024-05-08T18:59:41.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:41.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:41.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:41.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj21 td/osd-backfill-space/datafile 2024-05-08T18:59:41.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:41.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:41.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:41.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj22 td/osd-backfill-space/datafile 2024-05-08T18:59:41.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:41.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:41.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:41.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj23 td/osd-backfill-space/datafile 2024-05-08T18:59:41.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:41.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:41.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:41.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj24 td/osd-backfill-space/datafile 2024-05-08T18:59:42.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:42.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:42.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:42.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj25 td/osd-backfill-space/datafile 2024-05-08T18:59:42.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:42.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:42.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:42.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj26 td/osd-backfill-space/datafile 2024-05-08T18:59:42.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:42.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:42.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:42.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj27 td/osd-backfill-space/datafile 2024-05-08T18:59:43.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:43.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:43.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:43.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj28 td/osd-backfill-space/datafile 2024-05-08T18:59:43.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:43.387 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:43.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:43.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj29 td/osd-backfill-space/datafile 2024-05-08T18:59:43.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:43.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:43.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:43.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj30 td/osd-backfill-space/datafile 2024-05-08T18:59:43.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:43.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:43.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:43.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj31 td/osd-backfill-space/datafile 2024-05-08T18:59:44.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:44.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:44.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:44.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj32 td/osd-backfill-space/datafile 2024-05-08T18:59:44.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:44.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:44.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:44.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj33 td/osd-backfill-space/datafile 2024-05-08T18:59:44.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:44.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:44.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:44.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj34 td/osd-backfill-space/datafile 2024-05-08T18:59:44.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:44.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:44.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:44.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj35 td/osd-backfill-space/datafile 2024-05-08T18:59:45.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:45.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:45.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:45.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj36 td/osd-backfill-space/datafile 2024-05-08T18:59:45.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:45.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:45.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:45.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj37 td/osd-backfill-space/datafile 2024-05-08T18:59:45.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:45.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:45.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:45.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj38 td/osd-backfill-space/datafile 2024-05-08T18:59:45.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:46.000 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:46.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:46.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj39 td/osd-backfill-space/datafile 2024-05-08T18:59:46.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:46.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:46.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:46.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj40 td/osd-backfill-space/datafile 2024-05-08T18:59:46.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:46.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:46.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:46.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj41 td/osd-backfill-space/datafile 2024-05-08T18:59:46.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:46.781 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:46.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:46.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj42 td/osd-backfill-space/datafile 2024-05-08T18:59:47.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:47.017 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:47.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:47.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj43 td/osd-backfill-space/datafile 2024-05-08T18:59:47.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:47.293 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:47.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:47.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj44 td/osd-backfill-space/datafile 2024-05-08T18:59:47.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:47.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:47.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:47.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj45 td/osd-backfill-space/datafile 2024-05-08T18:59:47.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:47.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:47.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:47.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj46 td/osd-backfill-space/datafile 2024-05-08T18:59:48.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:48.058 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:48.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:48.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj47 td/osd-backfill-space/datafile 2024-05-08T18:59:48.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:48.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:48.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:48.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj48 td/osd-backfill-space/datafile 2024-05-08T18:59:48.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:48.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:48.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:48.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj49 td/osd-backfill-space/datafile 2024-05-08T18:59:48.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:48.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:48.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:48.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj50 td/osd-backfill-space/datafile 2024-05-08T18:59:49.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:49.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj51 td/osd-backfill-space/datafile 2024-05-08T18:59:49.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:49.292 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:49.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:49.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj52 td/osd-backfill-space/datafile 2024-05-08T18:59:49.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:49.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:49.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:49.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj53 td/osd-backfill-space/datafile 2024-05-08T18:59:49.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:49.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:49.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:49.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj54 td/osd-backfill-space/datafile 2024-05-08T18:59:50.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:50.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:50.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:50.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj55 td/osd-backfill-space/datafile 2024-05-08T18:59:50.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:50.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:50.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:50.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj56 td/osd-backfill-space/datafile 2024-05-08T18:59:50.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:50.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:50.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:50.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj57 td/osd-backfill-space/datafile 2024-05-08T18:59:50.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:50.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:50.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:50.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj58 td/osd-backfill-space/datafile 2024-05-08T18:59:51.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:51.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:51.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:51.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj59 td/osd-backfill-space/datafile 2024-05-08T18:59:51.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:51.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:51.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:51.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj60 td/osd-backfill-space/datafile 2024-05-08T18:59:51.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:51.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:51.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:51.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj61 td/osd-backfill-space/datafile 2024-05-08T18:59:51.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:51.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:51.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:51.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj62 td/osd-backfill-space/datafile 2024-05-08T18:59:52.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:52.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:52.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:52.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj63 td/osd-backfill-space/datafile 2024-05-08T18:59:52.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:52.324 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:52.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:52.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj64 td/osd-backfill-space/datafile 2024-05-08T18:59:52.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:52.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:52.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:52.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj65 td/osd-backfill-space/datafile 2024-05-08T18:59:52.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:52.938 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:52.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:52.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj66 td/osd-backfill-space/datafile 2024-05-08T18:59:53.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:53.155 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:53.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:53.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj67 td/osd-backfill-space/datafile 2024-05-08T18:59:53.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:53.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:53.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:53.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj68 td/osd-backfill-space/datafile 2024-05-08T18:59:53.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:53.651 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:53.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:53.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj69 td/osd-backfill-space/datafile 2024-05-08T18:59:53.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:53.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:53.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:53.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj70 td/osd-backfill-space/datafile 2024-05-08T18:59:54.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:54.155 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:54.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:54.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj71 td/osd-backfill-space/datafile 2024-05-08T18:59:54.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:54.390 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:54.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj72 td/osd-backfill-space/datafile 2024-05-08T18:59:54.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:54.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:54.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:54.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj73 td/osd-backfill-space/datafile 2024-05-08T18:59:54.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:54.887 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:54.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:54.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj74 td/osd-backfill-space/datafile 2024-05-08T18:59:55.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:55.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:55.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:55.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj75 td/osd-backfill-space/datafile 2024-05-08T18:59:55.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:55.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:55.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:55.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj76 td/osd-backfill-space/datafile 2024-05-08T18:59:55.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:55.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:55.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:55.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj77 td/osd-backfill-space/datafile 2024-05-08T18:59:55.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:55.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:55.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:55.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj78 td/osd-backfill-space/datafile 2024-05-08T18:59:56.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:56.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:56.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:56.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj79 td/osd-backfill-space/datafile 2024-05-08T18:59:56.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:56.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:56.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:56.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj80 td/osd-backfill-space/datafile 2024-05-08T18:59:56.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:56.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:56.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:56.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj81 td/osd-backfill-space/datafile 2024-05-08T18:59:56.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:56.902 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:56.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:56.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj82 td/osd-backfill-space/datafile 2024-05-08T18:59:57.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:57.155 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:57.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:57.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj83 td/osd-backfill-space/datafile 2024-05-08T18:59:57.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:57.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:57.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:57.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj84 td/osd-backfill-space/datafile 2024-05-08T18:59:57.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:57.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:57.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:57.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj85 td/osd-backfill-space/datafile 2024-05-08T18:59:57.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:57.910 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:57.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:57.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj86 td/osd-backfill-space/datafile 2024-05-08T18:59:58.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:58.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:58.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:58.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj87 td/osd-backfill-space/datafile 2024-05-08T18:59:58.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:58.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:58.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:58.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj88 td/osd-backfill-space/datafile 2024-05-08T18:59:58.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:58.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:58.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:58.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj89 td/osd-backfill-space/datafile 2024-05-08T18:59:58.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:58.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:58.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:58.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj90 td/osd-backfill-space/datafile 2024-05-08T18:59:59.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:59.237 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:59.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:59.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj91 td/osd-backfill-space/datafile 2024-05-08T18:59:59.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:59.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:59.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:59.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj92 td/osd-backfill-space/datafile 2024-05-08T18:59:59.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:59.724 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:59.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:59.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj93 td/osd-backfill-space/datafile 2024-05-08T18:59:59.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T18:59:59.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T18:59:59.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T18:59:59.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj94 td/osd-backfill-space/datafile 2024-05-08T19:00:00.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:00.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:00.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:00.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj95 td/osd-backfill-space/datafile 2024-05-08T19:00:00.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:00.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:00.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:00.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj96 td/osd-backfill-space/datafile 2024-05-08T19:00:00.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:00.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:00.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:00.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj97 td/osd-backfill-space/datafile 2024-05-08T19:00:01.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:01.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:01.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:01.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj98 td/osd-backfill-space/datafile 2024-05-08T19:00:01.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:01.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:01.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj99 td/osd-backfill-space/datafile 2024-05-08T19:00:01.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:01.521 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:01.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:01.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj100 td/osd-backfill-space/datafile 2024-05-08T19:00:01.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:01.765 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:01.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:01.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj101 td/osd-backfill-space/datafile 2024-05-08T19:00:02.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:02.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:02.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:02.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj102 td/osd-backfill-space/datafile 2024-05-08T19:00:02.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:02.402 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:02.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:02.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj103 td/osd-backfill-space/datafile 2024-05-08T19:00:02.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:02.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:02.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:02.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj104 td/osd-backfill-space/datafile 2024-05-08T19:00:02.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:02.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:02.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:02.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj105 td/osd-backfill-space/datafile 2024-05-08T19:00:03.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:03.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:03.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:03.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj106 td/osd-backfill-space/datafile 2024-05-08T19:00:03.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:03.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:03.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:03.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj107 td/osd-backfill-space/datafile 2024-05-08T19:00:03.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:03.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:03.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:03.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj108 td/osd-backfill-space/datafile 2024-05-08T19:00:03.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:03.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:03.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:03.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj109 td/osd-backfill-space/datafile 2024-05-08T19:00:04.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:04.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:04.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:04.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj110 td/osd-backfill-space/datafile 2024-05-08T19:00:04.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:04.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:04.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:04.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj111 td/osd-backfill-space/datafile 2024-05-08T19:00:04.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:04.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:04.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:04.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj112 td/osd-backfill-space/datafile 2024-05-08T19:00:04.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:04.913 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:04.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:04.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj113 td/osd-backfill-space/datafile 2024-05-08T19:00:05.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:05.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:05.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:05.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj114 td/osd-backfill-space/datafile 2024-05-08T19:00:05.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:05.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:05.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:05.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj115 td/osd-backfill-space/datafile 2024-05-08T19:00:05.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:05.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:05.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:05.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj116 td/osd-backfill-space/datafile 2024-05-08T19:00:05.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:05.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:05.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:05.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj117 td/osd-backfill-space/datafile 2024-05-08T19:00:06.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:06.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:06.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:06.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj118 td/osd-backfill-space/datafile 2024-05-08T19:00:06.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:06.476 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:06.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:06.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj119 td/osd-backfill-space/datafile 2024-05-08T19:00:06.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:06.762 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:06.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:06.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj120 td/osd-backfill-space/datafile 2024-05-08T19:00:06.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:06.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:06.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:06.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj121 td/osd-backfill-space/datafile 2024-05-08T19:00:07.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:07.215 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:07.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:07.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj122 td/osd-backfill-space/datafile 2024-05-08T19:00:07.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:07.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:07.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:07.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj123 td/osd-backfill-space/datafile 2024-05-08T19:00:07.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:07.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:07.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:07.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj124 td/osd-backfill-space/datafile 2024-05-08T19:00:08.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:08.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:08.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:08.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj125 td/osd-backfill-space/datafile 2024-05-08T19:00:08.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:08.352 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:08.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:08.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj126 td/osd-backfill-space/datafile 2024-05-08T19:00:08.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:08.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:08.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:08.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj127 td/osd-backfill-space/datafile 2024-05-08T19:00:08.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:08.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:08.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:08.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj128 td/osd-backfill-space/datafile 2024-05-08T19:00:09.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:09.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:09.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:09.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj129 td/osd-backfill-space/datafile 2024-05-08T19:00:09.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:09.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:09.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:09.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj130 td/osd-backfill-space/datafile 2024-05-08T19:00:09.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:09.586 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj131 td/osd-backfill-space/datafile 2024-05-08T19:00:09.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:09.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:09.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:09.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj132 td/osd-backfill-space/datafile 2024-05-08T19:00:10.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:10.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:10.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:10.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj133 td/osd-backfill-space/datafile 2024-05-08T19:00:10.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:10.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:10.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:10.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj134 td/osd-backfill-space/datafile 2024-05-08T19:00:10.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:10.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:10.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:10.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj135 td/osd-backfill-space/datafile 2024-05-08T19:00:10.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:10.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:10.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:10.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj136 td/osd-backfill-space/datafile 2024-05-08T19:00:11.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:11.072 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:11.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:11.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj137 td/osd-backfill-space/datafile 2024-05-08T19:00:11.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:11.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:11.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:11.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj138 td/osd-backfill-space/datafile 2024-05-08T19:00:11.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:11.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:11.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:11.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj139 td/osd-backfill-space/datafile 2024-05-08T19:00:11.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:11.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:11.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:11.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj140 td/osd-backfill-space/datafile 2024-05-08T19:00:12.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:12.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:12.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:12.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj141 td/osd-backfill-space/datafile 2024-05-08T19:00:12.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:12.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:12.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:12.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj142 td/osd-backfill-space/datafile 2024-05-08T19:00:12.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:12.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:12.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:12.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj143 td/osd-backfill-space/datafile 2024-05-08T19:00:12.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:12.878 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:12.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:12.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj144 td/osd-backfill-space/datafile 2024-05-08T19:00:13.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:13.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:13.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:13.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj145 td/osd-backfill-space/datafile 2024-05-08T19:00:13.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:13.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:13.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:13.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj146 td/osd-backfill-space/datafile 2024-05-08T19:00:13.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:13.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:13.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:13.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj147 td/osd-backfill-space/datafile 2024-05-08T19:00:14.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:14.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:14.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:14.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj148 td/osd-backfill-space/datafile 2024-05-08T19:00:14.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:14.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:14.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:14.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj149 td/osd-backfill-space/datafile 2024-05-08T19:00:14.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:14.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:14.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:14.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj150 td/osd-backfill-space/datafile 2024-05-08T19:00:14.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:14.910 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:14.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:14.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj151 td/osd-backfill-space/datafile 2024-05-08T19:00:15.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:15.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:15.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:15.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj152 td/osd-backfill-space/datafile 2024-05-08T19:00:15.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:15.406 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:15.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:15.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj153 td/osd-backfill-space/datafile 2024-05-08T19:00:15.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:15.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:15.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:15.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj154 td/osd-backfill-space/datafile 2024-05-08T19:00:15.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:15.876 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:15.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:15.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj155 td/osd-backfill-space/datafile 2024-05-08T19:00:16.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:16.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:16.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:16.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj156 td/osd-backfill-space/datafile 2024-05-08T19:00:16.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:16.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:16.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:16.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj157 td/osd-backfill-space/datafile 2024-05-08T19:00:16.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:16.650 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj158 td/osd-backfill-space/datafile 2024-05-08T19:00:16.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:16.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:16.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:16.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj159 td/osd-backfill-space/datafile 2024-05-08T19:00:17.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:17.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:17.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:17.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj160 td/osd-backfill-space/datafile 2024-05-08T19:00:17.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:17.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:17.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:17.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj161 td/osd-backfill-space/datafile 2024-05-08T19:00:17.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:17.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:17.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:17.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj162 td/osd-backfill-space/datafile 2024-05-08T19:00:17.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:17.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:17.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:17.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj163 td/osd-backfill-space/datafile 2024-05-08T19:00:18.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:18.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:18.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:18.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj164 td/osd-backfill-space/datafile 2024-05-08T19:00:18.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:18.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:18.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:18.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj165 td/osd-backfill-space/datafile 2024-05-08T19:00:18.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:18.691 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:18.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:18.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj166 td/osd-backfill-space/datafile 2024-05-08T19:00:18.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:18.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:18.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:18.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj167 td/osd-backfill-space/datafile 2024-05-08T19:00:19.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:19.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:19.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:19.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj168 td/osd-backfill-space/datafile 2024-05-08T19:00:19.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:19.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:19.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:19.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj169 td/osd-backfill-space/datafile 2024-05-08T19:00:19.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:19.656 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:19.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:19.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj170 td/osd-backfill-space/datafile 2024-05-08T19:00:19.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:19.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:19.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:19.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj171 td/osd-backfill-space/datafile 2024-05-08T19:00:20.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:20.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:20.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:20.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj172 td/osd-backfill-space/datafile 2024-05-08T19:00:20.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:20.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:20.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:20.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj173 td/osd-backfill-space/datafile 2024-05-08T19:00:20.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:20.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:20.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:20.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj174 td/osd-backfill-space/datafile 2024-05-08T19:00:20.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:20.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:20.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:20.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj175 td/osd-backfill-space/datafile 2024-05-08T19:00:21.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:21.202 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:21.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:21.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj176 td/osd-backfill-space/datafile 2024-05-08T19:00:21.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:21.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:21.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:21.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj177 td/osd-backfill-space/datafile 2024-05-08T19:00:21.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:21.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:21.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:21.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj178 td/osd-backfill-space/datafile 2024-05-08T19:00:21.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:21.950 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:21.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:21.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj179 td/osd-backfill-space/datafile 2024-05-08T19:00:22.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:22.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:22.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:22.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj180 td/osd-backfill-space/datafile 2024-05-08T19:00:22.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:22.473 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:22.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:22.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj181 td/osd-backfill-space/datafile 2024-05-08T19:00:22.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:22.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:22.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:22.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj182 td/osd-backfill-space/datafile 2024-05-08T19:00:22.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:22.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:22.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:22.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj183 td/osd-backfill-space/datafile 2024-05-08T19:00:23.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:23.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:23.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:23.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj184 td/osd-backfill-space/datafile 2024-05-08T19:00:23.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:23.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:23.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:23.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj185 td/osd-backfill-space/datafile 2024-05-08T19:00:23.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:23.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:23.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:23.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj186 td/osd-backfill-space/datafile 2024-05-08T19:00:24.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:24.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:24.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:24.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj187 td/osd-backfill-space/datafile 2024-05-08T19:00:24.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:24.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:24.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:24.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj188 td/osd-backfill-space/datafile 2024-05-08T19:00:24.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:24.561 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:24.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:24.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj189 td/osd-backfill-space/datafile 2024-05-08T19:00:24.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:24.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:24.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:24.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj190 td/osd-backfill-space/datafile 2024-05-08T19:00:25.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:25.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:25.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:25.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj191 td/osd-backfill-space/datafile 2024-05-08T19:00:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:25.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:25.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:25.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj192 td/osd-backfill-space/datafile 2024-05-08T19:00:25.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:25.586 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:25.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:25.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj193 td/osd-backfill-space/datafile 2024-05-08T19:00:25.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:25.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:25.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:25.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj194 td/osd-backfill-space/datafile 2024-05-08T19:00:26.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:26.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:26.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:26.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj195 td/osd-backfill-space/datafile 2024-05-08T19:00:26.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:26.375 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:26.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:26.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj196 td/osd-backfill-space/datafile 2024-05-08T19:00:26.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:26.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:26.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:26.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj197 td/osd-backfill-space/datafile 2024-05-08T19:00:26.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:26.879 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:26.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:26.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj198 td/osd-backfill-space/datafile 2024-05-08T19:00:27.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:27.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:27.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:27.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj199 td/osd-backfill-space/datafile 2024-05-08T19:00:27.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-05-08T19:00:27.333 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:00:27.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-05-08T19:00:27.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj200 td/osd-backfill-space/datafile 2024-05-08T19:00:27.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:690: TEST_ec_backfill_simple: kill_daemon td/osd-backfill-space/osd.2.pid TERM 2024-05-08T19:00:27.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/osd-backfill-space/osd.2.pid 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=457454 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 457454 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T19:00:27.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2024-05-08T19:00:27.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T19:00:27.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 457454 2024-05-08T19:00:27.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2024-05-08T19:00:27.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2024-05-08T19:00:27.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.2 2024-05-08T19:00:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2024-05-08T19:00:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 457454 2024-05-08T19:00:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2024-05-08T19:00:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2024-05-08T19:00:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2024-05-08T19:00:27.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:691: TEST_ec_backfill_simple: ceph osd out osd.2 2024-05-08T19:00:28.753 INFO:tasks.workunit.client.0.smithi117.stderr:osd.2 is already out. 2024-05-08T19:00:28.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:693: TEST_ec_backfill_simple: activate_osd td/osd-backfill-space 1 2024-05-08T19:00:28.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/osd-backfill-space 2024-05-08T19:00:28.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2024-05-08T19:00:28.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2024-05-08T19:00:28.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2024-05-08T19:00:28.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/osd-backfill-space/1 2024-05-08T19:00:28.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-05-08T19:00:28.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T19:00:28.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2024-05-08T19:00:28.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/osd-backfill-space/1 2024-05-08T19:00:28.777 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:00:28.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2024-05-08T19:00:28.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=62f593dd-65a1-4557-a917-917cf05b8631 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.109971/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:00:28.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/osd-backfill-space/1/whoami 2024-05-08T19:00:28.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2024-05-08T19:00:28.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2024-05-08T19:00:28.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2024-05-08T19:00:28.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2024-05-08T19:00:28.808 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:00:28.810+0000 7f10ec8097c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:00:28.862 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:00:28.858+0000 7f10ec8097c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:00:28.862 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:00:28.862+0000 7f10ec8097c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:00:29.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2024-05-08T19:00:29.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:00:29.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:00:29.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:00:29.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:00:29.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:00:29.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:00:29.225 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:00:29.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:00:29.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:00:29.398 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:00:29.398+0000 7f10ec8097c0 -1 Falling back to public interface 2024-05-08T19:00:29.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:00:30.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:00:30.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:00:30.732 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:00:30.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:00:30.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:00:30.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:00:31.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:00:32.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:00:32.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:00:32.159 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:00:32.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:00:32.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:00:32.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:00:32.387 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:00:32.386+0000 7f10ec8097c0 -1 osd.1 39 log_to_monitors true 2024-05-08T19:00:32.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:00:33.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:00:33.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:00:33.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:00:33.606 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:00:33.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:00:33.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:00:34.035 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up out weight 0 up_from 51 up_thru 37 down_at 40 last_clean_interval [10,39) [v2:127.0.0.1:6810/2310728507,v1:127.0.0.1:6811/2310728507] [v2:127.0.0.1:6812/2310728507,v1:127.0.0.1:6813/2310728507] exists,up c8e04653-6b78-4b09-8e54-89402e70838c 2024-05-08T19:00:34.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:00:34.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:00:34.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:00:34.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:694: TEST_ec_backfill_simple: ceph osd in osd.1 2024-05-08T19:00:34.873 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already in. 2024-05-08T19:00:34.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:695: TEST_ec_backfill_simple: sleep 30 2024-05-08T19:01:04.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:697: TEST_ec_backfill_simple: ceph pg dump pgs 2024-05-08T19:01:05.290 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T19:01:05.290 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 200 0 200 200 0 3686400 0 0 100 100 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T19:00:36.616020+0000 46'200 56:247 [3,5,1,0,4] 3 [3,5,4,0,NONE] 3 0'0 2024-05-08T18:59:30.393247+0000 0'0 2024-05-08T18:59:30.393247+0000 0 0 no scrub is scheduled 0 0 2024-05-08T19:01:05.290 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 100 active+clean 2024-05-08T19:00:35.439515+0000 39'200 56:233 [1] 1 [1] 1 0'0 2024-05-08T18:58:59.986407+0000 0'0 2024-05-08T18:58:59.986407+0000 0 0 periodic scrub scheduled @ 2024-05-09T22:21:38.018013+0000 0 0 2024-05-08T19:01:05.290 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T19:01:05.290 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T19:01:05.290 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:01:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:699: TEST_ec_backfill_simple: wait_for_not_backfilling 1200 2024-05-08T19:01:05.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-05-08T19:01:05.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-05-08T19:01:05.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-05-08T19:01:05.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T19:01:05.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T19:01:05.306 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-05-08T19:01:05.307 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:01:05.307 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:01:05.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:01:05.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:01:05.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:01:05.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-05-08T19:01:05.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T19:01:05.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T19:01:05.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T19:01:05.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:01:05.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:01:06.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:01:06.402 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:01:06.402 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:01:06.403 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:01:06.403 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:01:06.403 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:01:06.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:01:06.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:06.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:01:06.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836546 2024-05-08T19:01:06.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836546 2024-05-08T19:01:06.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546' 2024-05-08T19:01:06.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:06.587 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:01:06.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=219043332106 2024-05-08T19:01:06.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 219043332106 2024-05-08T19:01:06.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546 1-219043332106' 2024-05-08T19:01:06.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:06.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:01:06.875 INFO:tasks.workunit.client.0.smithi117.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-05-08T19:01:06.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq= 2024-05-08T19:01:06.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z '' 2024-05-08T19:01:06.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: continue 2024-05-08T19:01:06.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:06.878 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:01:07.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345965 2024-05-08T19:01:07.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345965 2024-05-08T19:01:07.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546 1-219043332106 3-85899345965' 2024-05-08T19:01:07.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:07.036 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:01:07.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182438 2024-05-08T19:01:07.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182438 2024-05-08T19:01:07.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546 1-219043332106 3-85899345965 4-107374182438' 2024-05-08T19:01:07.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:07.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:01:07.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018913 2024-05-08T19:01:07.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018913 2024-05-08T19:01:07.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836546 1-219043332106 3-85899345965 4-107374182438 5-128849018913' 2024-05-08T19:01:07.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:07.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836546 2024-05-08T19:01:07.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:07.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:01:07.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836546 2024-05-08T19:01:07.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:07.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836546 2024-05-08T19:01:07.366 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836546 2024-05-08T19:01:07.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836546' 2024-05-08T19:01:07.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:01:07.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836544 -lt 21474836546 2024-05-08T19:01:07.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:01:08.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:01:08.782 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:01:09.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836546 -lt 21474836546 2024-05-08T19:01:09.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:09.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:09.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-219043332106 2024-05-08T19:01:09.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:01:09.197 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-219043332106 2024-05-08T19:01:09.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:09.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=219043332106 2024-05-08T19:01:09.199 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 219043332106 2024-05-08T19:01:09.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 219043332106' 2024-05-08T19:01:09.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:01:09.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 219043332106 -lt 219043332106 2024-05-08T19:01:09.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:09.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345965 2024-05-08T19:01:09.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:09.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:01:09.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345965 2024-05-08T19:01:09.636 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:09.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345965 2024-05-08T19:01:09.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345965' 2024-05-08T19:01:09.637 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345965 2024-05-08T19:01:09.638 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:01:10.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345966 -lt 85899345965 2024-05-08T19:01:10.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:10.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182438 2024-05-08T19:01:10.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:10.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:01:10.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182438 2024-05-08T19:01:10.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:10.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182438 2024-05-08T19:01:10.071 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182438 2024-05-08T19:01:10.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182438' 2024-05-08T19:01:10.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:01:10.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182439 -lt 107374182438 2024-05-08T19:01:10.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:10.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018913 2024-05-08T19:01:10.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:10.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:01:10.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018913 2024-05-08T19:01:10.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:10.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018913 2024-05-08T19:01:10.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018913' 2024-05-08T19:01:10.471 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018913 2024-05-08T19:01:10.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:01:10.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018914 -lt 128849018913 2024-05-08T19:01:10.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T19:01:10.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:01:10.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:01:11.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-05-08T19:01:11.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T19:01:11.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-05-08T19:01:11.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-05-08T19:01:11.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T19:01:11.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-05-08T19:01:11.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T19:01:11.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-05-08T19:01:11.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:700: TEST_ec_backfill_simple: wait_for_not_activating 60 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-05-08T19:01:11.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-05-08T19:01:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:01:11.850 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:01:11.850 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:01:11.850 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:01:11.850 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:01:11.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-05-08T19:01:11.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-05-08T19:01:11.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-05-08T19:01:11.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-05-08T19:01:11.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:01:11.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:01:12.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:01:12.285 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:01:12.285 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:01:12.285 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:01:12.285 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:01:12.285 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:01:12.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:01:12.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:12.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:01:12.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836549 2024-05-08T19:01:12.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836549 2024-05-08T19:01:12.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836549' 2024-05-08T19:01:12.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:12.469 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:01:12.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=219043332109 2024-05-08T19:01:12.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 219043332109 2024-05-08T19:01:12.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836549 1-219043332109' 2024-05-08T19:01:12.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:12.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:01:12.745 INFO:tasks.workunit.client.0.smithi117.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-05-08T19:01:12.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq= 2024-05-08T19:01:12.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z '' 2024-05-08T19:01:12.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: continue 2024-05-08T19:01:12.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:12.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:01:12.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345968 2024-05-08T19:01:12.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345968 2024-05-08T19:01:12.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836549 1-219043332109 3-85899345968' 2024-05-08T19:01:12.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:12.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:01:13.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182442 2024-05-08T19:01:13.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182442 2024-05-08T19:01:13.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836549 1-219043332109 3-85899345968 4-107374182442' 2024-05-08T19:01:13.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:01:13.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:01:13.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018916 2024-05-08T19:01:13.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018916 2024-05-08T19:01:13.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836549 1-219043332109 3-85899345968 4-107374182442 5-128849018916' 2024-05-08T19:01:13.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:13.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836549 2024-05-08T19:01:13.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:13.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:01:13.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836549 2024-05-08T19:01:13.221 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:13.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836549 2024-05-08T19:01:13.222 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836549 2024-05-08T19:01:13.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836549' 2024-05-08T19:01:13.222 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:01:13.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836547 -lt 21474836549 2024-05-08T19:01:13.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:01:14.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:01:14.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:01:15.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836550 -lt 21474836549 2024-05-08T19:01:15.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:15.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-219043332109 2024-05-08T19:01:15.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:15.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:01:15.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-219043332109 2024-05-08T19:01:15.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:15.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=219043332109 2024-05-08T19:01:15.094 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 219043332109 2024-05-08T19:01:15.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 219043332109' 2024-05-08T19:01:15.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:01:15.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 219043332110 -lt 219043332109 2024-05-08T19:01:15.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:15.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345968 2024-05-08T19:01:15.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:15.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:01:15.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345968 2024-05-08T19:01:15.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:15.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345968 2024-05-08T19:01:15.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345968' 2024-05-08T19:01:15.533 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345968 2024-05-08T19:01:15.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:01:15.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345969 -lt 85899345968 2024-05-08T19:01:15.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:15.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182442 2024-05-08T19:01:15.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:15.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:01:15.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182442 2024-05-08T19:01:15.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:15.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182442 2024-05-08T19:01:15.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182442' 2024-05-08T19:01:15.964 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182442 2024-05-08T19:01:15.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:01:16.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182442 -lt 107374182442 2024-05-08T19:01:16.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:01:16.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018916 2024-05-08T19:01:16.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:01:16.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:01:16.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018916 2024-05-08T19:01:16.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:01:16.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018916 2024-05-08T19:01:16.375 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018916 2024-05-08T19:01:16.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018916' 2024-05-08T19:01:16.376 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:01:16.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018917 -lt 128849018916 2024-05-08T19:01:16.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-05-08T19:01:16.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:01:16.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:01:17.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-05-08T19:01:17.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-05-08T19:01:17.378 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-05-08T19:01:17.378 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-05-08T19:01:17.378 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-05-08T19:01:17.378 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-05-08T19:01:17.378 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-05-08T19:01:17.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-05-08T19:01:17.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-05-08T19:01:17.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-05-08T19:01:17.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-05-08T19:01:17.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-05-08T19:01:17.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:702: TEST_ec_backfill_simple: ceph pg dump pgs 2024-05-08T19:01:18.216 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T19:01:18.216 INFO:tasks.workunit.client.0.smithi117.stdout:2.0 200 0 200 200 0 3686400 0 0 100 100 100 active+undersized+degraded+remapped+backfill_toofull 2024-05-08T19:01:06.616985+0000 46'200 56:251 [3,5,1,0,4] 3 [3,5,4,0,NONE] 3 0'0 2024-05-08T18:59:30.393247+0000 0'0 2024-05-08T18:59:30.393247+0000 0 0 no scrub is scheduled 0 0 2024-05-08T19:01:18.216 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 100 active+clean 2024-05-08T19:00:35.439515+0000 39'200 56:233 [1] 1 [1] 1 0'0 2024-05-08T18:58:59.986407+0000 0'0 2024-05-08T18:58:59.986407+0000 0 0 periodic scrub scheduled @ 2024-05-09T22:21:38.018013+0000 0 0 2024-05-08T19:01:18.216 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T19:01:18.216 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T19:01:18.216 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:01:18.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:704: TEST_ec_backfill_simple: ERRORS=0 2024-05-08T19:01:18.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: ceph pg dump pgs 2024-05-08T19:01:18.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: grep -v '^1.0' 2024-05-08T19:01:18.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: grep +backfill_toofull 2024-05-08T19:01:18.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: wc -l 2024-05-08T19:01:18.616 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:01:18.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: '[' 1 '!=' 1 ']' 2024-05-08T19:01:18.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:710: TEST_ec_backfill_simple: '[' 0 '!=' 0 ']' 2024-05-08T19:01:18.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:715: TEST_ec_backfill_simple: delete_pool fillpool 2024-05-08T19:01:18.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=fillpool 2024-05-08T19:01:18.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2024-05-08T19:01:19.181 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'fillpool' does not exist 2024-05-08T19:01:19.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:716: TEST_ec_backfill_simple: seq 1 1 2024-05-08T19:01:19.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:716: TEST_ec_backfill_simple: for i in $(seq 1 $pools) 2024-05-08T19:01:19.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:718: TEST_ec_backfill_simple: delete_pool test1 2024-05-08T19:01:19.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test1 2024-05-08T19:01:19.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-05-08T19:01:19.923 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test1' does not exist 2024-05-08T19:01:19.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:720: TEST_ec_backfill_simple: kill_daemons td/osd-backfill-space 2024-05-08T19:01:19.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:01:19.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:01:19.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:01:19.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:01:19.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:01:21.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:01:21.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-05-08T19:01:21.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T19:01:21.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:01:21.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T19:01:21.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:01:21.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:01:21.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:01:21.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:01:21.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:01:21.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:01:21.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:01:21.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:01:21.268 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:01:21.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:01:21.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:01:21.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:01:21.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:01:21.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:01:21.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:01:21.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:01:21.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:01:21.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:01:21.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T19:01:21.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:01:21.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:21.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T19:01:21.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2314: main: code=0 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: teardown td/osd-backfill-space 0 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-space 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-space KILL 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:01:21.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:01:21.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:01:21.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:01:21.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:01:21.328 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:01:21.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:01:21.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:01:21.329 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:01:21.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:01:21.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:01:21.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:01:21.330 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:01:21.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:01:21.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2024-05-08T19:01:21.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-space 2024-05-08T19:01:21.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:01:21.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:21.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.109971 2024-05-08T19:01:21.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.109971 2024-05-08T19:01:21.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:01:21.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:01:21.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2319: main: return 0 2024-05-08T19:01:21.336 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T19:01:21.336 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T19:01:21.347 INFO:tasks.workunit:Running workunit osd-backfill/osd-backfill-stats.sh... 2024-05-08T19:01:21.347 DEBUG:teuthology.orchestra.run.smithi117:workunit test osd-backfill/osd-backfill-stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=95a4ad3c90f2f12f920e87725ad8d9002f948722 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh 2024-05-08T19:01:21.402 INFO:tasks.workunit.client.0.smithi117.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-05-08T19:01:21.408 INFO:tasks.workunit.client.0.smithi117.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2307: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2307: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2308: main: export PYTHONWARNINGS=ignore 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2308: main: PYTHONWARNINGS=ignore 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2309: main: export CEPH_CONF=/dev/null 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2309: main: CEPH_CONF=/dev/null 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2310: main: unset CEPH_ARGS 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2312: main: local code 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2313: main: run td/osd-backfill-stats 2024-05-08T19:01:21.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:21: run: local dir=td/osd-backfill-stats 2024-05-08T19:01:21.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:22: run: shift 2024-05-08T19:01:21.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:25: run: export CEPH_MON=127.0.0.1:7114 2024-05-08T19:01:21.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:25: run: CEPH_MON=127.0.0.1:7114 2024-05-08T19:01:21.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:26: run: export CEPH_ARGS 2024-05-08T19:01:21.410 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:27: run: uuidgen 2024-05-08T19:01:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:27: run: CEPH_ARGS+='--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none ' 2024-05-08T19:01:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7114 ' 2024-05-08T19:01:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:29: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:01:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:30: run: export margin=10 2024-05-08T19:01:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:30: run: margin=10 2024-05-08T19:01:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:31: run: export objects=200 2024-05-08T19:01:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:31: run: objects=200 2024-05-08T19:01:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:32: run: export poolname=test 2024-05-08T19:01:21.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:32: run: poolname=test 2024-05-08T19:01:21.412 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:34: run: set 2024-05-08T19:01:21.412 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:34: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-05-08T19:01:21.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:34: run: local 'funcs=TEST_backfill_down_out 2024-05-08T19:01:21.413 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_ec_all_out 2024-05-08T19:01:21.413 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_ec_down_all_out 2024-05-08T19:01:21.413 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_ec_down_out 2024-05-08T19:01:21.413 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_ec_prim_out 2024-05-08T19:01:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_out 2024-05-08T19:01:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_out2 2024-05-08T19:01:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_remapped 2024-05-08T19:01:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_sizeup 2024-05-08T19:01:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_sizeup4_allout 2024-05-08T19:01:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:TEST_backfill_sizeup_out' 2024-05-08T19:01:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:01:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:01:21.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:01:21.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:01:21.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:01:21.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:01:21.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:01:21.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:01:21.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:01:21.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:01:21.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:01:21.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:01:21.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:01:21.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:01:21.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:01:21.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:01:21.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:01:21.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:01:21.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:21.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:01:21.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:01:21.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:01:21.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:01:21.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:01:21.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:01:21.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:21.423 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:01:21.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:01:21.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:01:21.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_down_out td/osd-backfill-stats 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:278: TEST_backfill_down_out: local dir=td/osd-backfill-stats 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:280: TEST_backfill_down_out: run_mon td/osd-backfill-stats a 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:01:21.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:01:21.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:01:21.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:01:21.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:01:21.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:01:21.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:21.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:01:21.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:01:21.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:01:22.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:01:22.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:01:22.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:01:22.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:01:22.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:01:22.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:01:22.116 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:01:22.116 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:01:22.116 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:01:22.117 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:01:22.117 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:22.117 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:01:22.117 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:01:22.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:01:22.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:01:22.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:01:22.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:01:22.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:01:22.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:01:22.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:01:22.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:01:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:281: TEST_backfill_down_out: run_mgr td/osd-backfill-stats x 2024-05-08T19:01:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:01:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:01:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:01:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:01:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:01:22.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:01:23.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:01:23.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:01:23.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:01:23.342 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:01:23.342 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:23.342 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:01:23.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:01:23.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:01:23.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:01:23.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:282: TEST_backfill_down_out: run_osd td/osd-backfill-stats 0 2024-05-08T19:01:23.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:01:23.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:01:23.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:01:23.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:01:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:01:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:01:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:01:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:01:23.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:01:23.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:01:23.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=02af4b0b-9955-4d5c-867f-d7a37ba67693 2024-05-08T19:01:23.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 02af4b0b-9955-4d5c-867f-d7a37ba67693' 2024-05-08T19:01:23.384 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 02af4b0b-9955-4d5c-867f-d7a37ba67693 2024-05-08T19:01:23.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:01:23.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQADzDtmHYJBGBAANHNb24z8sAhtdibT/dhUZQ== 2024-05-08T19:01:23.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQADzDtmHYJBGBAANHNb24z8sAhtdibT/dhUZQ=="}' 2024-05-08T19:01:23.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 02af4b0b-9955-4d5c-867f-d7a37ba67693 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:01:23.764 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:01:23.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:01:23.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADzDtmHYJBGBAANHNb24z8sAhtdibT/dhUZQ== --osd-uuid 02af4b0b-9955-4d5c-867f-d7a37ba67693 2024-05-08T19:01:23.816 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:23.821+0000 7fe0bd30c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:01:23.849 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:23.853+0000 7fe0bd30c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:01:23.850 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:23.853+0000 7fe0bd30c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:01:23.851 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:23.853+0000 7fe0bd30c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:01:23.851 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:23.853+0000 7fe0bd30c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:01:23.851 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:23.853+0000 7fe0bd30c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:01:23.889 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:23.893+0000 7fe0bd30c7c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:01:31.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:01:31.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:01:31.364 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:01:31.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:01:31.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:01:31.964 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:01:31.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:01:31.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:01:31.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:01:31.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:01:31.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:01:31.997 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:32.001+0000 7f1dcda0f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:01:31.999 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:32.001+0000 7f1dcda0f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:01:32.000 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:32.005+0000 7f1dcda0f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:01:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:01:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:01:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:01:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:01:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:01:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:32.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:01:32.348 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:01:32.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:32.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:32.553 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:32.557+0000 7f1dcda0f7c0 -1 Falling back to public interface 2024-05-08T19:01:32.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:33.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:33.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:33.791 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:01:33.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:01:33.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:33.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:34.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:35.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:01:35.197 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:01:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:35.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:35.354 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:01:35.357+0000 7f1dcda0f7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:01:35.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:36.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:36.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:36.635 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:01:36.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:01:36.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:36.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:37.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:38.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:38.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:38.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:01:38.082 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:01:38.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:38.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:38.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:39.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:39.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:39.642 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:01:39.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:01:39.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:39.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:40.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:41.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:41.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:41.118 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:01:41.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:01:41.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:41.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:41.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:42.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:42.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:42.621 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:01:42.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:01:42.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:42.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:43.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:44.065 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:01:44.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:01:44.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:44.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:44.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:45.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:45.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:45.639 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:01:45.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:01:45.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:45.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:46.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:47.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:47.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:47.161 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:01:47.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:01:47.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:47.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:47.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:48.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:48.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:48.754 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:01:48.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:01:48.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:48.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:49.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:50.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:50.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:50.274 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:01:50.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:01:50.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:50.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:51.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:52.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:52.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:52.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:01:52.071 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:01:52.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:52.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:52.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:53.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:53.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:53.624 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:01:53.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:01:53.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:53.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:54.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:55.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:55.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:55.134 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:01:55.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:01:55.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:55.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:55.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:56.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:56.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:56.970 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:01:56.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:01:56.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:56.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:57.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:01:58.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:01:58.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:01:58.849 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:01:58.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:01:58.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:01:58.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:01:59.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:00.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:00.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:00.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:02:00.762 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:02:00.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:00.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:02:01.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:02.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:02.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:02.754 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:02:02.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:02:02.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:02.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:02:04.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:05.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:05.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:05.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:02:05.257 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:02:05.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:05.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:02:06.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:07.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:07.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:07.045 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:02:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:02:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:02:07.560 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2121267900,v1:127.0.0.1:6803/2121267900] [v2:127.0.0.1:6804/2121267900,v1:127.0.0.1:6805/2121267900] exists,up 02af4b0b-9955-4d5c-867f-d7a37ba67693 2024-05-08T19:02:07.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:283: TEST_backfill_down_out: run_osd td/osd-backfill-stats 1 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:02:07.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:02:07.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:02:07.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:02:07.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:02:07.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:02:07.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:02:07.567 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 4d387cc0-9538-4708-87d1-09ebc378ea53 2024-05-08T19:02:07.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4d387cc0-9538-4708-87d1-09ebc378ea53 2024-05-08T19:02:07.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 4d387cc0-9538-4708-87d1-09ebc378ea53' 2024-05-08T19:02:07.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:02:07.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAvzDtmltl3IxAAliW1Umo3sPtE1O7UaukL/A== 2024-05-08T19:02:07.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAvzDtmltl3IxAAliW1Umo3sPtE1O7UaukL/A=="}' 2024-05-08T19:02:07.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4d387cc0-9538-4708-87d1-09ebc378ea53 -i td/osd-backfill-stats/1/new.json 2024-05-08T19:02:08.151 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:02:08.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:02:08.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAvzDtmltl3IxAAliW1Umo3sPtE1O7UaukL/A== --osd-uuid 4d387cc0-9538-4708-87d1-09ebc378ea53 2024-05-08T19:02:08.199 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:08.200+0000 7f76c1a697c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:08.201 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:08.204+0000 7f76c1a697c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:08.202 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:08.204+0000 7f76c1a697c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:08.203 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:08.204+0000 7f76c1a697c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:02:08.203 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:08.204+0000 7f76c1a697c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:02:08.203 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:08.204+0000 7f76c1a697c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:02:08.267 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:08.268+0000 7f76c1a697c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:02:16.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:02:16.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:02:16.245 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:02:16.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:02:16.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:02:16.808 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:02:16.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:02:16.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:02:16.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:02:16.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:02:16.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:02:16.841 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:16.844+0000 7fe2201767c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:16.843 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:16.844+0000 7fe2201767c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:16.844 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:16.848+0000 7fe2201767c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:17.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:02:17.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:02:17.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:02:17.214 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:02:17.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:02:17.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:02:17.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:17.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:02:17.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:17.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:17.400+0000 7fe2201767c0 -1 Falling back to public interface 2024-05-08T19:02:17.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:18.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:18.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:18.621 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:02:18.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:02:18.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:18.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:19.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:20.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:20.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:20.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:02:20.044 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:02:20.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:20.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:20.264 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:20.268+0000 7fe2201767c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:02:20.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:21.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:21.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:21.499 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:02:21.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:02:21.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:21.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:22.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:23.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:23.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:23.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:02:23.010 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:02:23.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:23.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:23.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:24.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:24.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:24.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:02:24.549 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:02:24.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:24.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:25.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:26.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:26.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:26.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:02:26.080 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:02:26.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:26.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:26.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:27.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:27.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:27.741 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:02:27.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:02:27.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:27.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:28.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:29.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:29.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:29.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:02:29.320 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:02:29.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:29.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:29.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:30.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:30.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:30.861 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:02:30.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:02:30.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:30.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:31.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:32.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:32.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:32.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:02:32.509 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:02:32.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:32.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:33.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:34.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:34.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:34.046 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:02:34.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:02:34.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:34.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:34.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:35.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:35.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:35.699 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:02:35.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:02:35.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:35.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:36.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:37.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:37.111 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:02:37.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:37.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:02:37.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:37.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:37.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:38.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:38.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:38.633 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:02:38.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:02:38.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:38.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:39.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:40.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:40.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:40.527 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:02:40.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:02:40.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:40.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:41.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:42.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:42.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:42.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:02:42.765 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:02:42.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:42.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:43.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:44.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:44.713 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:02:44.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:44.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:02:44.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:44.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:45.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:46.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:46.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:46.868 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:02:46.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:02:46.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:46.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:47.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:48.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:48.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:48.879 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:02:48.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:02:48.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:48.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:49.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:50.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:50.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:50.624 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:02:50.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:02:50.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:50.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:51.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:02:52.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:02:52.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:02:52.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:02:52.597 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:02:52.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:02:52.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:02:53.048 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3254620581,v1:127.0.0.1:6811/3254620581] [v2:127.0.0.1:6812/3254620581,v1:127.0.0.1:6813/3254620581] exists,up 4d387cc0-9538-4708-87d1-09ebc378ea53 2024-05-08T19:02:53.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:284: TEST_backfill_down_out: run_osd td/osd-backfill-stats 2 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:02:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:02:53.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:02:53.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:02:53.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:02:53.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f36d71f7-53bd-484a-ba76-6c8279c86c52 2024-05-08T19:02:53.055 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 f36d71f7-53bd-484a-ba76-6c8279c86c52 2024-05-08T19:02:53.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 f36d71f7-53bd-484a-ba76-6c8279c86c52' 2024-05-08T19:02:53.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:02:53.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBdzDtmO3/1BBAAbDynVfQJxY0/q7IneIg1fA== 2024-05-08T19:02:53.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBdzDtmO3/1BBAAbDynVfQJxY0/q7IneIg1fA=="}' 2024-05-08T19:02:53.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f36d71f7-53bd-484a-ba76-6c8279c86c52 -i td/osd-backfill-stats/2/new.json 2024-05-08T19:02:53.719 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:02:53.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:02:53.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBdzDtmO3/1BBAAbDynVfQJxY0/q7IneIg1fA== --osd-uuid f36d71f7-53bd-484a-ba76-6c8279c86c52 2024-05-08T19:02:53.774 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:53.775+0000 7f5a8e4e97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:53.776 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:53.779+0000 7f5a8e4e97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:53.777 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:53.779+0000 7f5a8e4e97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:02:53.778 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:53.779+0000 7f5a8e4e97c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:02:53.778 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:53.779+0000 7f5a8e4e97c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:02:53.778 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:53.779+0000 7f5a8e4e97c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:02:53.860 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:02:53.863+0000 7f5a8e4e97c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:03:02.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:03:02.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:03:02.083 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:03:02.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:03:02.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:03:02.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:03:02.700 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:03:02.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:03:02.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:03:02.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:03:02.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:03:02.733 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:02.735+0000 7f60df6197c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:02.769 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:02.771+0000 7f60df6197c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:02.771 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:02.771+0000 7f60df6197c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:03.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:03:03.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:03:03.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:03:03.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:03:03.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:03:03.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:03.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:03:03.157 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:03:03.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:03.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:03.317 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:03.319+0000 7f60df6197c0 -1 Falling back to public interface 2024-05-08T19:03:03.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:04.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:04.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:04.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:03:04.576 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:03:04.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:04.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:04.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:05.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:05.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:05.980 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:03:05.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:03:05.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:05.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:06.223 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:06.223+0000 7f60df6197c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:03:06.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:07.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:07.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:07.496 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:03:07.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:03:07.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:07.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:08.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:09.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:09.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:09.093 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:03:09.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:03:09.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:09.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:09.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:10.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:10.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:10.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:03:10.743 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:03:10.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:10.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:11.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:12.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:12.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:12.289 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:03:12.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:03:12.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:12.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:12.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:13.785 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:03:13.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:03:13.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:13.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:14.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:15.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:15.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:15.220 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:03:15.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:03:15.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:15.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:15.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:16.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:16.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:16.837 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:03:16.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:03:16.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:16.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:17.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:18.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:18.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:18.571 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:03:18.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:03:18.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:18.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:19.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:20.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:20.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:20.176 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:03:20.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:03:20.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:20.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:20.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:21.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:21.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:21.761 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:03:21.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:03:21.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:21.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:22.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:23.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:23.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:23.365 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:03:23.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:03:23.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:23.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:23.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:24.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:24.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:24.921 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:03:24.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:03:24.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:24.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:25.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:26.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:26.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:26.538 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:03:26.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:03:26.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:26.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:27.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:28.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:28.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:28.935 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:03:28.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:03:28.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:28.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:29.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:30.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:30.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:30.903 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:03:30.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:03:30.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:30.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:31.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:32.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:32.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:32.657 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:03:32.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:03:32.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:32.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:33.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:34.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:34.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:34.672 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:03:34.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:03:34.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:34.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:36.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:37.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:37.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:37.056 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:03:37.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:03:37.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:37.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:37.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:38.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:38.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:38.792 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:03:38.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:03:38.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:38.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:03:39.191 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3124737986,v1:127.0.0.1:6819/3124737986] [v2:127.0.0.1:6820/3124737986,v1:127.0.0.1:6821/3124737986] exists,up f36d71f7-53bd-484a-ba76-6c8279c86c52 2024-05-08T19:03:39.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:285: TEST_backfill_down_out: run_osd td/osd-backfill-stats 3 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:03:39.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:03:39.195 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:03:39.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:03:39.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:03:39.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:03:39.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:03:39.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:03:39.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:03:39.197 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:03:39.198 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 6581694c-b2cd-46d9-8174-791832ceec36 2024-05-08T19:03:39.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6581694c-b2cd-46d9-8174-791832ceec36 2024-05-08T19:03:39.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 6581694c-b2cd-46d9-8174-791832ceec36' 2024-05-08T19:03:39.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:03:39.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCLzDtm5s85DRAAgBEQMbGijTgt903Q7Yhhzg== 2024-05-08T19:03:39.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCLzDtm5s85DRAAgBEQMbGijTgt903Q7Yhhzg=="}' 2024-05-08T19:03:39.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6581694c-b2cd-46d9-8174-791832ceec36 -i td/osd-backfill-stats/3/new.json 2024-05-08T19:03:39.840 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:03:39.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:03:39.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCLzDtm5s85DRAAgBEQMbGijTgt903Q7Yhhzg== --osd-uuid 6581694c-b2cd-46d9-8174-791832ceec36 2024-05-08T19:03:39.892 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:39.898+0000 7fd6f6d307c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:39.894 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:39.898+0000 7fd6f6d307c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:39.898+0000 7fd6f6d307c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:39.902+0000 7fd6f6d307c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:03:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:39.902+0000 7fd6f6d307c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:03:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:39.902+0000 7fd6f6d307c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:03:39.982 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:39.986+0000 7fd6f6d307c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:03:47.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:03:47.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:03:47.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:03:47.907 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:03:47.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:03:48.516 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:03:48.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:03:48.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:03:48.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:03:48.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:03:48.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:03:48.551 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:48.554+0000 7f29c1f9e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:48.553 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:48.558+0000 7f29c1f9e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:48.554 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:48.558+0000 7f29c1f9e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:03:48.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:03:48.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:03:48.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:03:48.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:03:48.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:03:48.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:48.938 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:03:48.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:03:48.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:48.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:03:49.094 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:49.098+0000 7f29c1f9e7c0 -1 Falling back to public interface 2024-05-08T19:03:49.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:50.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:50.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:50.392 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:03:50.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:03:50.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:50.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:03:50.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:51.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:51.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:51.803 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:03:51.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:03:51.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:51.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:03:51.968 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:03:51.974+0000 7f29c1f9e7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:03:52.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:53.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:53.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:53.283 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:03:53.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:03:53.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:53.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:03:53.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:54.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:54.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:54.798 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:03:54.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:03:54.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:54.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:03:55.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:56.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:56.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:56.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:03:56.491 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:03:56.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:56.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:03:56.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:57.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:57.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:57.931 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:03:57.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:03:57.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:57.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:03:58.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:03:59.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:03:59.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:03:59.420 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:03:59.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:03:59.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:03:59.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:03:59.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:00.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:00.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:00.865 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:04:00.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:04:00.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:00.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:01.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:02.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:02.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:02.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:04:02.366 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:04:02.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:02.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:02.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:03.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:03.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:03.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:04:03.975 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:04:03.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:03.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:04.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:05.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:05.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:05.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:04:05.457 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:04:05.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:05.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:05.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:06.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:06.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:06.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:04:06.877 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:04:06.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:06.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:07.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:08.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:08.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:08.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:04:08.508 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:04:08.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:08.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:09.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:10.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:10.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:10.189 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:04:10.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:04:10.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:10.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:10.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:11.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:11.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:11.599 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:04:11.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:04:11.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:11.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:12.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:13.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:13.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:13.210 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:04:13.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:04:13.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:13.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:13.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:14.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:14.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:14.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:04:14.977 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:04:14.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:14.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:15.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:16.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:16.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:16.841 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:04:16.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:04:16.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:16.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:18.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:19.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:19.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:19.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:04:19.266 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:04:19.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:19.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:20.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:21.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:21.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:21.169 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:04:21.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:04:21.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:21.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:21.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:22.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:22.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:22.910 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:04:22.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:04:22.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:22.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:23.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:24.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:24.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:24.606 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:04:24.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:04:24.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:24.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:04:25.041 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/142267944,v1:127.0.0.1:6827/142267944] [v2:127.0.0.1:6828/142267944,v1:127.0.0.1:6829/142267944] exists,up 6581694c-b2cd-46d9-8174-791832ceec36 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:286: TEST_backfill_down_out: run_osd td/osd-backfill-stats 4 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:04:25.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:04:25.045 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:04:25.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:04:25.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:04:25.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:04:25.048 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 e925e08a-58be-4e56-9740-6838ab810f88 2024-05-08T19:04:25.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e925e08a-58be-4e56-9740-6838ab810f88 2024-05-08T19:04:25.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 e925e08a-58be-4e56-9740-6838ab810f88' 2024-05-08T19:04:25.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:04:25.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC5zDtmeaelBBAAtHAVOHM6lg30tHwe8tEKfA== 2024-05-08T19:04:25.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC5zDtmeaelBBAAtHAVOHM6lg30tHwe8tEKfA=="}' 2024-05-08T19:04:25.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e925e08a-58be-4e56-9740-6838ab810f88 -i td/osd-backfill-stats/4/new.json 2024-05-08T19:04:25.744 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:04:25.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:04:25.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC5zDtmeaelBBAAtHAVOHM6lg30tHwe8tEKfA== --osd-uuid e925e08a-58be-4e56-9740-6838ab810f88 2024-05-08T19:04:25.802 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:25.805+0000 7f48402d67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:04:25.846 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:25.849+0000 7f48402d67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:04:25.848 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:25.853+0000 7f48402d67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:04:25.849 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:25.853+0000 7f48402d67c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:04:25.849 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:25.853+0000 7f48402d67c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:04:25.849 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:25.853+0000 7f48402d67c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:04:25.893 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:25.897+0000 7f48402d67c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:04:34.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:04:34.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:04:34.144 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:04:34.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:04:34.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:04:34.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:04:34.700 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:04:34.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:04:34.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:04:34.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:04:34.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:04:34.734 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:34.737+0000 7fd9356a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:04:34.756 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:34.761+0000 7fd9356a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:04:34.757 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:34.761+0000 7fd9356a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:04:35.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:04:35.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:04:35.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:04:35.088 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:04:35.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:04:35.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:04:35.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:35.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:04:35.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:35.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:35.306 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:35.309+0000 7fd9356a47c0 -1 Falling back to public interface 2024-05-08T19:04:35.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:36.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:36.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:36.562 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:04:36.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:04:36.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:36.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:36.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:37.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:37.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:37.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:04:37.974 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:04:37.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:37.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:38.098 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:04:38.101+0000 7fd9356a47c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:04:38.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:39.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:39.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:39.469 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:04:39.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:04:39.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:39.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:39.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:40.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:40.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:40.901 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:04:40.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:04:40.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:40.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:41.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:42.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:42.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:42.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:04:42.513 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:04:42.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:42.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:43.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:44.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:44.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:44.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:04:44.082 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:04:44.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:44.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:44.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:45.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:45.927 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:04:45.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:45.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:04:45.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:45.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:46.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:47.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:47.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:47.595 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:04:47.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:04:47.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:47.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:48.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:49.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:49.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:49.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:04:49.368 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:04:49.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:49.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:49.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:50.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:50.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:50.802 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:04:50.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:04:50.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:50.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:51.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:52.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:52.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:52.474 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:04:52.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:04:52.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:52.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:53.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:54.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:54.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:54.080 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:04:54.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:04:54.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:54.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:54.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:55.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:55.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:55.861 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:04:55.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:04:55.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:55.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:56.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:57.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:57.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:57.314 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:04:57.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:04:57.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:57.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:04:57.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:04:58.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:04:58.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:04:58.932 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:04:58.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:04:58.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:04:58.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:05:00.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:01.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:01.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:01.037 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:05:01.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:05:01.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:01.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:05:01.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:02.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:02.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:02.877 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:05:02.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:05:02.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:02.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:05:03.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:04.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:04.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:04.870 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:05:04.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:05:04.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:05:04.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:05.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:06.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:06.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:06.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:05:06.977 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:05:06.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:06.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:05:07.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:08.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:08.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:08.876 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:05:08.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:05:08.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:08.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:05:09.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:10.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:10.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:10.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:05:10.643 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:05:10.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:10.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:05:11.208 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1821557896,v1:127.0.0.1:6835/1821557896] [v2:127.0.0.1:6836/1821557896,v1:127.0.0.1:6837/1821557896] exists,up e925e08a-58be-4e56-9740-6838ab810f88 2024-05-08T19:05:11.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:05:11.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:05:11.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:05:11.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:287: TEST_backfill_down_out: run_osd td/osd-backfill-stats 5 2024-05-08T19:05:11.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/5 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:05:11.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:05:11.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:05:11.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:05:11.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:05:11.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:05:11.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:05:11.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:05:11.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:05:11.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/5 2024-05-08T19:05:11.215 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:05:11.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=fd60312c-c688-43c4-ae9b-9f339f0322d3 2024-05-08T19:05:11.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 fd60312c-c688-43c4-ae9b-9f339f0322d3' 2024-05-08T19:05:11.216 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 fd60312c-c688-43c4-ae9b-9f339f0322d3 2024-05-08T19:05:11.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:05:11.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDnzDtml4qGDhAA3bZbmwkIOCKBA9pxHcyOVQ== 2024-05-08T19:05:11.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDnzDtml4qGDhAA3bZbmwkIOCKBA9pxHcyOVQ=="}' 2024-05-08T19:05:11.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new fd60312c-c688-43c4-ae9b-9f339f0322d3 -i td/osd-backfill-stats/5/new.json 2024-05-08T19:05:11.873 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:05:11.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/5/new.json 2024-05-08T19:05:11.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnzDtml4qGDhAA3bZbmwkIOCKBA9pxHcyOVQ== --osd-uuid fd60312c-c688-43c4-ae9b-9f339f0322d3 2024-05-08T19:05:11.933 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:11.936+0000 7f5eb134e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:05:12.097 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:12.100+0000 7f5eb134e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:05:12.098 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:12.100+0000 7f5eb134e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:05:12.099 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:12.104+0000 7f5eb134e7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:05:12.099 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:12.104+0000 7f5eb134e7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:05:12.099 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:12.104+0000 7f5eb134e7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:05:12.150 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:12.152+0000 7f5eb134e7c0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-05-08T19:05:20.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-05-08T19:05:20.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:05:20.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T19:05:20.265 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T19:05:20.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:05:20.808 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T19:05:20.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T19:05:20.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:05:20.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:05:20.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:05:20.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:05:20.841 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:20.844+0000 7ff034e997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:05:20.878 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:20.880+0000 7ff034e997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:05:20.880 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:20.884+0000 7ff034e997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:05:21.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T19:05:21.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:05:21.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T19:05:21.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:05:21.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:05:21.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:21.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:05:21.250 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:05:21.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:21.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:21.445 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:21.448+0000 7ff034e997c0 -1 Falling back to public interface 2024-05-08T19:05:21.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:22.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:22.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:22.728 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:05:22.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:05:22.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:22.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:23.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:24.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:24.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:24.160 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:05:24.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:05:24.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:24.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:24.352 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:05:24.356+0000 7ff034e997c0 -1 osd.5 0 log_to_monitors true 2024-05-08T19:05:24.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:25.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:25.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:25.656 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:05:25.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:05:25.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:25.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:26.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:27.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:27.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:27.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:05:27.141 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:05:27.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:27.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:27.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:28.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:28.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:28.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:05:28.646 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:05:28.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:28.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:29.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:30.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:30.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:30.271 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:05:30.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:05:30.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:30.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:30.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:31.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:31.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:31.806 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:05:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:05:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:33.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:33.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:33.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:05:33.267 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:05:33.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:33.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:33.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:34.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:34.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:34.819 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:05:34.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:05:34.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:34.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:35.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:36.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:36.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:36.528 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:05:36.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:05:36.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:36.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:37.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:38.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:38.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:38.187 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:05:38.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:05:38.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:38.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:38.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:39.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:39.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:39.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:05:39.761 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:05:39.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:39.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:40.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:41.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:41.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:41.375 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:05:41.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:05:41.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:41.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:41.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:42.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:42.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:42.872 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:05:42.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:05:42.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:42.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:43.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:44.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:44.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:44.373 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:05:44.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:05:44.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:44.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:45.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:46.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:46.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:46.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:05:46.648 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:05:46.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:46.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:47.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:48.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:48.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:48.484 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:05:48.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:05:48.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:48.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:49.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:50.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:50.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:50.470 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:05:50.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:05:50.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:50.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:50.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:51.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:51.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:51.969 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:05:51.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:05:51.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:51.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:52.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:53.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:53.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:53.973 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:05:53.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:05:53.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:53.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:54.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:55.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:55.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:55.985 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:05:55.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:05:55.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:55.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:56.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:05:57.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:05:57.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:05:57.502 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:05:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:05:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:05:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:05:57.941 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2136700659,v1:127.0.0.1:6843/2136700659] [v2:127.0.0.1:6844/2136700659,v1:127.0.0.1:6845/2136700659] exists,up fd60312c-c688-43c4-ae9b-9f339f0322d3 2024-05-08T19:05:57.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:05:57.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:05:57.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:05:57.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:289: TEST_backfill_down_out: create_pool test 1 1 2024-05-08T19:05:57.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T19:05:58.529 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:05:58.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:05:59.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:290: TEST_backfill_down_out: ceph osd pool set test size 2 2024-05-08T19:06:00.577 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T19:06:00.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:291: TEST_backfill_down_out: sleep 5 2024-05-08T19:06:05.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:293: TEST_backfill_down_out: wait_for_clean 2024-05-08T19:06:05.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:06:05.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:06:05.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:06:05.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:06:05.602 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:06:05.602 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:06:05.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:06:05.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:06:05.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:06:05.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:06:05.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:06:05.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:06:05.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:06:05.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:06:05.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:06:06.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:06:06.141 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:06:06.141 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:06:06.141 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:06:06.142 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:06:06.142 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:06:06.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:06:06.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:06.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:06:06.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836536 2024-05-08T19:06:06.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836536 2024-05-08T19:06:06.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536' 2024-05-08T19:06:06.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:06.327 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:06:06.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673004 2024-05-08T19:06:06.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673004 2024-05-08T19:06:06.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673004' 2024-05-08T19:06:06.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:06.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:06:06.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509481 2024-05-08T19:06:06.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509481 2024-05-08T19:06:06.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673004 2-64424509481' 2024-05-08T19:06:06.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:06.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:06:06.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345944 2024-05-08T19:06:06.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345944 2024-05-08T19:06:06.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673004 2-64424509481 3-85899345944' 2024-05-08T19:06:06.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:06.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:06:06.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182419 2024-05-08T19:06:06.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182419 2024-05-08T19:06:06.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673004 2-64424509481 3-85899345944 4-107374182419' 2024-05-08T19:06:06.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:06.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:06:07.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018890 2024-05-08T19:06:07.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018890 2024-05-08T19:06:07.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673004 2-64424509481 3-85899345944 4-107374182419 5-128849018890' 2024-05-08T19:06:07.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:07.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836536 2024-05-08T19:06:07.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:07.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:06:07.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836536 2024-05-08T19:06:07.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:07.154 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836536 2024-05-08T19:06:07.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836536 2024-05-08T19:06:07.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836536' 2024-05-08T19:06:07.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:06:07.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836534 -lt 21474836536 2024-05-08T19:06:07.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:06:08.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:06:08.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:06:08.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836537 -lt 21474836536 2024-05-08T19:06:08.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:08.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:08.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673004 2024-05-08T19:06:08.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:06:08.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673004 2024-05-08T19:06:08.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:08.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673004 2024-05-08T19:06:08.971 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673004 2024-05-08T19:06:08.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673004' 2024-05-08T19:06:08.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:06:09.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673004 -lt 42949673004 2024-05-08T19:06:09.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:09.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509481 2024-05-08T19:06:09.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:09.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:06:09.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509481 2024-05-08T19:06:09.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:09.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509481 2024-05-08T19:06:09.373 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509481 2024-05-08T19:06:09.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509481' 2024-05-08T19:06:09.373 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:06:09.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509481 -lt 64424509481 2024-05-08T19:06:09.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:09.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345944 2024-05-08T19:06:09.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:09.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:06:09.809 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345944 2024-05-08T19:06:09.809 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:09.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345944 2024-05-08T19:06:09.811 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345944 2024-05-08T19:06:09.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345944' 2024-05-08T19:06:09.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:06:10.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345945 -lt 85899345944 2024-05-08T19:06:10.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:10.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182419 2024-05-08T19:06:10.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:10.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:06:10.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182419 2024-05-08T19:06:10.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:10.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182419 2024-05-08T19:06:10.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182419' 2024-05-08T19:06:10.262 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182419 2024-05-08T19:06:10.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:06:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182419 -lt 107374182419 2024-05-08T19:06:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:10.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018890 2024-05-08T19:06:10.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:10.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:06:10.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018890 2024-05-08T19:06:10.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:10.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018890 2024-05-08T19:06:10.659 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018890 2024-05-08T19:06:10.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018890' 2024-05-08T19:06:10.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:06:11.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018890 -lt 128849018890 2024-05-08T19:06:11.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:06:11.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:06:11.072 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:06:11.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:06:11.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:06:11.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:06:11.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:06:11.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:06:11.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:06:11.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:06:11.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:06:12.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:06:12.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:06:12.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:06:12.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:06:12.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:06:12.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:06:12.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:06:12.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: seq 1 200 2024-05-08T19:06:12.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:12.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj1 /dev/null 2024-05-08T19:06:12.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:12.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj2 /dev/null 2024-05-08T19:06:12.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:12.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj3 /dev/null 2024-05-08T19:06:13.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:13.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj4 /dev/null 2024-05-08T19:06:13.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:13.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj5 /dev/null 2024-05-08T19:06:13.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:13.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj6 /dev/null 2024-05-08T19:06:13.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:13.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj7 /dev/null 2024-05-08T19:06:13.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:13.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj8 /dev/null 2024-05-08T19:06:13.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:13.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj9 /dev/null 2024-05-08T19:06:13.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:13.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj10 /dev/null 2024-05-08T19:06:14.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:14.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj11 /dev/null 2024-05-08T19:06:14.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:14.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj12 /dev/null 2024-05-08T19:06:14.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:14.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj13 /dev/null 2024-05-08T19:06:14.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:14.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj14 /dev/null 2024-05-08T19:06:14.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:14.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj15 /dev/null 2024-05-08T19:06:14.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:14.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj16 /dev/null 2024-05-08T19:06:14.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:14.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj17 /dev/null 2024-05-08T19:06:15.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:15.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj18 /dev/null 2024-05-08T19:06:15.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:15.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj19 /dev/null 2024-05-08T19:06:15.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:15.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj20 /dev/null 2024-05-08T19:06:15.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:15.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj21 /dev/null 2024-05-08T19:06:15.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:15.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj22 /dev/null 2024-05-08T19:06:15.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:15.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj23 /dev/null 2024-05-08T19:06:15.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:15.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj24 /dev/null 2024-05-08T19:06:16.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:16.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj25 /dev/null 2024-05-08T19:06:16.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:16.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj26 /dev/null 2024-05-08T19:06:16.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:16.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj27 /dev/null 2024-05-08T19:06:16.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:16.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj28 /dev/null 2024-05-08T19:06:16.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:16.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj29 /dev/null 2024-05-08T19:06:16.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:16.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj30 /dev/null 2024-05-08T19:06:17.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:17.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj31 /dev/null 2024-05-08T19:06:17.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:17.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj32 /dev/null 2024-05-08T19:06:17.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:17.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj33 /dev/null 2024-05-08T19:06:17.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:17.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj34 /dev/null 2024-05-08T19:06:17.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:17.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj35 /dev/null 2024-05-08T19:06:17.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:17.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj36 /dev/null 2024-05-08T19:06:17.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:17.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj37 /dev/null 2024-05-08T19:06:17.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:17.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj38 /dev/null 2024-05-08T19:06:18.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:18.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj39 /dev/null 2024-05-08T19:06:18.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:18.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj40 /dev/null 2024-05-08T19:06:18.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:18.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj41 /dev/null 2024-05-08T19:06:18.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:18.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj42 /dev/null 2024-05-08T19:06:18.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:18.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj43 /dev/null 2024-05-08T19:06:18.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:18.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj44 /dev/null 2024-05-08T19:06:19.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:19.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj45 /dev/null 2024-05-08T19:06:19.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:19.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj46 /dev/null 2024-05-08T19:06:19.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:19.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj47 /dev/null 2024-05-08T19:06:19.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:19.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj48 /dev/null 2024-05-08T19:06:19.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:19.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj49 /dev/null 2024-05-08T19:06:19.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:19.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj50 /dev/null 2024-05-08T19:06:19.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:19.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj51 /dev/null 2024-05-08T19:06:19.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:19.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj52 /dev/null 2024-05-08T19:06:20.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:20.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj53 /dev/null 2024-05-08T19:06:20.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:20.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj54 /dev/null 2024-05-08T19:06:20.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:20.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj55 /dev/null 2024-05-08T19:06:20.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:20.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj56 /dev/null 2024-05-08T19:06:20.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:20.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj57 /dev/null 2024-05-08T19:06:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:20.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj58 /dev/null 2024-05-08T19:06:20.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:20.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj59 /dev/null 2024-05-08T19:06:21.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:21.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj60 /dev/null 2024-05-08T19:06:21.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:21.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj61 /dev/null 2024-05-08T19:06:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:21.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj62 /dev/null 2024-05-08T19:06:21.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:21.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj63 /dev/null 2024-05-08T19:06:21.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:21.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj64 /dev/null 2024-05-08T19:06:21.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:21.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj65 /dev/null 2024-05-08T19:06:21.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:21.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj66 /dev/null 2024-05-08T19:06:22.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:22.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj67 /dev/null 2024-05-08T19:06:22.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:22.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj68 /dev/null 2024-05-08T19:06:22.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:22.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj69 /dev/null 2024-05-08T19:06:22.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:22.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj70 /dev/null 2024-05-08T19:06:22.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:22.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj71 /dev/null 2024-05-08T19:06:22.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:22.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj72 /dev/null 2024-05-08T19:06:22.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:22.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj73 /dev/null 2024-05-08T19:06:23.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:23.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj74 /dev/null 2024-05-08T19:06:23.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:23.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj75 /dev/null 2024-05-08T19:06:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:23.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj76 /dev/null 2024-05-08T19:06:23.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:23.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj77 /dev/null 2024-05-08T19:06:23.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:23.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj78 /dev/null 2024-05-08T19:06:23.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:23.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj79 /dev/null 2024-05-08T19:06:23.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:23.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj80 /dev/null 2024-05-08T19:06:24.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:24.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj81 /dev/null 2024-05-08T19:06:24.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:24.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj82 /dev/null 2024-05-08T19:06:24.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:24.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj83 /dev/null 2024-05-08T19:06:24.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:24.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj84 /dev/null 2024-05-08T19:06:24.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:24.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj85 /dev/null 2024-05-08T19:06:24.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:24.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj86 /dev/null 2024-05-08T19:06:24.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:24.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj87 /dev/null 2024-05-08T19:06:25.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:25.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj88 /dev/null 2024-05-08T19:06:25.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:25.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj89 /dev/null 2024-05-08T19:06:25.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:25.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj90 /dev/null 2024-05-08T19:06:25.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:25.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj91 /dev/null 2024-05-08T19:06:25.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:25.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj92 /dev/null 2024-05-08T19:06:25.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:25.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj93 /dev/null 2024-05-08T19:06:25.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:25.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj94 /dev/null 2024-05-08T19:06:26.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:26.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj95 /dev/null 2024-05-08T19:06:26.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:26.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj96 /dev/null 2024-05-08T19:06:26.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:26.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj97 /dev/null 2024-05-08T19:06:26.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:26.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj98 /dev/null 2024-05-08T19:06:26.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:26.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj99 /dev/null 2024-05-08T19:06:26.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:26.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj100 /dev/null 2024-05-08T19:06:27.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:27.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj101 /dev/null 2024-05-08T19:06:27.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:27.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj102 /dev/null 2024-05-08T19:06:27.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:27.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj103 /dev/null 2024-05-08T19:06:27.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:27.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj104 /dev/null 2024-05-08T19:06:27.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:27.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj105 /dev/null 2024-05-08T19:06:27.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:27.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj106 /dev/null 2024-05-08T19:06:27.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:27.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj107 /dev/null 2024-05-08T19:06:28.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:28.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj108 /dev/null 2024-05-08T19:06:28.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:28.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj109 /dev/null 2024-05-08T19:06:28.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:28.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj110 /dev/null 2024-05-08T19:06:28.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:28.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj111 /dev/null 2024-05-08T19:06:28.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:28.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj112 /dev/null 2024-05-08T19:06:28.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:28.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj113 /dev/null 2024-05-08T19:06:29.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:29.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj114 /dev/null 2024-05-08T19:06:29.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:29.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj115 /dev/null 2024-05-08T19:06:29.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:29.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj116 /dev/null 2024-05-08T19:06:29.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:29.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj117 /dev/null 2024-05-08T19:06:29.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:29.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj118 /dev/null 2024-05-08T19:06:29.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:29.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj119 /dev/null 2024-05-08T19:06:29.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:29.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj120 /dev/null 2024-05-08T19:06:29.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:29.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj121 /dev/null 2024-05-08T19:06:30.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:30.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj122 /dev/null 2024-05-08T19:06:30.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:30.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj123 /dev/null 2024-05-08T19:06:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj124 /dev/null 2024-05-08T19:06:30.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:30.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj125 /dev/null 2024-05-08T19:06:30.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:30.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj126 /dev/null 2024-05-08T19:06:30.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:30.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj127 /dev/null 2024-05-08T19:06:31.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:31.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj128 /dev/null 2024-05-08T19:06:31.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:31.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj129 /dev/null 2024-05-08T19:06:31.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:31.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj130 /dev/null 2024-05-08T19:06:31.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:31.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj131 /dev/null 2024-05-08T19:06:31.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:31.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj132 /dev/null 2024-05-08T19:06:31.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:31.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj133 /dev/null 2024-05-08T19:06:31.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:31.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj134 /dev/null 2024-05-08T19:06:31.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:31.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj135 /dev/null 2024-05-08T19:06:32.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:32.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj136 /dev/null 2024-05-08T19:06:32.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:32.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj137 /dev/null 2024-05-08T19:06:32.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:32.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj138 /dev/null 2024-05-08T19:06:32.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:32.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj139 /dev/null 2024-05-08T19:06:32.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:32.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj140 /dev/null 2024-05-08T19:06:32.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:32.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj141 /dev/null 2024-05-08T19:06:33.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:33.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj142 /dev/null 2024-05-08T19:06:33.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:33.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj143 /dev/null 2024-05-08T19:06:33.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:33.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj144 /dev/null 2024-05-08T19:06:33.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:33.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj145 /dev/null 2024-05-08T19:06:33.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:33.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj146 /dev/null 2024-05-08T19:06:33.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:33.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj147 /dev/null 2024-05-08T19:06:33.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:33.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj148 /dev/null 2024-05-08T19:06:34.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:34.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj149 /dev/null 2024-05-08T19:06:34.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:34.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj150 /dev/null 2024-05-08T19:06:34.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:34.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj151 /dev/null 2024-05-08T19:06:34.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:34.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj152 /dev/null 2024-05-08T19:06:34.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:34.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj153 /dev/null 2024-05-08T19:06:34.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:34.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj154 /dev/null 2024-05-08T19:06:34.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:34.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj155 /dev/null 2024-05-08T19:06:35.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:35.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj156 /dev/null 2024-05-08T19:06:35.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:35.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj157 /dev/null 2024-05-08T19:06:35.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:35.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj158 /dev/null 2024-05-08T19:06:35.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:35.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj159 /dev/null 2024-05-08T19:06:35.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:35.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj160 /dev/null 2024-05-08T19:06:35.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:35.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj161 /dev/null 2024-05-08T19:06:35.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:35.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj162 /dev/null 2024-05-08T19:06:36.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:36.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj163 /dev/null 2024-05-08T19:06:36.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:36.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj164 /dev/null 2024-05-08T19:06:36.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:36.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj165 /dev/null 2024-05-08T19:06:36.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:36.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj166 /dev/null 2024-05-08T19:06:36.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:36.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj167 /dev/null 2024-05-08T19:06:36.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:36.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj168 /dev/null 2024-05-08T19:06:37.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:37.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj169 /dev/null 2024-05-08T19:06:37.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:37.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj170 /dev/null 2024-05-08T19:06:37.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:37.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj171 /dev/null 2024-05-08T19:06:37.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:37.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj172 /dev/null 2024-05-08T19:06:37.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:37.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj173 /dev/null 2024-05-08T19:06:37.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:37.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj174 /dev/null 2024-05-08T19:06:37.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:37.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj175 /dev/null 2024-05-08T19:06:38.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:38.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj176 /dev/null 2024-05-08T19:06:38.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:38.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj177 /dev/null 2024-05-08T19:06:38.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:38.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj178 /dev/null 2024-05-08T19:06:38.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:38.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj179 /dev/null 2024-05-08T19:06:38.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:38.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj180 /dev/null 2024-05-08T19:06:38.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:38.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj181 /dev/null 2024-05-08T19:06:39.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:39.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj182 /dev/null 2024-05-08T19:06:39.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:39.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj183 /dev/null 2024-05-08T19:06:39.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:39.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj184 /dev/null 2024-05-08T19:06:39.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:39.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj185 /dev/null 2024-05-08T19:06:39.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:39.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj186 /dev/null 2024-05-08T19:06:39.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:39.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj187 /dev/null 2024-05-08T19:06:39.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:39.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj188 /dev/null 2024-05-08T19:06:40.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:40.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj189 /dev/null 2024-05-08T19:06:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj190 /dev/null 2024-05-08T19:06:40.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:40.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj191 /dev/null 2024-05-08T19:06:40.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:40.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj192 /dev/null 2024-05-08T19:06:40.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:40.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj193 /dev/null 2024-05-08T19:06:40.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:40.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj194 /dev/null 2024-05-08T19:06:40.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:40.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj195 /dev/null 2024-05-08T19:06:41.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:41.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj196 /dev/null 2024-05-08T19:06:41.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:41.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj197 /dev/null 2024-05-08T19:06:41.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:41.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj198 /dev/null 2024-05-08T19:06:41.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:41.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj199 /dev/null 2024-05-08T19:06:41.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-05-08T19:06:41.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj200 /dev/null 2024-05-08T19:06:41.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:300: TEST_backfill_down_out: get_pg test obj1 2024-05-08T19:06:41.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:06:41.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:06:41.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:06:41.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:06:42.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:300: TEST_backfill_down_out: local PG=1.0 2024-05-08T19:06:42.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:302: TEST_backfill_down_out: get_primary test obj1 2024-05-08T19:06:42.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:06:42.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:06:42.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:06:42.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:06:42.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:302: TEST_backfill_down_out: local primary=1 2024-05-08T19:06:42.712 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:303: TEST_backfill_down_out: get_not_primary test obj1 2024-05-08T19:06:42.712 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T19:06:42.712 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T19:06:42.712 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T19:06:42.713 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:06:42.713 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:06:42.713 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:06:42.713 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:06:43.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T19:06:43.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T19:06:43.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T19:06:43.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:303: TEST_backfill_down_out: local otherosd=0 2024-05-08T19:06:43.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:305: TEST_backfill_down_out: ceph osd set nobackfill 2024-05-08T19:06:44.358 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:06:44.378 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:306: TEST_backfill_down_out: cat td/osd-backfill-stats/osd.0.pid 2024-05-08T19:06:44.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:306: TEST_backfill_down_out: kill 474966 2024-05-08T19:06:44.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:307: TEST_backfill_down_out: ceph osd down osd.0 2024-05-08T19:06:44.945 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already down. 2024-05-08T19:06:44.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:308: TEST_backfill_down_out: ceph osd out osd.0 2024-05-08T19:06:46.099 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T19:06:46.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:309: TEST_backfill_down_out: sleep 2 2024-05-08T19:06:48.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:310: TEST_backfill_down_out: ceph osd unset nobackfill 2024-05-08T19:06:48.900 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:06:48.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:312: TEST_backfill_down_out: wait_for_clean 2024-05-08T19:06:48.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:06:48.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:06:48.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:06:48.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:06:48.929 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:06:48.929 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:06:48.930 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:06:48.930 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:06:48.930 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:06:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:06:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:06:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:06:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:06:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:06:49.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:06:49.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:06:49.681 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:06:49.681 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:06:49.681 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:06:49.681 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:06:49.681 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:06:49.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:06:49.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:49.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:06:49.880 INFO:tasks.workunit.client.0.smithi117.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-05-08T19:06:49.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq= 2024-05-08T19:06:49.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z '' 2024-05-08T19:06:49.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: continue 2024-05-08T19:06:49.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:49.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:06:50.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673015 2024-05-08T19:06:50.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673015 2024-05-08T19:06:50.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673015' 2024-05-08T19:06:50.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:50.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:06:50.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509492 2024-05-08T19:06:50.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509492 2024-05-08T19:06:50.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673015 2-64424509492' 2024-05-08T19:06:50.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:50.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:06:50.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345955 2024-05-08T19:06:50.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345955 2024-05-08T19:06:50.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673015 2-64424509492 3-85899345955' 2024-05-08T19:06:50.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:50.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:06:50.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182429 2024-05-08T19:06:50.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182429 2024-05-08T19:06:50.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673015 2-64424509492 3-85899345955 4-107374182429' 2024-05-08T19:06:50.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:06:50.656 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:06:50.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018900 2024-05-08T19:06:50.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018900 2024-05-08T19:06:50.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673015 2-64424509492 3-85899345955 4-107374182429 5-128849018900' 2024-05-08T19:06:50.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:50.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673015 2024-05-08T19:06:50.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:50.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:06:50.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673015 2024-05-08T19:06:50.821 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:50.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673015 2024-05-08T19:06:50.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673015' 2024-05-08T19:06:50.823 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673015 2024-05-08T19:06:50.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:06:51.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673013 -lt 42949673015 2024-05-08T19:06:51.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:06:52.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:06:52.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:06:52.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673015 -lt 42949673015 2024-05-08T19:06:52.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:52.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509492 2024-05-08T19:06:52.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:52.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:06:52.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509492 2024-05-08T19:06:52.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:52.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509492 2024-05-08T19:06:52.794 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509492 2024-05-08T19:06:52.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509492' 2024-05-08T19:06:52.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:06:53.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509492 -lt 64424509492 2024-05-08T19:06:53.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:53.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:53.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345955 2024-05-08T19:06:53.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:06:53.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345955 2024-05-08T19:06:53.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:53.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345955 2024-05-08T19:06:53.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345955' 2024-05-08T19:06:53.243 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345955 2024-05-08T19:06:53.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:06:53.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345955 -lt 85899345955 2024-05-08T19:06:53.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:53.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182429 2024-05-08T19:06:53.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:53.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:06:53.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182429 2024-05-08T19:06:53.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:53.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182429 2024-05-08T19:06:53.746 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182429 2024-05-08T19:06:53.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182429' 2024-05-08T19:06:53.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:06:54.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182430 -lt 107374182429 2024-05-08T19:06:54.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:06:54.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018900 2024-05-08T19:06:54.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:06:54.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:06:54.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018900 2024-05-08T19:06:54.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:06:54.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018900 2024-05-08T19:06:54.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018900' 2024-05-08T19:06:54.202 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018900 2024-05-08T19:06:54.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:06:54.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018901 -lt 128849018900 2024-05-08T19:06:54.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:06:54.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:06:54.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:06:55.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:06:55.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:06:55.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:06:55.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:06:55.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:06:55.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:06:55.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:06:55.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:06:55.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:06:55.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:06:55.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:06:55.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:06:56.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:06:56.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:06:56.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:06:56.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:06:56.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:06:56.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:06:56.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:06:56.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:06:56.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:06:56.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:06:56.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:06:56.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:06:56.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:06:56.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:06:56.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:06:56.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:06:56.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:06:56.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:06:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:06:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:06:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:06:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:06:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:06:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:06:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:06:57.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:06:57.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:06:58.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:06:58.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:06:58.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:06:58.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:06:58.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:06:58.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:06:58.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:06:58.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:06:58.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:06:58.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:06:58.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:06:58.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:06:58.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:06:58.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:06:58.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:06:58.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:06:58.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:06:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:06:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:06:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:06:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:06:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:06:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:06:59.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:06:59.292 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:06:59.292 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:06:59.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T19:06:59.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T19:06:59.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:06:59.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:06:59.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:06:59.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:06:59.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:06:59.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:06:59.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:06:59.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:06:59.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:06:59.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:06:59.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:00.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:00.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:00.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:00.512 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:01.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:01.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:01.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:01.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:01.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:01.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:01.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:01.077 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:01.077 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:01.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:07:01.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:07:01.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:01.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:01.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:01.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:01.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:01.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:01.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:01.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:01.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:01.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:01.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:02.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:02.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:02.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:02.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:02.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:02.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:02.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:02.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:02.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:02.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:02.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:02.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:02.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:03.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:07:03.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:07:03.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:03.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:03.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:03.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:03.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:03.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:03.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:03.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:03.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:03.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:03.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:03.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:03.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:03.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:03.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:04.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:04.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:04.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:05.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=7 2024-05-08T19:07:05.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 7 '!=' null 2024-05-08T19:07:05.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:05.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:05.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:05.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:05.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:05.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:05.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:05.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:05.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:05.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:05.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:05.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:05.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:05.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:05.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:06.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:06.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:06.042 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:06.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:07:06.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:07:06.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:06.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:06.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:06.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:06.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:06.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:06.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:06.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:06.880 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:06.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:06.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:07.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:07.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:07.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:07.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:07.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:07.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:07.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:08.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:07:08.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:07:08.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:08.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:08.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:08.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:08.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:08.713 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:08.713 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:08.713 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:08.713 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:08.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:08.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:09.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:09.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:09.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:09.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:09.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:09.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:09.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:09.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:09.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:09.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:09.784 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:09.784 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:10.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:07:10.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:07:10.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:10.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:10.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:10.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:10.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:10.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:10.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:10.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:10.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:10.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:10.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:10.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:10.876 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:10.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:10.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:11.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:11.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:07:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:07:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:12.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:12.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:12.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:12.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:12.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:12.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:12.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:12.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:12.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:12.545 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:12.546 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:12.546 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:13.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:13.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:13.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:13.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:13.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:13.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:13.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:13.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:13.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:13.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:07:13.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:07:13.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:13.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:13.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:13.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:13.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:13.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:13.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:13.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:13.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:13.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:13.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:14.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:14.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:14.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:14.429 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:14.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:14.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:14.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:14.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:14.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:14.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:14.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:14.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:14.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:07:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:07:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:15.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:15.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:15.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:15.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:15.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:15.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:15.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:15.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:15.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:16.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:16.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:16.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:16.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:16.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:16.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:16.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:16.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:16.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:16.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:16.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:16.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:16.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:17.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:07:17.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:07:17.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:17.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:17.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:17.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:17.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:17.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:17.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:17.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:17.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:17.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:17.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:17.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:17.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:17.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:18.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:18.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:18.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:18.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:18.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:18.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:18.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:18.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:18.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:18.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:07:18.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:07:18.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:18.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:18.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:19.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:19.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:19.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:19.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:19.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:19.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:19.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:19.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:19.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:19.556 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:19.556 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:19.556 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:20.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:20.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:20.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:20.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:20.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:20.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:20.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:20.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:20.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:20.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:07:20.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:07:20.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:20.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:20.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:20.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:20.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:20.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:20.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:20.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:20.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:20.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:20.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:21.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:21.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:21.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:21.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:21.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:21.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:21.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:21.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:21.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:21.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:21.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:21.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:21.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:22.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:07:22.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:07:22.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:22.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:22.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:22.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:22.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:22.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:22.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:22.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:22.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:22.553 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:22.553 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:22.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:07:22.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:22.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:22.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:07:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:07:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:07:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:07:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:07:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:07:23.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:07:23.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:07:23.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:07:24.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:07:24.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:07:24.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:07:24.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:07:24.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:07:24.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:07:24.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:07:24.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:07:24.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:07:24.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:07:24.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:07:24.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:07:24.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:07:24.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:07:24.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:07:24.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:07:24.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:314: TEST_backfill_down_out: check td/osd-backfill-stats 1.0 1 replicated 200 0 0 0 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=200 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=0 2024-05-08T19:07:25.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-05-08T19:07:25.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:07:25.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:07:25.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:07:25.144 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:07:25.149 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-05-08T19:07:25.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:07:25.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:07:25.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:07:25.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-05-08T19:07:25.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:07:25.167 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.168 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:07:25.168 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:07:25.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[1,2]/[1]' 2024-05-08T19:07:25.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[1,2]/[1]' ']' 2024-05-08T19:07:25.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:07:25.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:07:25.183 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.183 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [1,2]/[1] ' 2024-05-08T19:07:25.183 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:07:25.183 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:07:25.183 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:07:25.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=200 2024-05-08T19:07:25.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2024-05-08T19:07:25.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 200 200 2024-05-08T19:07:25.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-05-08T19:07:25.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:07:25.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-05-08T19:07:25.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:07:25.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:07:25.190 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.190 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:07:25.190 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:07:25.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=1 2024-05-08T19:07:25.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2024-05-08T19:07:25.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 1 0 2024-05-08T19:07:25.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-05-08T19:07:25.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:07:25.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:07:25.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:07:25.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:07:25.198 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:07:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [1,2]/[1] ' 2024-05-08T19:07:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:07:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:07:25.199 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:07:25.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=0 2024-05-08T19:07:25.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2024-05-08T19:07:25.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 0 0 2024-05-08T19:07:25.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-05-08T19:07:25.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:07:25.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-05-08T19:07:25.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:07:25.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:07:25.205 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:07:25.205 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:07:25.205 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:07:25.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=0 2024-05-08T19:07:25.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2024-05-08T19:07:25.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 0 0 2024-05-08T19:07:25.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-05-08T19:07:25.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:07:25.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:07:25.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:07:25.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:07:25.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:316: TEST_backfill_down_out: delete_pool test 2024-05-08T19:07:25.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:07:25.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:07:25.841 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:07:25.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:317: TEST_backfill_down_out: kill_daemons td/osd-backfill-stats 2024-05-08T19:07:25.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:07:25.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:07:25.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:07:25.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:07:25.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:07:27.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:07:27.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:07:27.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:07:27.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:07:27.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:07:27.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:07:27.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:07:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:07:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:07:27.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:07:27.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:07:27.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:07:27.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:07:27.186 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:07:27.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:07:27.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:07:27.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:07:27.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:07:27.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:07:27.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:07:27.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:07:27.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:07:27.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:07:27.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:07:27.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:07:27.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:07:27.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:07:27.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:07:27.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:07:27.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:07:27.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:07:27.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:07:27.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:07:27.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:07:27.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:07:27.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:07:27.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:07:27.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:07:27.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:07:27.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:07:27.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:07:27.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:07:27.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:07:27.235 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:07:27.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:07:27.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:07:27.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:07:27.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:07:27.237 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:07:27.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:07:27.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:07:27.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:07:27.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:07:27.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:07:27.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:07:27.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:07:27.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:07:27.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:07:27.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:07:27.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:07:27.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:07:27.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:07:27.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:07:27.244 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:07:27.244 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:07:27.244 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:07:27.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_ec_all_out td/osd-backfill-stats 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:515: TEST_backfill_ec_all_out: local dir=td/osd-backfill-stats 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:517: TEST_backfill_ec_all_out: run_mon td/osd-backfill-stats a 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:07:27.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:07:27.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:07:27.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:07:27.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:07:27.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:07:27.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:07:27.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:07:27.682 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:07:27.683 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:07:27.683 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:07:27.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:07:27.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:07:27.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:07:27.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:07:27.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:07:27.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:07:27.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:07:27.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:07:27.917 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:07:27.917 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:07:27.917 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:07:27.918 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:07:27.918 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:07:27.918 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:07:27.918 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:07:27.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:07:27.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:07:28.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:07:28.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:07:28.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:07:28.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:07:28.035 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:07:28.035 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:07:28.035 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:07:28.035 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:07:28.035 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:07:28.035 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:07:28.035 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:07:28.036 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:07:28.036 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:07:28.036 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:07:28.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:518: TEST_backfill_ec_all_out: run_mgr td/osd-backfill-stats x 2024-05-08T19:07:28.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:07:28.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:07:28.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:07:28.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:07:28.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:07:28.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:07:29.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:07:29.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:07:29.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:07:29.888 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:07:29.888 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:07:29.888 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:07:29.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:07:29.889 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:07:29.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:07:29.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:519: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 0 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:07:29.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:07:29.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:07:29.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=053bbe9d-1084-418f-9915-fe4711ba0431 2024-05-08T19:07:29.930 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 053bbe9d-1084-418f-9915-fe4711ba0431 2024-05-08T19:07:29.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 053bbe9d-1084-418f-9915-fe4711ba0431' 2024-05-08T19:07:29.930 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:07:29.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBxzTtmOp3iOBAAGAe+NSld/efMSZP49GBk3g== 2024-05-08T19:07:29.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBxzTtmOp3iOBAAGAe+NSld/efMSZP49GBk3g=="}' 2024-05-08T19:07:29.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 053bbe9d-1084-418f-9915-fe4711ba0431 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:07:30.278 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:07:30.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:07:30.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBxzTtmOp3iOBAAGAe+NSld/efMSZP49GBk3g== --osd-uuid 053bbe9d-1084-418f-9915-fe4711ba0431 2024-05-08T19:07:30.328 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:30.333+0000 7f17469077c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:07:30.365 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:30.369+0000 7f17469077c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:07:30.366 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:30.373+0000 7f17469077c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:07:30.367 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:30.373+0000 7f17469077c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:07:30.367 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:30.373+0000 7f17469077c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:07:30.367 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:30.373+0000 7f17469077c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:07:30.403 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:30.409+0000 7f17469077c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:07:38.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:07:38.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:07:38.250 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:07:38.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:07:38.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:07:38.804 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:07:38.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:07:38.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:07:38.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:07:38.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:07:38.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:07:38.838 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:38.845+0000 7f06a3c8f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:07:38.841 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:38.845+0000 7f06a3c8f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:07:38.842 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:38.845+0000 7f06a3c8f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:07:39.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:07:39.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:07:39.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:07:39.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:07:39.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:07:39.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:39.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:07:39.216 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:07:39.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:39.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:39.388 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:39.393+0000 7f06a3c8f7c0 -1 Falling back to public interface 2024-05-08T19:07:39.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:40.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:40.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:40.619 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:07:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:07:40.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:40.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:41.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:42.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:42.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:42.031 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:07:42.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:07:42.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:42.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:42.179 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:07:42.185+0000 7f06a3c8f7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:07:42.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:43.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:43.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:43.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:07:43.459 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:07:43.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:43.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:43.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:44.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:44.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:44.873 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:07:44.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:07:44.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:44.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:45.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:46.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:46.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:46.412 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:07:46.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:07:46.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:46.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:46.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:47.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:47.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:47.882 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:07:47.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:07:47.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:47.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:48.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:49.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:49.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:49.386 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:07:49.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:07:49.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:49.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:49.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:50.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:50.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:50.884 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:07:50.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:07:50.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:50.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:51.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:52.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:52.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:52.369 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:07:52.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:07:52.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:52.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:52.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:53.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:53.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:53.868 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:07:53.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:07:53.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:53.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:54.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:55.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:55.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:55.429 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:07:55.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:07:55.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:55.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:56.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:57.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:57.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:57.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:07:57.013 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:07:57.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:57.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:57.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:07:58.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:07:58.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:07:58.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:07:58.671 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:07:58.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:07:58.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:07:59.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:00.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:00.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:00.201 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:08:00.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:08:00.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:00.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:08:00.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:01.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:01.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:01.667 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:08:01.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:08:01.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:01.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:08:02.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:03.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:03.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:03.691 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:08:03.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:08:03.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:03.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:08:04.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:05.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:05.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:05.764 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:08:05.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:08:05.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:05.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:08:06.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:07.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:07.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:07.797 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:08:07.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:08:07.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:07.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:08:08.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:09.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:09.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:09.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:08:09.959 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:08:09.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:09.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:08:10.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:11.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:11.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:11.745 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:08:11.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:08:11.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:11.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:08:12.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:13.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:13.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:13.681 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:08:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:08:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:13.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:08:14.098 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/906018691,v1:127.0.0.1:6803/906018691] [v2:127.0.0.1:6804/906018691,v1:127.0.0.1:6805/906018691] exists,up 053bbe9d-1084-418f-9915-fe4711ba0431 2024-05-08T19:08:14.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:520: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 1 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:08:14.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:08:14.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:08:14.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:08:14.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:08:14.105 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 f2239c71-94f0-4e20-b46e-d2e8004e2de9 2024-05-08T19:08:14.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f2239c71-94f0-4e20-b46e-d2e8004e2de9 2024-05-08T19:08:14.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 f2239c71-94f0-4e20-b46e-d2e8004e2de9' 2024-05-08T19:08:14.105 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:08:14.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCezTtmpzUHCBAAAVZduAwCyHaGjibtGsi2/A== 2024-05-08T19:08:14.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCezTtmpzUHCBAAAVZduAwCyHaGjibtGsi2/A=="}' 2024-05-08T19:08:14.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f2239c71-94f0-4e20-b46e-d2e8004e2de9 -i td/osd-backfill-stats/1/new.json 2024-05-08T19:08:14.761 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:08:14.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:08:14.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCezTtmpzUHCBAAAVZduAwCyHaGjibtGsi2/A== --osd-uuid f2239c71-94f0-4e20-b46e-d2e8004e2de9 2024-05-08T19:08:14.814 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:14.816+0000 7fb04cf8a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:08:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:14.820+0000 7fb04cf8a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:08:14.817 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:14.820+0000 7fb04cf8a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:08:14.818 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:14.820+0000 7fb04cf8a7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:08:14.818 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:14.820+0000 7fb04cf8a7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:08:14.818 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:14.820+0000 7fb04cf8a7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:08:14.886 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:14.892+0000 7fb04cf8a7c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:08:22.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:08:22.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:08:22.756 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:08:22.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:08:22.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:08:23.302 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:08:23.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:08:23.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:08:23.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:08:23.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:08:23.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:08:23.335 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:23.340+0000 7f3799a9d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:08:23.337 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:23.340+0000 7f3799a9d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:08:23.338 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:23.344+0000 7f3799a9d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:08:23.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:08:23.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:08:23.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:08:23.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:08:23.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:08:23.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:23.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:08:23.686 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:08:23.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:23.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:23.872 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:23.876+0000 7f3799a9d7c0 -1 Falling back to public interface 2024-05-08T19:08:24.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:25.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:25.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:25.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:08:25.161 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:08:25.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:25.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:25.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:26.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:26.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:26.588 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:08:26.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:08:26.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:26.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:26.784 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:08:26.788+0000 7f3799a9d7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:08:27.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:28.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:28.104 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:08:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:08:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:28.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:29.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:29.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:29.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:08:29.557 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:08:29.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:29.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:30.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:31.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:31.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:31.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:08:31.194 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:08:31.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:31.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:31.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:32.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:32.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:32.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:08:32.813 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:08:32.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:32.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:33.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:34.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:34.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:34.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:08:34.474 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:08:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:34.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:35.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:36.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:36.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:36.112 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:08:36.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:08:36.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:36.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:36.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:37.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:37.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:37.602 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:08:37.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:08:37.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:37.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:38.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:39.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:39.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:39.223 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:08:39.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:08:39.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:39.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:39.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:40.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:40.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:40.865 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:08:40.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:08:40.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:40.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:41.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:42.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:42.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:42.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:08:42.353 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:08:42.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:42.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:42.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:43.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:43.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:43.836 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:08:43.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:08:43.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:43.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:44.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:45.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:45.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:45.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:08:45.268 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:08:45.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:45.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:45.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:46.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:46.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:46.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:08:46.804 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:08:46.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:46.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:47.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:48.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:48.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:48.761 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:08:48.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:08:48.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:48.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:50.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:51.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:51.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:51.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:08:51.175 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:08:51.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:51.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:52.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:53.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:53.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:53.194 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:08:53.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:08:53.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:53.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:54.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:55.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:55.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:55.426 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:08:55.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:08:55.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:55.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:56.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:57.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:57.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:57.388 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:08:57.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:08:57.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:57.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:58.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:08:59.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:08:59.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:08:59.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:08:59.287 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:08:59.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:08:59.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:08:59.713 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3017113631,v1:127.0.0.1:6811/3017113631] [v2:127.0.0.1:6812/3017113631,v1:127.0.0.1:6813/3017113631] exists,up f2239c71-94f0-4e20-b46e-d2e8004e2de9 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:521: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 2 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:08:59.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:08:59.716 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:08:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:08:59.718 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:08:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8fa2baa6-dd0d-4ad5-9814-b854d39458c6 2024-05-08T19:08:59.718 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 8fa2baa6-dd0d-4ad5-9814-b854d39458c6 2024-05-08T19:08:59.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 8fa2baa6-dd0d-4ad5-9814-b854d39458c6' 2024-05-08T19:08:59.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:08:59.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDLzTtmOCeWLBAACARtdwG7MBDC6EBnvXgYJQ== 2024-05-08T19:08:59.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDLzTtmOCeWLBAACARtdwG7MBDC6EBnvXgYJQ=="}' 2024-05-08T19:08:59.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8fa2baa6-dd0d-4ad5-9814-b854d39458c6 -i td/osd-backfill-stats/2/new.json 2024-05-08T19:09:00.363 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:09:00.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:09:00.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDLzTtmOCeWLBAACARtdwG7MBDC6EBnvXgYJQ== --osd-uuid 8fa2baa6-dd0d-4ad5-9814-b854d39458c6 2024-05-08T19:09:00.417 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:00.419+0000 7fa1787f97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:00.418 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:00.419+0000 7fa1787f97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:00.419 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:00.423+0000 7fa1787f97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:00.419 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:00.423+0000 7fa1787f97c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:09:00.419 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:00.423+0000 7fa1787f97c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:09:00.420 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:00.423+0000 7fa1787f97c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:09:00.488 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:00.491+0000 7fa1787f97c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:09:08.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:09:08.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:09:08.737 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:09:08.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:09:08.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:09:09.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:09:09.342 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:09:09.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:09:09.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:09:09.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:09:09.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:09:09.375 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:09.379+0000 7fe4fcac17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:09.378 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:09.379+0000 7fe4fcac17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:09.378 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:09.383+0000 7fe4fcac17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:09.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:09:09.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:09:09.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:09:09.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:09:09.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:09:09.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:09.731 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:09:09.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:09:09.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:09.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:09.911 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:09.915+0000 7fe4fcac17c0 -1 Falling back to public interface 2024-05-08T19:09:10.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:11.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:11.133 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:09:11.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:11.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:09:11.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:11.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:11.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:12.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:12.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:12.536 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:09:12.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:09:12.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:12.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:12.759 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:12.763+0000 7fe4fcac17c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:09:13.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:14.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:14.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:14.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:09:14.058 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:09:14.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:14.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:14.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:15.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:15.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:15.634 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:09:15.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:09:15.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:15.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:16.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:17.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:17.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:17.276 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:09:17.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:09:17.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:17.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:17.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:18.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:18.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:18.969 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:09:18.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:09:18.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:18.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:19.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:20.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:20.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:20.498 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:09:20.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:09:20.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:20.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:21.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:22.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:22.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:22.119 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:09:22.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:09:22.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:22.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:22.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:23.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:23.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:23.553 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:09:23.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:09:23.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:23.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:24.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:25.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:25.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:25.238 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:09:25.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:09:25.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:25.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:26.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:27.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:27.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:27.048 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:09:27.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:09:27.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:27.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:27.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:28.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:28.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:28.614 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:09:28.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:09:28.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:28.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:29.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:30.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:30.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:30.255 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:09:30.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:09:30.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:30.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:30.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:31.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:31.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:31.875 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:09:31.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:09:31.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:31.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:32.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:33.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:33.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:33.473 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:09:33.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:09:33.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:33.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:34.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:35.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:35.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:35.390 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:09:35.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:09:35.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:35.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:36.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:37.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:37.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:37.064 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:09:37.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:09:37.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:37.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:38.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:39.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:39.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:39.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:09:39.338 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:09:39.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:39.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:40.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:41.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:41.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:41.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:09:41.340 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:09:41.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:41.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:42.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:43.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:43.097 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:09:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:09:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:43.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:44.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:45.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:45.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:45.317 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:09:45.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:09:45.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:45.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:09:45.755 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2102357311,v1:127.0.0.1:6819/2102357311] [v2:127.0.0.1:6820/2102357311,v1:127.0.0.1:6821/2102357311] exists,up 8fa2baa6-dd0d-4ad5-9814-b854d39458c6 2024-05-08T19:09:45.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:09:45.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:522: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 3 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:09:45.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:09:45.760 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:09:45.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:09:45.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:09:45.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:09:45.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:09:45.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:09:45.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:09:45.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:09:45.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:09:45.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:09:45.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:09:45.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:09:45.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:09:45.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:09:45.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:09:45.763 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 5240a6a5-d299-423c-ab34-36fe819a2281 2024-05-08T19:09:45.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5240a6a5-d299-423c-ab34-36fe819a2281 2024-05-08T19:09:45.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 5240a6a5-d299-423c-ab34-36fe819a2281' 2024-05-08T19:09:45.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:09:45.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD5zTtmUu7gLhAAIcYBTLGh0xt/G6fGcc00pw== 2024-05-08T19:09:45.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD5zTtmUu7gLhAAIcYBTLGh0xt/G6fGcc00pw=="}' 2024-05-08T19:09:45.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5240a6a5-d299-423c-ab34-36fe819a2281 -i td/osd-backfill-stats/3/new.json 2024-05-08T19:09:46.441 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:09:46.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:09:46.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD5zTtmUu7gLhAAIcYBTLGh0xt/G6fGcc00pw== --osd-uuid 5240a6a5-d299-423c-ab34-36fe819a2281 2024-05-08T19:09:46.493 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:46.498+0000 7f045e5707c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:46.569 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:46.574+0000 7f045e5707c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:46.571 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:46.578+0000 7f045e5707c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:46.572 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:46.578+0000 7f045e5707c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:09:46.572 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:46.578+0000 7f045e5707c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:09:46.572 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:46.578+0000 7f045e5707c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:09:46.727 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:46.734+0000 7f045e5707c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:09:54.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:09:54.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:09:54.775 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:09:54.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:09:54.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:09:55.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:09:55.328 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:09:55.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:09:55.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:09:55.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:09:55.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:09:55.361 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:55.366+0000 7fc78950c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:55.402 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:55.406+0000 7fc78950c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:55.404 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:55.410+0000 7fc78950c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:09:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:09:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:09:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:09:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:09:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:09:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:09:55.739 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:09:55.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:55.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:09:55.977 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:55.982+0000 7fc78950c7c0 -1 Falling back to public interface 2024-05-08T19:09:56.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:57.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:57.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:57.204 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:09:57.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:09:57.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:57.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:09:57.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:09:58.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:09:58.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:09:58.659 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:09:58.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:09:58.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:09:58.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:09:58.839 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:09:58.846+0000 7fc78950c7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:09:59.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:00.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:00.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:00.147 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:10:00.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:10:00.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:00.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:00.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:01.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:01.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:01.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:10:01.657 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:10:01.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:01.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:02.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:03.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:03.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:03.324 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:10:03.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:10:03.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:03.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:03.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:04.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:04.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:04.803 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:10:04.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:10:04.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:04.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:05.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:06.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:06.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:06.230 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:10:06.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:10:06.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:06.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:06.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:07.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:07.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:07.766 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:10:07.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:10:07.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:07.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:08.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:09.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:09.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:09.240 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:10:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:10:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:09.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:09.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:10.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:10.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:10.817 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:10:10.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:10:10.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:10.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:11.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:12.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:12.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:12.630 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:10:12.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:10:12.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:12.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:13.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:14.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:14.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:14.240 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:10:14.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:10:14.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:14.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:14.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:15.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:15.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:15.857 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:10:15.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:10:15.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:15.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:16.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:17.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:17.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:17.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:10:17.358 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:10:17.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:17.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:18.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:19.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:19.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:19.062 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:10:19.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:10:19.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:19.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:20.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:21.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:21.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:21.180 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:10:21.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:10:21.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:21.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:22.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:23.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:23.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:23.155 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:10:23.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:10:23.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:23.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:24.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:25.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:25.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:25.126 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:10:25.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:10:25.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:25.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:26.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:27.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:27.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:27.477 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:10:27.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:10:27.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:27.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:28.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:29.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:29.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:29.379 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:10:29.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:10:29.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:29.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:31.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:31.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:31.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:10:31.209 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:10:31.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:31.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:10:31.640 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/4113798703,v1:127.0.0.1:6827/4113798703] [v2:127.0.0.1:6828/4113798703,v1:127.0.0.1:6829/4113798703] exists,up 5240a6a5-d299-423c-ab34-36fe819a2281 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:523: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 4 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:10:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:10:31.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:10:31.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:10:31.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:10:31.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:10:31.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:10:31.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:10:31.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:10:31.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=41ae20a1-e8b0-431b-bfa7-d974a40881d8 2024-05-08T19:10:31.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 41ae20a1-e8b0-431b-bfa7-d974a40881d8' 2024-05-08T19:10:31.648 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 41ae20a1-e8b0-431b-bfa7-d974a40881d8 2024-05-08T19:10:31.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:10:31.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAnzjtmJ/9PKBAAIEffwOq8S8yet9iRhHkuAA== 2024-05-08T19:10:31.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAnzjtmJ/9PKBAAIEffwOq8S8yet9iRhHkuAA=="}' 2024-05-08T19:10:31.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 41ae20a1-e8b0-431b-bfa7-d974a40881d8 -i td/osd-backfill-stats/4/new.json 2024-05-08T19:10:32.360 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:10:32.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:10:32.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAnzjtmJ/9PKBAAIEffwOq8S8yet9iRhHkuAA== --osd-uuid 41ae20a1-e8b0-431b-bfa7-d974a40881d8 2024-05-08T19:10:32.416 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:32.421+0000 7fd8cf4557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:10:32.463 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:32.469+0000 7fd8cf4557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:10:32.464 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:32.469+0000 7fd8cf4557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:10:32.465 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:32.469+0000 7fd8cf4557c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:10:32.465 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:32.469+0000 7fd8cf4557c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:10:32.465 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:32.469+0000 7fd8cf4557c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:10:32.526 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:32.533+0000 7fd8cf4557c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:10:40.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:10:40.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:10:40.465 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:10:40.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:10:40.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:10:41.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:10:41.057 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:10:41.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:10:41.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:10:41.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:10:41.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:10:41.091 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:41.097+0000 7fe4daae37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:10:41.093 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:41.097+0000 7fe4daae37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:10:41.095 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:41.101+0000 7fe4daae37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:10:41.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:10:41.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:10:41.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:10:41.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:10:41.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:10:41.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:41.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:10:41.466 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:10:41.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:41.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:41.696 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:41.701+0000 7fe4daae37c0 -1 Falling back to public interface 2024-05-08T19:10:41.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:42.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:42.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:42.931 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:10:42.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:10:42.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:42.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:43.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:44.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:44.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:44.355 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:10:44.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:10:44.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:44.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:44.477 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:10:44.481+0000 7fe4daae37c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:10:44.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:45.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:45.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:45.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:10:45.903 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:10:45.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:45.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:47.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:47.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:47.420 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:10:47.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:10:47.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:47.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:47.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:48.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:48.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:48.828 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:10:48.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:10:48.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:48.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:49.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:50.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:50.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:50.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:10:50.449 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:10:50.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:50.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:51.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:52.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:52.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:52.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:10:52.088 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:10:52.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:52.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:52.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:53.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:53.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:53.601 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:10:53.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:10:53.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:53.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:54.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:55.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:55.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:55.122 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:10:55.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:10:55.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:55.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:55.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:56.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:56.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:56.673 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:10:56.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:10:56.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:56.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:57.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:10:58.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:10:58.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:10:58.404 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:10:58.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:10:58.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:10:58.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:10:59.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:00.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:00.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:00.250 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:11:00.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:11:00.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:00.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:00.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:01.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:01.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:01.723 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:11:01.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:11:01.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:01.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:02.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:03.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:03.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:03.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:11:03.269 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:11:03.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:03.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:03.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:04.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:04.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:04.880 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:11:04.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:11:04.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:04.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:06.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:07.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:07.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:07.244 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:11:07.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:11:07.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:07.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:08.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:09.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:09.123 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:11:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:11:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:09.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:10.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:10.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:10.816 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:11:10.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:11:10.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:10.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:12.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:13.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:13.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:13.200 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:11:13.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:11:13.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:13.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:14.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:15.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:15.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:15.110 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:11:15.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:11:15.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:15.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:16.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:11:17.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:11:17.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:11:17.031 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:11:17.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:11:17.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:11:17.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:11:17.583 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/807337274,v1:127.0.0.1:6835/807337274] [v2:127.0.0.1:6836/807337274,v1:127.0.0.1:6837/807337274] exists,up 41ae20a1-e8b0-431b-bfa7-d974a40881d8 2024-05-08T19:11:17.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:11:17.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:11:17.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:11:17.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:525: TEST_backfill_ec_all_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T19:11:18.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:526: TEST_backfill_ec_all_out: create_pool test 1 1 erasure myprofile 2024-05-08T19:11:18.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 erasure myprofile 2024-05-08T19:11:19.494 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:11:19.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:11:20.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:528: TEST_backfill_ec_all_out: wait_for_clean 2024-05-08T19:11:20.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:11:20.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:11:20.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:11:20.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:11:20.515 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:11:20.515 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:11:20.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:11:20.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:11:20.516 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:11:20.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:11:20.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:11:20.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:11:20.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:11:20.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:11:20.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:11:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:11:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:11:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:11:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:11:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T19:11:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:11:21.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:11:21.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:11:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836526 2024-05-08T19:11:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836526 2024-05-08T19:11:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526' 2024-05-08T19:11:21.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:11:21.412 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:11:21.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672997 2024-05-08T19:11:21.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672997 2024-05-08T19:11:21.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672997' 2024-05-08T19:11:21.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:11:21.581 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:11:21.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509473 2024-05-08T19:11:21.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509473 2024-05-08T19:11:21.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672997 2-64424509473' 2024-05-08T19:11:21.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:11:21.772 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:11:21.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345935 2024-05-08T19:11:21.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345935 2024-05-08T19:11:21.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672997 2-64424509473 3-85899345935' 2024-05-08T19:11:21.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:11:21.930 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:11:22.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182407 2024-05-08T19:11:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182407 2024-05-08T19:11:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672997 2-64424509473 3-85899345935 4-107374182407' 2024-05-08T19:11:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:11:22.086 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836526 2024-05-08T19:11:22.086 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:11:22.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:11:22.087 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836526 2024-05-08T19:11:22.087 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:11:22.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836526 2024-05-08T19:11:22.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836526' 2024-05-08T19:11:22.089 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836526 2024-05-08T19:11:22.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:11:22.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836524 -lt 21474836526 2024-05-08T19:11:22.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:11:23.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:11:23.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:11:23.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836526 -lt 21474836526 2024-05-08T19:11:23.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:11:23.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672997 2024-05-08T19:11:23.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:11:23.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:11:23.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672997 2024-05-08T19:11:23.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:11:23.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672997 2024-05-08T19:11:23.907 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672997 2024-05-08T19:11:23.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672997' 2024-05-08T19:11:23.908 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:11:24.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672997 -lt 42949672997 2024-05-08T19:11:24.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:11:24.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509473 2024-05-08T19:11:24.342 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:11:24.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:11:24.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509473 2024-05-08T19:11:24.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:11:24.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509473 2024-05-08T19:11:24.346 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509473 2024-05-08T19:11:24.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509473' 2024-05-08T19:11:24.346 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:11:24.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509473 -lt 64424509473 2024-05-08T19:11:24.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:11:24.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345935 2024-05-08T19:11:24.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:11:24.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:11:24.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345935 2024-05-08T19:11:24.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:11:24.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345935 2024-05-08T19:11:24.821 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345935 2024-05-08T19:11:24.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345935' 2024-05-08T19:11:24.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:11:25.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345935 -lt 85899345935 2024-05-08T19:11:25.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:11:25.304 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:11:25.304 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182407 2024-05-08T19:11:25.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:11:25.306 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182407 2024-05-08T19:11:25.306 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:11:25.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182407 2024-05-08T19:11:25.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182407' 2024-05-08T19:11:25.308 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182407 2024-05-08T19:11:25.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:11:25.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182408 -lt 107374182407 2024-05-08T19:11:25.749 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:11:25.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:11:25.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:11:26.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:11:26.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:11:26.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:11:26.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:11:26.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:11:26.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:11:26.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:11:26.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:11:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:11:26.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:11:26.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:11:26.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:11:27.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:11:27.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:11:27.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:11:27.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: seq 1 200 2024-05-08T19:11:27.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:27.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj1 /dev/null 2024-05-08T19:11:27.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:27.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj2 /dev/null 2024-05-08T19:11:27.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:27.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj3 /dev/null 2024-05-08T19:11:27.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:27.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj4 /dev/null 2024-05-08T19:11:28.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:28.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj5 /dev/null 2024-05-08T19:11:28.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:28.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj6 /dev/null 2024-05-08T19:11:28.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:28.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj7 /dev/null 2024-05-08T19:11:29.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:29.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj8 /dev/null 2024-05-08T19:11:29.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:29.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj9 /dev/null 2024-05-08T19:11:29.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:29.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj10 /dev/null 2024-05-08T19:11:29.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:29.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj11 /dev/null 2024-05-08T19:11:30.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:30.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj12 /dev/null 2024-05-08T19:11:30.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:30.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj13 /dev/null 2024-05-08T19:11:31.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:31.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj14 /dev/null 2024-05-08T19:11:31.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:31.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj15 /dev/null 2024-05-08T19:11:31.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:31.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj16 /dev/null 2024-05-08T19:11:31.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:31.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj17 /dev/null 2024-05-08T19:11:32.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:32.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj18 /dev/null 2024-05-08T19:11:32.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:32.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj19 /dev/null 2024-05-08T19:11:32.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:32.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj20 /dev/null 2024-05-08T19:11:32.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:32.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj21 /dev/null 2024-05-08T19:11:33.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:33.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj22 /dev/null 2024-05-08T19:11:33.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:33.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj23 /dev/null 2024-05-08T19:11:33.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:33.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj24 /dev/null 2024-05-08T19:11:34.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:34.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj25 /dev/null 2024-05-08T19:11:34.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:34.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj26 /dev/null 2024-05-08T19:11:34.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:34.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj27 /dev/null 2024-05-08T19:11:34.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:34.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj28 /dev/null 2024-05-08T19:11:35.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:35.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj29 /dev/null 2024-05-08T19:11:35.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:35.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj30 /dev/null 2024-05-08T19:11:35.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:35.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj31 /dev/null 2024-05-08T19:11:35.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:35.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj32 /dev/null 2024-05-08T19:11:36.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:36.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj33 /dev/null 2024-05-08T19:11:36.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:36.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj34 /dev/null 2024-05-08T19:11:36.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:36.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj35 /dev/null 2024-05-08T19:11:36.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:36.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj36 /dev/null 2024-05-08T19:11:37.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:37.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj37 /dev/null 2024-05-08T19:11:37.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:37.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj38 /dev/null 2024-05-08T19:11:37.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:37.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj39 /dev/null 2024-05-08T19:11:38.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:38.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj40 /dev/null 2024-05-08T19:11:38.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:38.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj41 /dev/null 2024-05-08T19:11:38.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:38.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj42 /dev/null 2024-05-08T19:11:38.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:38.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj43 /dev/null 2024-05-08T19:11:39.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:39.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj44 /dev/null 2024-05-08T19:11:39.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:39.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj45 /dev/null 2024-05-08T19:11:39.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:39.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj46 /dev/null 2024-05-08T19:11:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:39.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj47 /dev/null 2024-05-08T19:11:40.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:40.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj48 /dev/null 2024-05-08T19:11:40.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:40.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj49 /dev/null 2024-05-08T19:11:40.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:40.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj50 /dev/null 2024-05-08T19:11:41.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:41.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj51 /dev/null 2024-05-08T19:11:41.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:41.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj52 /dev/null 2024-05-08T19:11:41.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:41.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj53 /dev/null 2024-05-08T19:11:41.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:41.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj54 /dev/null 2024-05-08T19:11:42.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:42.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj55 /dev/null 2024-05-08T19:11:42.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:42.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj56 /dev/null 2024-05-08T19:11:42.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:42.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj57 /dev/null 2024-05-08T19:11:42.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:42.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj58 /dev/null 2024-05-08T19:11:43.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:43.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj59 /dev/null 2024-05-08T19:11:43.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:43.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj60 /dev/null 2024-05-08T19:11:43.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:43.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj61 /dev/null 2024-05-08T19:11:44.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:44.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj62 /dev/null 2024-05-08T19:11:44.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:44.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj63 /dev/null 2024-05-08T19:11:44.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:44.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj64 /dev/null 2024-05-08T19:11:44.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:44.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj65 /dev/null 2024-05-08T19:11:45.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:45.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj66 /dev/null 2024-05-08T19:11:45.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:45.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj67 /dev/null 2024-05-08T19:11:45.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:45.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj68 /dev/null 2024-05-08T19:11:45.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:45.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj69 /dev/null 2024-05-08T19:11:46.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:46.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj70 /dev/null 2024-05-08T19:11:46.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:46.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj71 /dev/null 2024-05-08T19:11:46.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:46.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj72 /dev/null 2024-05-08T19:11:46.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:46.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj73 /dev/null 2024-05-08T19:11:47.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:47.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj74 /dev/null 2024-05-08T19:11:47.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:47.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj75 /dev/null 2024-05-08T19:11:47.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:47.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj76 /dev/null 2024-05-08T19:11:48.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:48.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj77 /dev/null 2024-05-08T19:11:48.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:48.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj78 /dev/null 2024-05-08T19:11:48.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:48.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj79 /dev/null 2024-05-08T19:11:48.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:48.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj80 /dev/null 2024-05-08T19:11:49.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:49.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj81 /dev/null 2024-05-08T19:11:49.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:49.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj82 /dev/null 2024-05-08T19:11:49.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:49.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj83 /dev/null 2024-05-08T19:11:49.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:49.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj84 /dev/null 2024-05-08T19:11:50.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:50.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj85 /dev/null 2024-05-08T19:11:50.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:50.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj86 /dev/null 2024-05-08T19:11:50.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:50.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj87 /dev/null 2024-05-08T19:11:50.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:50.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj88 /dev/null 2024-05-08T19:11:51.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:51.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj89 /dev/null 2024-05-08T19:11:51.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:51.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj90 /dev/null 2024-05-08T19:11:51.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:51.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj91 /dev/null 2024-05-08T19:11:52.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:52.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj92 /dev/null 2024-05-08T19:11:52.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:52.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj93 /dev/null 2024-05-08T19:11:52.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:52.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj94 /dev/null 2024-05-08T19:11:52.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:52.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj95 /dev/null 2024-05-08T19:11:53.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:53.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj96 /dev/null 2024-05-08T19:11:53.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:53.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj97 /dev/null 2024-05-08T19:11:53.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:53.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj98 /dev/null 2024-05-08T19:11:53.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:53.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj99 /dev/null 2024-05-08T19:11:54.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:54.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj100 /dev/null 2024-05-08T19:11:54.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:54.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj101 /dev/null 2024-05-08T19:11:54.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:54.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj102 /dev/null 2024-05-08T19:11:54.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:54.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj103 /dev/null 2024-05-08T19:11:55.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:55.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj104 /dev/null 2024-05-08T19:11:55.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:55.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj105 /dev/null 2024-05-08T19:11:55.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:55.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj106 /dev/null 2024-05-08T19:11:56.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:56.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj107 /dev/null 2024-05-08T19:11:56.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:56.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj108 /dev/null 2024-05-08T19:11:56.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:56.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj109 /dev/null 2024-05-08T19:11:56.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:56.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj110 /dev/null 2024-05-08T19:11:56.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:56.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj111 /dev/null 2024-05-08T19:11:57.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:57.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj112 /dev/null 2024-05-08T19:11:57.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:57.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj113 /dev/null 2024-05-08T19:11:57.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:57.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj114 /dev/null 2024-05-08T19:11:58.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:58.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj115 /dev/null 2024-05-08T19:11:58.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:58.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj116 /dev/null 2024-05-08T19:11:58.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:58.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj117 /dev/null 2024-05-08T19:11:58.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:58.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj118 /dev/null 2024-05-08T19:11:59.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:59.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj119 /dev/null 2024-05-08T19:11:59.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:59.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj120 /dev/null 2024-05-08T19:11:59.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:11:59.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj121 /dev/null 2024-05-08T19:12:00.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:00.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj122 /dev/null 2024-05-08T19:12:00.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:00.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj123 /dev/null 2024-05-08T19:12:00.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:00.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj124 /dev/null 2024-05-08T19:12:00.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:00.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj125 /dev/null 2024-05-08T19:12:00.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:00.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj126 /dev/null 2024-05-08T19:12:01.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:01.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj127 /dev/null 2024-05-08T19:12:01.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:01.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj128 /dev/null 2024-05-08T19:12:02.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:02.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj129 /dev/null 2024-05-08T19:12:02.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:02.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj130 /dev/null 2024-05-08T19:12:02.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:02.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj131 /dev/null 2024-05-08T19:12:03.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:03.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj132 /dev/null 2024-05-08T19:12:03.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:03.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj133 /dev/null 2024-05-08T19:12:03.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:03.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj134 /dev/null 2024-05-08T19:12:03.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:03.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj135 /dev/null 2024-05-08T19:12:04.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:04.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj136 /dev/null 2024-05-08T19:12:04.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:04.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj137 /dev/null 2024-05-08T19:12:04.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:04.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj138 /dev/null 2024-05-08T19:12:04.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:04.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj139 /dev/null 2024-05-08T19:12:05.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:05.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj140 /dev/null 2024-05-08T19:12:05.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:05.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj141 /dev/null 2024-05-08T19:12:05.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:05.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj142 /dev/null 2024-05-08T19:12:05.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:05.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj143 /dev/null 2024-05-08T19:12:06.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:06.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj144 /dev/null 2024-05-08T19:12:06.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:06.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj145 /dev/null 2024-05-08T19:12:06.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:06.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj146 /dev/null 2024-05-08T19:12:07.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:07.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj147 /dev/null 2024-05-08T19:12:07.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:07.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj148 /dev/null 2024-05-08T19:12:07.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:07.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj149 /dev/null 2024-05-08T19:12:08.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:08.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj150 /dev/null 2024-05-08T19:12:08.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:08.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj151 /dev/null 2024-05-08T19:12:08.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:08.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj152 /dev/null 2024-05-08T19:12:08.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:08.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj153 /dev/null 2024-05-08T19:12:09.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:09.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj154 /dev/null 2024-05-08T19:12:09.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:09.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj155 /dev/null 2024-05-08T19:12:09.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:09.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj156 /dev/null 2024-05-08T19:12:09.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:09.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj157 /dev/null 2024-05-08T19:12:10.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:10.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj158 /dev/null 2024-05-08T19:12:10.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:10.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj159 /dev/null 2024-05-08T19:12:10.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:10.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj160 /dev/null 2024-05-08T19:12:11.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:11.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj161 /dev/null 2024-05-08T19:12:11.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:11.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj162 /dev/null 2024-05-08T19:12:11.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:11.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj163 /dev/null 2024-05-08T19:12:11.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:11.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj164 /dev/null 2024-05-08T19:12:12.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:12.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj165 /dev/null 2024-05-08T19:12:12.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:12.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj166 /dev/null 2024-05-08T19:12:12.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:12.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj167 /dev/null 2024-05-08T19:12:12.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:12.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj168 /dev/null 2024-05-08T19:12:13.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:13.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj169 /dev/null 2024-05-08T19:12:13.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:13.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj170 /dev/null 2024-05-08T19:12:13.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:13.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj171 /dev/null 2024-05-08T19:12:13.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:13.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj172 /dev/null 2024-05-08T19:12:14.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:14.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj173 /dev/null 2024-05-08T19:12:14.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:14.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj174 /dev/null 2024-05-08T19:12:14.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:14.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj175 /dev/null 2024-05-08T19:12:15.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:15.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj176 /dev/null 2024-05-08T19:12:15.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:15.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj177 /dev/null 2024-05-08T19:12:15.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:15.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj178 /dev/null 2024-05-08T19:12:15.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:15.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj179 /dev/null 2024-05-08T19:12:16.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:16.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj180 /dev/null 2024-05-08T19:12:16.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:16.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj181 /dev/null 2024-05-08T19:12:16.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:16.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj182 /dev/null 2024-05-08T19:12:16.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:16.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj183 /dev/null 2024-05-08T19:12:17.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:17.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj184 /dev/null 2024-05-08T19:12:17.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:17.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj185 /dev/null 2024-05-08T19:12:17.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:17.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj186 /dev/null 2024-05-08T19:12:17.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:17.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj187 /dev/null 2024-05-08T19:12:18.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:18.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj188 /dev/null 2024-05-08T19:12:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj189 /dev/null 2024-05-08T19:12:18.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:18.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj190 /dev/null 2024-05-08T19:12:18.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:18.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj191 /dev/null 2024-05-08T19:12:19.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:19.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj192 /dev/null 2024-05-08T19:12:19.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:19.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj193 /dev/null 2024-05-08T19:12:19.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:19.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj194 /dev/null 2024-05-08T19:12:20.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:20.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj195 /dev/null 2024-05-08T19:12:20.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:20.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj196 /dev/null 2024-05-08T19:12:20.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:20.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj197 /dev/null 2024-05-08T19:12:20.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:20.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj198 /dev/null 2024-05-08T19:12:21.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:21.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj199 /dev/null 2024-05-08T19:12:21.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-05-08T19:12:21.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj200 /dev/null 2024-05-08T19:12:21.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:535: TEST_backfill_ec_all_out: get_pg test obj1 2024-05-08T19:12:21.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:12:21.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:12:21.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:12:21.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:12:22.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:535: TEST_backfill_ec_all_out: local PG=1.0 2024-05-08T19:12:22.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:537: TEST_backfill_ec_all_out: get_primary test obj1 2024-05-08T19:12:22.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:12:22.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:12:22.201 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:12:22.202 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:12:22.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:537: TEST_backfill_ec_all_out: local primary=1 2024-05-08T19:12:22.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:539: TEST_backfill_ec_all_out: ceph osd set nobackfill 2024-05-08T19:12:23.622 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:12:23.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: get_osds test obj1 2024-05-08T19:12:23.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=test 2024-05-08T19:12:23.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj1 2024-05-08T19:12:23.647 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map test obj1 2024-05-08T19:12:23.647 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2024-05-08T19:12:24.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=1 2024-05-08T19:12:24.071 INFO:tasks.workunit.client.0.smithi117.stderr:0 2024-05-08T19:12:24.071 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T19:12:24.071 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 1 0 2 2024-05-08T19:12:24.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2024-05-08T19:12:24.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.1 2024-05-08T19:12:24.707 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T19:12:24.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2024-05-08T19:12:24.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.0 2024-05-08T19:12:25.816 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T19:12:25.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2024-05-08T19:12:25.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.2 2024-05-08T19:12:27.097 INFO:tasks.workunit.client.0.smithi117.stderr:osd.2 is already out. 2024-05-08T19:12:27.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:545: TEST_backfill_ec_all_out: sleep 2 2024-05-08T19:12:29.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:546: TEST_backfill_ec_all_out: get_primary test obj1 2024-05-08T19:12:29.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:12:29.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:12:29.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:12:29.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:12:29.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:546: TEST_backfill_ec_all_out: primary=1 2024-05-08T19:12:29.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:547: TEST_backfill_ec_all_out: ceph osd unset nobackfill 2024-05-08T19:12:30.434 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:12:30.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:548: TEST_backfill_ec_all_out: ceph tell osd.1 get_latest_osdmap 2024-05-08T19:12:30.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:549: TEST_backfill_ec_all_out: ceph tell osd.1 debug kick_recovery_wq 0 2024-05-08T19:12:30.890 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T19:12:30.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:550: TEST_backfill_ec_all_out: sleep 2 2024-05-08T19:12:32.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:552: TEST_backfill_ec_all_out: wait_for_clean 2024-05-08T19:12:32.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:12:32.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:12:32.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:12:32.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:12:32.908 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:12:32.908 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:12:32.909 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:12:32.909 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:12:32.909 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:12:33.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:12:33.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:12:33.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:12:33.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:12:33.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:12:33.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:12:33.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:12:33.497 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:12:33.497 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:12:33.497 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:12:33.497 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T19:12:33.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:12:33.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:12:33.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:12:33.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836542 2024-05-08T19:12:33.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836542 2024-05-08T19:12:33.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542' 2024-05-08T19:12:33.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:12:33.715 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:12:33.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673013 2024-05-08T19:12:33.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673013 2024-05-08T19:12:33.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542 1-42949673013' 2024-05-08T19:12:33.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:12:33.879 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:12:34.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509489 2024-05-08T19:12:34.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509489 2024-05-08T19:12:34.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542 1-42949673013 2-64424509489' 2024-05-08T19:12:34.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:12:34.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:12:34.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345951 2024-05-08T19:12:34.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345951 2024-05-08T19:12:34.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542 1-42949673013 2-64424509489 3-85899345951' 2024-05-08T19:12:34.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:12:34.228 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:12:34.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182424 2024-05-08T19:12:34.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182424 2024-05-08T19:12:34.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542 1-42949673013 2-64424509489 3-85899345951 4-107374182424' 2024-05-08T19:12:34.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:12:34.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836542 2024-05-08T19:12:34.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:12:34.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:12:34.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836542 2024-05-08T19:12:34.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:12:34.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836542 2024-05-08T19:12:34.385 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836542 2024-05-08T19:12:34.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836542' 2024-05-08T19:12:34.386 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:12:34.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836543 -lt 21474836542 2024-05-08T19:12:34.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:12:34.819 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673013 2024-05-08T19:12:34.820 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:12:34.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:12:34.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673013 2024-05-08T19:12:34.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:12:34.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673013 2024-05-08T19:12:34.824 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673013 2024-05-08T19:12:34.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673013' 2024-05-08T19:12:34.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:12:35.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673013 -lt 42949673013 2024-05-08T19:12:35.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:12:35.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:12:35.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509489 2024-05-08T19:12:35.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:12:35.415 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509489 2024-05-08T19:12:35.415 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:12:35.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509489 2024-05-08T19:12:35.417 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509489 2024-05-08T19:12:35.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509489' 2024-05-08T19:12:35.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:12:35.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509489 -lt 64424509489 2024-05-08T19:12:35.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:12:35.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345951 2024-05-08T19:12:35.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:12:35.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:12:35.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345951 2024-05-08T19:12:35.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:12:35.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345951 2024-05-08T19:12:35.949 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345951 2024-05-08T19:12:35.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345951' 2024-05-08T19:12:35.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:12:36.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345951 -lt 85899345951 2024-05-08T19:12:36.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:12:36.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182424 2024-05-08T19:12:36.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:12:36.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:12:36.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182424 2024-05-08T19:12:36.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:12:36.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182424 2024-05-08T19:12:36.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182424' 2024-05-08T19:12:36.442 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182424 2024-05-08T19:12:36.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:12:37.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182424 -lt 107374182424 2024-05-08T19:12:37.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:12:37.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:37.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:37.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:12:37.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:37.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:37.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:37.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:37.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:37.837 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:37.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:38.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:38.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:38.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:38.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:38.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:38.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:12:38.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:12:38.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:12:38.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:38.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:38.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:38.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:38.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:38.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:38.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:38.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:38.900 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:38.901 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:39.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:39.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:39.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:39.314 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:39.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:39.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:39.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:39.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:39.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:39.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:39.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:39.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:39.861 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:40.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=1 2024-05-08T19:12:40.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 1 '!=' null 2024-05-08T19:12:40.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:40.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:40.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:40.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:40.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:40.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:40.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:40.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:40.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:40.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:40.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:41.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:41.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:41.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:41.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:41.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:41.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:42.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:12:42.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:12:42.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:42.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:42.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:42.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:42.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:42.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:42.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:42.322 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:42.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:42.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:42.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:42.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:42.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:42.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:42.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:43.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:43.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:43.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:43.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:43.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:43.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:43.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:43.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:43.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:43.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T19:12:43.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T19:12:43.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:43.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:43.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:43.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:43.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:43.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:43.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:43.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:43.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:43.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:43.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:44.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:44.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:44.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:44.349 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:44.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:44.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:44.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:44.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:44.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:44.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:44.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:44.872 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:44.872 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:45.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T19:12:45.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T19:12:45.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:45.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:45.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:45.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:45.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:45.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:45.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:45.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:45.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:45.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:45.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:46.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:46.087 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:46.087 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:46.087 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:46.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:46.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:46.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:46.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:46.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:46.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:46.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:46.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:46.621 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:47.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:12:47.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:12:47.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:47.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:47.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:47.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:47.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:47.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:47.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:47.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:47.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:47.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:47.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:47.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:47.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:47.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:47.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:48.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:48.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:48.613 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:48.613 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:49.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:12:49.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:12:49.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:49.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:49.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:49.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:49.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:49.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:49.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:49.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:49.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:49.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:49.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:49.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:49.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:49.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:49.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:50.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:50.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:50.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:50.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:12:50.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:12:50.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:50.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:50.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:50.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:50.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:50.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:50.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:50.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:50.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:50.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:50.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:51.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:51.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:51.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:51.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:51.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:51.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:51.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:12:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:12:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:52.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:52.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:52.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:52.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:52.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:52.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:52.757 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:52.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:52.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:53.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:53.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:53.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:53.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:53.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:53.950 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:53.950 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:54.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:12:54.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:12:54.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:54.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:54.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:54.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:54.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:54.730 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:54.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:54.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:54.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:54.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:54.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:55.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:55.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:55.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:55.249 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:55.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:55.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:56.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:12:56.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:12:56.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:56.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:56.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:56.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:56.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:56.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:56.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:56.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:56.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:56.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:56.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:56.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:56.937 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:56.937 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:56.937 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:57.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:57.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:57.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:57.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:57.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:57.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:57.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:57.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:57.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:58.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:12:58.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:12:58.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:58.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:58.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:58.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:58.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:58.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:58.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:58.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:58.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:58.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:58.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:12:58.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:12:58.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:12:58.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:12:58.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:12:59.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:12:59.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:12:59.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:12:59.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:12:59.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:12:59.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:12:59.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:12:59.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:12:59.176 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:12:59.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:12:59.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:12:59.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:12:59.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:12:59.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:12:59.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:12:59.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:12:59.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:12:59.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:12:59.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:12:59.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:12:59.979 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:12:59.979 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:00.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:00.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:00.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:00.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:01.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:01.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:01.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:01.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:01.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:01.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:01.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:01.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:01.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:01.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:13:01.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:13:01.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:01.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:01.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:01.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:01.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:01.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:01.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:01.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:01.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:01.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:01.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:02.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:02.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:02.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:02.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:02.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:02.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:02.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:03.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:13:03.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:13:03.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:03.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:03.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:03.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:03.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:03.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:03.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:03.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:03.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:03.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:03.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:04.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:04.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:04.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:04.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:04.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:04.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:04.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:04.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:04.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:04.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:04.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:04.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:04.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:05.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:13:05.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:13:05.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:05.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:05.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:05.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:05.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:05.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:05.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:05.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:05.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:05.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:05.448 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:05.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:05.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:05.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:05.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:06.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:06.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:06.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:06.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:06.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:06.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:06.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:06.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:06.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:07.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:13:07.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:13:07.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:07.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:07.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:07.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:07.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:07.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:07.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:07.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:07.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:07.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:07.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:07.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:07.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:07.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:07.626 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:08.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:08.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:08.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:08.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:08.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:08.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:08.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:08.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:08.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:08.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:13:08.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:13:08.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:08.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:08.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:09.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:09.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:09.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:09.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:09.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:09.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:09.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:09.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:09.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:09.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:09.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:09.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:10.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:10.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:10.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:10.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:10.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:10.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:10.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:10.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:10.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:10.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:13:10.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:13:10.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:10.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:10.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:10.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:10.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:10.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:10.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:10.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:10.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:11.000 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:11.000 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:11.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:11.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:11.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:11.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:12.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:12.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:12.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:12.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:12.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:12.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:12.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:12.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:12.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:12.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:13:12.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:13:12.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:12.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:12.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:12.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:12.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:12.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:12.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:12.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:12.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:12.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:12.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:13.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:13.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:13.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:13.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:13.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:13.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:13.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:13.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:13.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:13.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:13.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:13.892 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:13.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:14.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:13:14.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:13:14.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:14.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:14.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:14.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:14.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:14.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:14.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:14.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:14.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:14.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:14.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:15.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:15.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:15.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:15.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:15.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:15.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:15.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:15.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:15.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:15.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:15.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:15.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:15.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:16.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:13:16.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:13:16.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:16.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:16.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:16.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:16.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:16.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:16.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:16.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:16.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:16.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:16.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:16.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:16.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:16.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:16.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:17.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:17.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:17.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:17.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:17.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:17.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:17.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:17.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:17.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:18.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:13:18.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:13:18.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:18.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:18.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:18.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:18.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:18.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:18.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:18.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:18.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:18.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:18.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:18.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:18.773 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:18.773 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:18.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:19.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:19.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:19.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:19.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:19.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:19.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:19.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:19.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:19.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:19.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:13:19.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:13:19.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:19.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:19.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:20.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:20.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:20.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:20.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:20.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:20.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:20.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:20.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:20.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:20.579 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:20.579 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:20.580 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:21.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:21.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:21.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:21.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:21.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:21.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:21.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:21.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:21.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:21.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:13:21.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:13:21.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:13:21.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:21.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:13:21.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:21.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:21.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:21.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:21.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:21.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:21.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:21.919 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:22.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:22.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:22.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:22.313 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:22.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:22.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:23.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T19:13:23.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T19:13:23.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 1 >= 13 )) 2024-05-08T19:13:23.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:23.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.2 2024-05-08T19:13:23.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:23.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:23.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:23.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:23.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:23.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:23.802 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:23.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:24.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:24.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:24.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:24.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:24.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:24.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:24.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:24.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:24.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:24.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:24.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:24.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:24.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:25.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T19:13:25.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T19:13:25.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 2 >= 13 )) 2024-05-08T19:13:25.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:25.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.4 2024-05-08T19:13:25.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:25.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:25.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:25.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:25.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:25.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:25.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:25.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:26.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:26.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:26.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:26.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:26.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:26.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:26.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:27.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T19:13:27.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T19:13:27.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 3 >= 13 )) 2024-05-08T19:13:27.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:27.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.8 2024-05-08T19:13:28.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:28.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:28.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:28.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:28.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:28.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:28.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:28.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:13:28.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:28.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:28.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:29.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:13:29.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:13:29.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:13:29.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:13:29.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:13:29.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:13:29.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:13:29.018 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:13:29.018 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:13:29.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T19:13:29.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T19:13:29.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 4 >= 13 )) 2024-05-08T19:13:29.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:13:29.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 1.6 2024-05-08T19:13:31.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:13:31.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:13:31.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:13:31.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:13:31.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:13:31.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:13:31.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:13:31.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:13:31.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:13:31.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:13:31.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:13:31.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:13:32.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:13:32.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:13:32.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:13:32.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:554: TEST_backfill_ec_all_out: expr 200 '*' 3 2024-05-08T19:13:32.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:554: TEST_backfill_ec_all_out: local misplaced=600 2024-05-08T19:13:32.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:555: TEST_backfill_ec_all_out: check td/osd-backfill-stats 1.0 1 erasure 0 0 600 200 2024-05-08T19:13:32.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:13:32.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=erasure 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=0 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=600 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=200 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:13:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:13:32.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:13:32.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2024-05-08T19:13:32.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:13:32.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:13:32.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:13:32.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2024-05-08T19:13:32.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:89: check: addp=p 2024-05-08T19:13:32.206 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:13:32.207 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.207 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:13:32.207 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:13:32.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[4,3,NONE]/[1,0,2]' 2024-05-08T19:13:32.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[4,3,NONE]/[1,0,2]' ']' 2024-05-08T19:13:32.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:13:32.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:13:32.234 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.234 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [4,3,NONE]/[1,0,2]p' 2024-05-08T19:13:32.234 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:13:32.234 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:13:32.234 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:13:32.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=0 2024-05-08T19:13:32.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2024-05-08T19:13:32.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 0 0 2024-05-08T19:13:32.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-05-08T19:13:32.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:13:32.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-05-08T19:13:32.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:13:32.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:13:32.242 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.242 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:13:32.242 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:13:32.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=0 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 0 0 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [4,3,NONE]/[1,0,2]p' 2024-05-08T19:13:32.257 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:13:32.257 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:13:32.257 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=600 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 600 ']' 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 600 600 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=600 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=600 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:13:32.264 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:13:32.265 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:13:32.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=202 2024-05-08T19:13:32.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 202 ']' 2024-05-08T19:13:32.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 202 200 2024-05-08T19:13:32.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=202 2024-05-08T19:13:32.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:13:32.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=200 2024-05-08T19:13:32.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:13:32.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:13:32.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:557: TEST_backfill_ec_all_out: delete_pool test 2024-05-08T19:13:32.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:13:32.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:13:32.880 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:13:32.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:558: TEST_backfill_ec_all_out: kill_daemons td/osd-backfill-stats 2024-05-08T19:13:32.899 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:13:32.899 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:13:32.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:13:32.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:13:32.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:13:38.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:13:38.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:13:38.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:13:38.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:13:38.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:13:38.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:13:38.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:13:38.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:13:38.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:13:38.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:13:38.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:13:38.228 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:13:38.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:13:38.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:13:38.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:13:38.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:13:38.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:13:38.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:13:38.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:13:38.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:13:38.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:13:38.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:13:38.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:13:38.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:13:38.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:13:38.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:13:38.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:13:38.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:13:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:13:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:13:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:13:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:13:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:13:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:13:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:13:38.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:13:38.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:13:38.280 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:13:38.280 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:13:38.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:13:38.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:13:38.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:13:38.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:13:38.281 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:13:38.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:13:38.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:13:38.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:13:38.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:13:38.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:13:38.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:13:38.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:13:38.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:13:38.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:13:38.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:13:38.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:13:38.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:13:38.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:13:38.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:13:38.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:13:38.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:13:38.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:13:38.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:13:38.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:13:38.289 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:13:38.289 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:13:38.290 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:13:38.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:13:38.292 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:13:38.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:13:38.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_ec_down_all_out td/osd-backfill-stats 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:619: TEST_backfill_ec_down_all_out: local dir=td/osd-backfill-stats 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:621: TEST_backfill_ec_down_all_out: run_mon td/osd-backfill-stats a 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:13:38.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:13:38.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:13:38.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:13:38.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:13:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:13:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:13:38.741 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:13:38.742 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:13:38.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:13:38.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:13:38.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:13:38.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:13:38.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:13:38.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:13:38.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:13:39.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:13:39.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:13:39.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:13:39.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:13:39.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:13:39.095 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:13:39.095 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:13:39.095 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:13:39.095 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:13:39.095 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:13:39.095 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:13:39.096 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:13:39.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:13:39.096 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:13:39.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:622: TEST_backfill_ec_down_all_out: run_mgr td/osd-backfill-stats x 2024-05-08T19:13:39.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:13:39.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:13:39.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:13:39.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:13:39.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:13:39.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:13:40.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:13:40.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:13:40.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:13:40.171 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:13:40.171 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:13:40.171 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:13:40.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:13:40.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:13:40.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:13:40.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:623: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 0 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:13:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:13:40.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:13:40.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:13:40.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:13:40.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:13:40.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:13:40.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:13:40.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:13:40.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:13:40.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:13:40.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:13:40.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=bd6d43ae-7d27-4105-bc1a-aaad296e6ec4 2024-05-08T19:13:40.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 bd6d43ae-7d27-4105-bc1a-aaad296e6ec4' 2024-05-08T19:13:40.254 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 bd6d43ae-7d27-4105-bc1a-aaad296e6ec4 2024-05-08T19:13:40.254 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:13:40.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDkzjtmmWOeEBAAdSquEfsvx5+HsGEkr6VTIg== 2024-05-08T19:13:40.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDkzjtmmWOeEBAAdSquEfsvx5+HsGEkr6VTIg=="}' 2024-05-08T19:13:40.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new bd6d43ae-7d27-4105-bc1a-aaad296e6ec4 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:13:40.630 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:13:40.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:13:40.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDkzjtmmWOeEBAAdSquEfsvx5+HsGEkr6VTIg== --osd-uuid bd6d43ae-7d27-4105-bc1a-aaad296e6ec4 2024-05-08T19:13:40.683 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:40.689+0000 7fb2c60b57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:13:40.715 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:40.721+0000 7fb2c60b57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:13:40.716 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:40.721+0000 7fb2c60b57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:13:40.717 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:40.721+0000 7fb2c60b57c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:13:40.717 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:40.721+0000 7fb2c60b57c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:13:40.717 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:40.721+0000 7fb2c60b57c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:13:40.754 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:40.761+0000 7fb2c60b57c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:13:48.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:13:48.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:13:48.533 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:13:48.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:13:48.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:13:49.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:13:49.115 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:13:49.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:13:49.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:13:49.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:13:49.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:13:49.143 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:49.149+0000 7f9be0f2f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:13:49.145 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:49.149+0000 7f9be0f2f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:13:49.146 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:49.153+0000 7f9be0f2f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:13:49.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:13:49.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:13:49.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:13:49.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:13:49.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:13:49.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:13:49.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:13:49.524 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:13:49.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:13:49.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:13:49.703 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:49.709+0000 7f9be0f2f7c0 -1 Falling back to public interface 2024-05-08T19:13:49.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:13:50.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:13:50.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:13:50.927 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:13:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:13:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:13:50.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:13:51.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:13:52.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:13:52.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:13:52.355 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:13:52.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:13:52.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:13:52.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:13:52.532 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:13:52.537+0000 7f9be0f2f7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:13:52.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:13:53.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:13:53.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:13:53.796 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:13:53.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:13:53.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:13:53.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:13:54.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:13:55.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:13:55.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:13:55.263 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:13:55.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:13:55.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:13:55.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:13:55.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:13:56.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:13:56.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:13:56.747 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:13:56.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:13:56.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:13:56.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:13:57.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:13:58.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:13:58.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:13:58.234 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:13:58.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:13:58.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:13:58.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:13:58.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:13:59.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:13:59.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:13:59.704 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:13:59.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:13:59.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:13:59.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:00.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:01.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:01.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:01.168 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:14:01.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:14:01.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:01.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:01.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:02.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:02.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:02.747 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:14:02.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:14:02.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:02.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:03.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:04.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:04.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:04.249 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:14:04.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:14:04.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:04.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:04.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:05.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:05.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:05.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:14:05.764 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:14:05.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:05.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:06.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:07.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:07.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:07.286 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:14:07.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:14:07.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:07.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:08.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:09.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:09.081 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:14:09.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:14:09.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:09.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:09.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:10.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:10.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:10.594 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:14:10.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:14:10.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:10.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:11.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:12.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:12.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:12.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:14:12.025 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:14:12.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:12.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:12.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:13.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:13.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:13.931 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:14:13.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:14:13.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:13.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:14.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:15.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:15.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:15.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:14:15.687 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:14:15.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:15.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:17.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:18.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:18.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:18.006 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:14:18.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:14:18.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:18.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:18.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:19.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:19.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:19.773 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:14:19.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:14:19.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:19.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:20.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:21.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:21.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:21.294 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:14:21.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:14:21.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:21.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:22.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:23.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:23.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:23.722 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:14:23.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:14:23.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:23.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:24.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:25.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:25.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:25.397 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:14:25.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:14:25.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:25.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:14:25.863 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3115062633,v1:127.0.0.1:6803/3115062633] [v2:127.0.0.1:6804/3115062633,v1:127.0.0.1:6805/3115062633] exists,up bd6d43ae-7d27-4105-bc1a-aaad296e6ec4 2024-05-08T19:14:25.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:14:25.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:14:25.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:14:25.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:624: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 1 2024-05-08T19:14:25.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:14:25.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:14:25.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:14:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:14:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:14:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:14:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:14:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:14:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:14:25.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:14:25.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5c884ff3-61d9-4e0f-8a16-3debdeef405d 2024-05-08T19:14:25.870 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 5c884ff3-61d9-4e0f-8a16-3debdeef405d 2024-05-08T19:14:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 5c884ff3-61d9-4e0f-8a16-3debdeef405d' 2024-05-08T19:14:25.870 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:14:25.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQARzztmqw9ONRAAZLynhwzgVV748Ol617vwUA== 2024-05-08T19:14:25.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQARzztmqw9ONRAAZLynhwzgVV748Ol617vwUA=="}' 2024-05-08T19:14:25.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5c884ff3-61d9-4e0f-8a16-3debdeef405d -i td/osd-backfill-stats/1/new.json 2024-05-08T19:14:26.439 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:14:26.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:14:26.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQARzztmqw9ONRAAZLynhwzgVV748Ol617vwUA== --osd-uuid 5c884ff3-61d9-4e0f-8a16-3debdeef405d 2024-05-08T19:14:26.491 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:26.496+0000 7f3f744d77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:14:26.493 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:26.496+0000 7f3f744d77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:14:26.494 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:26.500+0000 7f3f744d77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:14:26.495 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:26.500+0000 7f3f744d77c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:14:26.495 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:26.500+0000 7f3f744d77c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:14:26.495 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:26.500+0000 7f3f744d77c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:14:26.564 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:26.568+0000 7f3f744d77c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:14:34.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:14:34.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:14:34.792 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:14:34.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:14:34.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:14:35.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:14:35.406 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:14:35.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:14:35.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:14:35.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:14:35.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:14:35.439 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:35.444+0000 7f5f066117c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:14:35.441 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:35.448+0000 7f5f066117c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:14:35.443 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:35.448+0000 7f5f066117c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:14:35.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:14:35.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:14:35.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:14:35.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:14:35.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:14:35.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:35.865 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:14:35.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:14:35.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:35.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:35.995 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:36.000+0000 7f5f066117c0 -1 Falling back to public interface 2024-05-08T19:14:36.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:37.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:37.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:37.264 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:14:37.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:14:37.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:37.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:37.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:38.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:38.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:38.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:14:38.671 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:14:38.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:38.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:38.874 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:14:38.880+0000 7f5f066117c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:14:39.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:40.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:40.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:40.112 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:14:40.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:14:40.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:40.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:40.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:41.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:41.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:41.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:14:41.652 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:14:41.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:41.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:42.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:43.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:43.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:43.314 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:14:43.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:14:43.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:43.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:43.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:44.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:44.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:44.835 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:14:44.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:14:44.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:44.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:45.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:46.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:46.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:46.363 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:14:46.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:14:46.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:46.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:46.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:47.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:47.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:47.821 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:14:47.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:14:47.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:47.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:48.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:49.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:49.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:49.462 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:14:49.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:14:49.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:49.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:50.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:51.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:51.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:51.114 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:14:51.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:14:51.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:51.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:51.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:52.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:52.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:52.747 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:14:52.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:14:52.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:52.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:53.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:54.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:54.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:54.192 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:14:54.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:14:54.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:54.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:54.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:55.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:55.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:55.606 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:14:55.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:14:55.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:55.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:56.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:57.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:57.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:57.279 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:14:57.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:14:57.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:57.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:57.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:14:58.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:14:58.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:14:58.941 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:14:58.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:14:58.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:14:58.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:14:59.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:00.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:00.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:00.455 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:15:00.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:15:00.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:00.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:15:01.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:02.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:02.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:02.184 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:15:02.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:15:02.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:02.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:15:02.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:03.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:03.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:03.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:15:03.751 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:15:03.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:03.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:15:04.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:05.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:05.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:05.759 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:15:05.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:15:05.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:05.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:15:07.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:08.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:08.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:08.049 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:15:08.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:15:08.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:08.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:15:08.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:09.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:09.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:09.817 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:15:09.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:15:09.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:09.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:15:10.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:11.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:11.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:11.765 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:15:11.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:15:11.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:11.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:15:12.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:13.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:13.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:13.292 INFO:tasks.workunit.client.0.smithi117.stdout:23 2024-05-08T19:15:13.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 23 2024-05-08T19:15:13.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:13.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:15:13.725 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2247099347,v1:127.0.0.1:6811/2247099347] [v2:127.0.0.1:6812/2247099347,v1:127.0.0.1:6813/2247099347] exists,up 5c884ff3-61d9-4e0f-8a16-3debdeef405d 2024-05-08T19:15:13.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:15:13.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:15:13.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:625: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 2 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:15:13.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:15:13.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:15:13.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:15:13.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:15:13.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:15:13.729 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:15:13.729 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:15:13.729 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:15:13.729 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:15:13.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:15:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7c483ae3-2531-4de6-9c70-8ec6df0ada56 2024-05-08T19:15:13.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 7c483ae3-2531-4de6-9c70-8ec6df0ada56' 2024-05-08T19:15:13.732 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 7c483ae3-2531-4de6-9c70-8ec6df0ada56 2024-05-08T19:15:13.732 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:15:13.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBBzztmDrxoLRAAWQm57GFK56TncOKcVfP2RQ== 2024-05-08T19:15:13.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBBzztmDrxoLRAAWQm57GFK56TncOKcVfP2RQ=="}' 2024-05-08T19:15:13.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7c483ae3-2531-4de6-9c70-8ec6df0ada56 -i td/osd-backfill-stats/2/new.json 2024-05-08T19:15:14.333 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:15:14.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:15:14.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBBzztmDrxoLRAAWQm57GFK56TncOKcVfP2RQ== --osd-uuid 7c483ae3-2531-4de6-9c70-8ec6df0ada56 2024-05-08T19:15:14.378 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:14.383+0000 7fa8b830d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:15:14.381 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:14.383+0000 7fa8b830d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:15:14.382 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:14.387+0000 7fa8b830d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:15:14.383 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:14.387+0000 7fa8b830d7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:15:14.383 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:14.387+0000 7fa8b830d7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:15:14.383 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:14.387+0000 7fa8b830d7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:15:14.450 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:14.455+0000 7fa8b830d7c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:15:22.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:15:22.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:15:22.689 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:15:22.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:15:22.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:15:23.259 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:15:23.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:15:23.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:15:23.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:15:23.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:15:23.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:15:23.292 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:23.295+0000 7f4b8a36a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:15:23.294 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:23.299+0000 7f4b8a36a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:15:23.295 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:23.299+0000 7f4b8a36a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:15:23.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:15:23.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:15:23.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:15:23.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:15:23.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:15:23.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:23.678 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:15:23.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:15:23.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:23.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:23.847 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:23.851+0000 7f4b8a36a7c0 -1 Falling back to public interface 2024-05-08T19:15:24.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:25.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:25.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:25.136 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:15:25.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:15:25.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:25.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:25.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:26.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:26.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:26.569 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:15:26.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:15:26.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:26.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:26.717 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:15:26.719+0000 7f4b8a36a7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:15:27.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:28.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:28.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:28.159 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:15:28.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:15:28.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:28.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:28.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:29.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:29.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:29.578 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:15:29.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:15:29.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:29.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:30.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:31.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:31.278 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:15:31.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:15:31.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:31.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:31.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:32.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:32.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:32.853 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:15:32.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:15:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:32.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:33.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:34.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:34.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:34.285 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:15:34.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:15:34.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:34.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:34.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:35.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:35.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:35.909 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:15:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:15:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:36.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:37.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:37.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:37.365 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:15:37.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:15:37.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:37.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:37.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:38.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:38.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:38.902 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:15:38.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:15:38.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:38.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:39.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:40.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:40.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:40.429 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:15:40.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:15:40.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:40.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:41.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:42.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:42.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:42.044 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:15:42.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:15:42.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:42.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:42.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:43.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:43.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:43.729 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:15:43.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:15:43.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:43.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:44.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:45.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:45.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:45.185 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:15:45.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:15:45.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:45.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:45.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:46.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:46.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:46.731 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:15:46.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:15:46.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:46.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:47.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:48.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:48.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:48.470 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:15:48.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:15:48.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:48.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:49.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:50.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:50.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:50.599 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:15:50.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:15:50.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:50.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:51.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:52.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:52.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:52.687 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:15:52.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:15:52.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:52.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:53.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:54.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:54.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:54.844 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:15:54.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:15:54.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:54.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:56.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:57.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:57.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:57.319 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:15:57.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:15:57.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:57.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:58.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:15:59.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:15:59.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:15:59.412 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:15:59.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:15:59.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:15:59.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:15:59.849 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1349571561,v1:127.0.0.1:6819/1349571561] [v2:127.0.0.1:6820/1349571561,v1:127.0.0.1:6821/1349571561] exists,up 7c483ae3-2531-4de6-9c70-8ec6df0ada56 2024-05-08T19:15:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:15:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:15:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:15:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:626: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 3 2024-05-08T19:15:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:15:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:15:59.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:15:59.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:15:59.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:15:59.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:15:59.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:15:59.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:15:59.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:15:59.855 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 0ad3c300-8601-4dfa-9fd8-e39abc960a29 2024-05-08T19:15:59.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=0ad3c300-8601-4dfa-9fd8-e39abc960a29 2024-05-08T19:15:59.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 0ad3c300-8601-4dfa-9fd8-e39abc960a29' 2024-05-08T19:15:59.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:15:59.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBvzztmn11vNBAAO5pSEPBTvspH00eWnGBujA== 2024-05-08T19:15:59.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBvzztmn11vNBAAO5pSEPBTvspH00eWnGBujA=="}' 2024-05-08T19:15:59.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 0ad3c300-8601-4dfa-9fd8-e39abc960a29 -i td/osd-backfill-stats/3/new.json 2024-05-08T19:16:00.523 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:16:00.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:16:00.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBvzztmn11vNBAAO5pSEPBTvspH00eWnGBujA== --osd-uuid 0ad3c300-8601-4dfa-9fd8-e39abc960a29 2024-05-08T19:16:00.581 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:00.582+0000 7fcb6d75e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:00.614 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:00.618+0000 7fcb6d75e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:00.615 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:00.618+0000 7fcb6d75e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:00.616 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:00.618+0000 7fcb6d75e7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:16:00.616 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:00.618+0000 7fcb6d75e7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:16:00.616 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:00.618+0000 7fcb6d75e7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:16:00.653 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:00.658+0000 7fcb6d75e7c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:16:08.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:16:08.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:16:08.972 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:16:08.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:16:08.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:16:09.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:16:09.560 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:16:09.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:16:09.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:16:09.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:16:09.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:16:09.593 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:09.598+0000 7f3e85dda7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:09.630 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:09.638+0000 7f3e85dda7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:09.632 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:09.638+0000 7f3e85dda7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:09.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:16:09.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:16:09.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:16:09.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:16:09.975 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:16:09.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:16:09.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:09.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:16:09.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:09.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:10.191 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:10.198+0000 7f3e85dda7c0 -1 Falling back to public interface 2024-05-08T19:16:10.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:11.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:11.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:11.442 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:16:11.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:16:11.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:11.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:11.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:12.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:12.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:12.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:16:12.868 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:16:12.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:12.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:13.065 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:13.070+0000 7f3e85dda7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:16:13.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:14.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:14.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:14.416 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:16:14.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:16:14.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:14.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:14.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:15.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:15.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:15.920 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:16:15.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:16:15.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:15.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:16.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:17.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:17.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:17.686 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:16:17.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:16:17.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:17.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:18.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:19.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:19.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:19.183 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:16:19.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:16:19.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:19.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:19.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:20.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:20.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:20.849 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:16:20.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:16:20.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:20.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:21.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:22.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:22.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:22.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:16:22.516 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:16:22.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:22.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:22.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:23.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:23.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:23.964 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:16:23.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:16:23.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:23.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:24.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:25.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:25.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:25.567 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:16:25.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:16:25.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:25.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:26.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:27.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:27.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:27.202 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:16:27.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:16:27.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:27.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:27.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:28.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:28.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:28.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:16:28.664 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:16:28.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:28.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:29.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:30.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:30.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:30.377 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:16:30.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:16:30.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:30.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:30.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:31.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:31.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:31.790 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:16:31.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:16:31.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:31.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:32.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:33.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:33.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:33.368 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:16:33.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:16:33.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:33.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:34.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:35.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:35.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:35.190 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:16:35.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:16:35.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:35.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:36.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:37.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:37.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:37.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:16:37.259 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:16:37.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:37.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:38.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:39.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:39.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:39.486 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:16:39.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:16:39.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:39.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:40.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:41.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:41.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:41.380 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:16:41.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:16:41.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:41.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:42.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:43.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:43.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:43.453 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:16:43.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:16:43.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:43.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:44.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:45.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:45.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:45.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:16:45.925 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:16:45.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:45.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:16:46.412 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1778487507,v1:127.0.0.1:6827/1778487507] [v2:127.0.0.1:6828/1778487507,v1:127.0.0.1:6829/1778487507] exists,up 0ad3c300-8601-4dfa-9fd8-e39abc960a29 2024-05-08T19:16:46.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:627: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 4 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:16:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:16:46.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:16:46.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:16:46.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:16:46.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c90f9f4c-ef7d-49d1-852e-889c86da988a 2024-05-08T19:16:46.419 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 c90f9f4c-ef7d-49d1-852e-889c86da988a 2024-05-08T19:16:46.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 c90f9f4c-ef7d-49d1-852e-889c86da988a' 2024-05-08T19:16:46.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:16:46.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCezztmjjSIGhAAjmA+2NsV5rGeCTYlYECqPQ== 2024-05-08T19:16:46.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCezztmjjSIGhAAjmA+2NsV5rGeCTYlYECqPQ=="}' 2024-05-08T19:16:46.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c90f9f4c-ef7d-49d1-852e-889c86da988a -i td/osd-backfill-stats/4/new.json 2024-05-08T19:16:47.036 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:16:47.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:16:47.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCezztmjjSIGhAAjmA+2NsV5rGeCTYlYECqPQ== --osd-uuid c90f9f4c-ef7d-49d1-852e-889c86da988a 2024-05-08T19:16:47.093 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:47.097+0000 7f4caacda7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:47.195 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:47.201+0000 7f4caacda7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:47.197 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:47.201+0000 7f4caacda7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:47.197 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:47.205+0000 7f4caacda7c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:16:47.197 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:47.205+0000 7f4caacda7c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:16:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:47.205+0000 7f4caacda7c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:16:47.353 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:47.357+0000 7f4caacda7c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:16:55.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:16:55.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:16:55.607 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:16:55.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:16:55.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:16:56.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:16:56.180 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:16:56.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:16:56.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:16:56.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:16:56.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:16:56.214 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:56.221+0000 7f59f7bb57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:56.254 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:56.261+0000 7f59f7bb57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:56.256 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:56.261+0000 7f59f7bb57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:16:56.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:16:56.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:16:56.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:16:56.595 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:16:56.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:16:56.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:16:56.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:56.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:16:56.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:56.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:16:56.820 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:56.825+0000 7f59f7bb57c0 -1 Falling back to public interface 2024-05-08T19:16:57.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:58.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:58.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:58.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:16:58.037 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:16:58.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:58.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:16:58.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:16:59.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:16:59.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:16:59.459 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:16:59.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:16:59.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:16:59.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:16:59.787 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:16:59.793+0000 7f59f7bb57c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:16:59.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:00.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:00.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:00.925 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:17:00.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:17:00.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:00.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:01.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:02.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:02.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:02.606 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:17:02.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:17:02.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:02.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:03.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:04.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:04.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:04.190 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:17:04.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:17:04.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:04.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:04.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:05.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:05.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:05.717 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:17:05.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:17:05.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:05.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:06.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:07.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:07.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:07.471 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:17:07.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:17:07.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:07.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:07.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:08.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:08.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:08.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:17:08.939 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:17:08.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:08.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:09.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:10.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:10.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:10.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:17:10.439 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:17:10.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:10.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:10.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:11.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:11.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:11.943 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:17:11.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:17:11.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:11.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:12.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:13.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:13.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:13.540 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:17:13.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:17:13.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:13.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:14.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:15.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:15.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:15.172 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:17:15.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:17:15.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:15.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:15.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:16.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:16.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:16.668 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:17:16.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:17:16.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:16.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:17.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:18.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:18.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:18.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:17:18.282 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:17:18.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:18.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:18.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:19.760 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:17:19.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:17:19.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:19.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:20.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:21.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:21.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:21.496 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:17:21.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:17:21.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:21.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:22.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:23.854 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:17:23.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:17:23.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:23.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:24.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:25.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:25.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:25.740 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:17:25.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:17:25.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:25.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:26.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:27.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:27.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:27.796 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:17:27.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:17:27.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:27.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:28.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:29.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:29.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:29.793 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:17:29.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:17:29.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:29.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:30.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:31.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:31.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:31.827 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:17:31.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:17:31.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:31.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:32.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:33.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:33.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:33.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:17:33.439 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:17:33.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:33.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:17:33.850 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2235334453,v1:127.0.0.1:6835/2235334453] [v2:127.0.0.1:6836/2235334453,v1:127.0.0.1:6837/2235334453] exists,up c90f9f4c-ef7d-49d1-852e-889c86da988a 2024-05-08T19:17:33.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:17:33.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:17:33.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:17:33.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:628: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 5 2024-05-08T19:17:33.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:17:33.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/5 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:17:33.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:17:33.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:17:33.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:17:33.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:17:33.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:17:33.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/5 2024-05-08T19:17:33.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:17:33.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=59c8446e-8398-4c9e-ba9c-7290d005f063 2024-05-08T19:17:33.858 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 59c8446e-8398-4c9e-ba9c-7290d005f063 2024-05-08T19:17:33.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 59c8446e-8398-4c9e-ba9c-7290d005f063' 2024-05-08T19:17:33.858 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:17:33.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDNzztmG6EONRAADFeItTy5DOLwGq8Rw5SX9g== 2024-05-08T19:17:33.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDNzztmG6EONRAADFeItTy5DOLwGq8Rw5SX9g=="}' 2024-05-08T19:17:33.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 59c8446e-8398-4c9e-ba9c-7290d005f063 -i td/osd-backfill-stats/5/new.json 2024-05-08T19:17:34.555 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:17:34.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/5/new.json 2024-05-08T19:17:34.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDNzztmG6EONRAADFeItTy5DOLwGq8Rw5SX9g== --osd-uuid 59c8446e-8398-4c9e-ba9c-7290d005f063 2024-05-08T19:17:34.609 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:34.612+0000 7fcb1eb147c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:17:34.611 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:34.616+0000 7fcb1eb147c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:17:34.612 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:34.616+0000 7fcb1eb147c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:17:34.613 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:34.616+0000 7fcb1eb147c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:17:34.613 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:34.616+0000 7fcb1eb147c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:17:34.613 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:34.616+0000 7fcb1eb147c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:17:34.722 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:34.728+0000 7fcb1eb147c0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-05-08T19:17:42.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-05-08T19:17:42.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:17:42.479 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T19:17:42.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T19:17:42.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:17:43.100 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T19:17:43.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T19:17:43.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:17:43.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:17:43.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:17:43.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:17:43.134 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:43.140+0000 7f64397267c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:17:43.165 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:43.172+0000 7f64397267c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:17:43.167 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:43.172+0000 7f64397267c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:17:43.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T19:17:43.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:17:43.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T19:17:43.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:17:43.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:17:43.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:43.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:17:43.664 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:17:43.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:43.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:43.743 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:43.748+0000 7f64397267c0 -1 Falling back to public interface 2024-05-08T19:17:44.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:45.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:45.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:45.076 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:17:45.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:17:45.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:45.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:45.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:46.574 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:17:46.580+0000 7f64397267c0 -1 osd.5 0 log_to_monitors true 2024-05-08T19:17:46.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:46.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:46.711 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:17:46.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:17:46.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:46.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:47.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:48.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:48.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:48.414 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:17:48.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:17:48.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:48.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:48.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:49.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:49.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:49.993 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:17:49.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:17:49.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:49.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:50.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:51.567 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:17:51.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:17:51.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:51.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:52.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:53.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:53.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:53.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:17:53.229 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:17:53.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:53.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:53.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:54.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:54.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:54.887 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:17:54.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:17:54.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:54.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:55.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:56.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:56.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:56.478 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:17:56.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:17:56.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:56.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:56.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:57.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:57.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:57.927 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:17:57.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:17:57.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:57.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:17:58.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:17:59.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:17:59.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:17:59.549 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:17:59.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:17:59.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:17:59.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:00.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:01.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:01.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:01.165 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:18:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:18:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:01.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:01.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:02.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:02.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:02.730 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:18:02.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:18:02.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:02.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:03.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:04.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:04.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:04.271 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:18:04.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:18:04.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:04.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:04.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:05.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:05.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:05.870 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:18:05.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:18:05.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:05.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:06.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:07.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:07.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:07.366 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:18:07.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:18:07.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:07.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:08.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:09.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:09.123 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:18:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:18:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:09.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:10.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:11.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:11.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:11.188 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:18:11.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:18:11.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:11.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:12.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:13.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:13.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:13.148 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:18:13.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:18:13.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:13.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:14.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:15.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:15.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:15.541 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:18:15.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:18:15.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:15.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:16.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:17.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:17.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:17.370 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:18:17.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:18:17.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:17.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:18.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:18:19.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:18:19.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:18:19.241 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:18:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:18:19.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:18:19.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:18:19.668 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/580947723,v1:127.0.0.1:6843/580947723] [v2:127.0.0.1:6844/580947723,v1:127.0.0.1:6845/580947723] exists,up 59c8446e-8398-4c9e-ba9c-7290d005f063 2024-05-08T19:18:19.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:18:19.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:18:19.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:18:19.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:630: TEST_backfill_ec_down_all_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T19:18:20.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:631: TEST_backfill_ec_down_all_out: create_pool test 1 1 erasure myprofile 2024-05-08T19:18:20.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 erasure myprofile 2024-05-08T19:18:21.805 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:18:21.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:18:22.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:632: TEST_backfill_ec_down_all_out: ceph osd pool set test min_size 2 2024-05-08T19:18:23.836 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 min_size to 2 2024-05-08T19:18:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:634: TEST_backfill_ec_down_all_out: wait_for_clean 2024-05-08T19:18:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:18:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:18:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:18:23.858 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:18:23.858 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:18:23.858 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:18:23.859 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:18:23.859 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:18:23.859 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:18:23.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:18:23.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:18:23.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:18:23.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:18:23.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:18:23.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:18:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:18:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:18:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:18:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:18:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:18:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:18:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:18:24.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:18:24.392 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:18:24.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836536 2024-05-08T19:18:24.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836536 2024-05-08T19:18:24.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536' 2024-05-08T19:18:24.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:18:24.554 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:18:24.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673005 2024-05-08T19:18:24.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673005 2024-05-08T19:18:24.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673005' 2024-05-08T19:18:24.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:18:24.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:18:24.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509481 2024-05-08T19:18:24.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509481 2024-05-08T19:18:24.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673005 2-64424509481' 2024-05-08T19:18:24.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:18:24.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:18:25.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345950 2024-05-08T19:18:25.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345950 2024-05-08T19:18:25.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673005 2-64424509481 3-85899345950' 2024-05-08T19:18:25.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:18:25.117 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:18:25.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182422 2024-05-08T19:18:25.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182422 2024-05-08T19:18:25.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673005 2-64424509481 3-85899345950 4-107374182422' 2024-05-08T19:18:25.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:18:25.273 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:18:25.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018887 2024-05-08T19:18:25.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018887 2024-05-08T19:18:25.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836536 1-42949673005 2-64424509481 3-85899345950 4-107374182422 5-128849018887' 2024-05-08T19:18:25.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:18:25.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836536 2024-05-08T19:18:25.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:18:25.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:18:25.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836536 2024-05-08T19:18:25.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:18:25.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836536 2024-05-08T19:18:25.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836536' 2024-05-08T19:18:25.447 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836536 2024-05-08T19:18:25.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:18:25.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836536 -lt 21474836536 2024-05-08T19:18:25.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:18:25.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673005 2024-05-08T19:18:25.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:18:25.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:18:25.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673005 2024-05-08T19:18:25.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:18:25.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673005 2024-05-08T19:18:25.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673005' 2024-05-08T19:18:25.844 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673005 2024-05-08T19:18:25.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:18:26.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673005 -lt 42949673005 2024-05-08T19:18:26.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:18:26.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509481 2024-05-08T19:18:26.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:18:26.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:18:26.244 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:18:26.245 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509481 2024-05-08T19:18:26.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509481 2024-05-08T19:18:26.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509481' 2024-05-08T19:18:26.246 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509481 2024-05-08T19:18:26.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:18:26.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509479 -lt 64424509481 2024-05-08T19:18:26.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:18:27.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:18:27.684 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:18:28.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509482 -lt 64424509481 2024-05-08T19:18:28.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:18:28.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:18:28.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345950 2024-05-08T19:18:28.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:18:28.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345950 2024-05-08T19:18:28.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:18:28.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345950 2024-05-08T19:18:28.102 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345950 2024-05-08T19:18:28.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345950' 2024-05-08T19:18:28.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:18:28.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345951 -lt 85899345950 2024-05-08T19:18:28.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:18:28.497 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182422 2024-05-08T19:18:28.497 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:18:28.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:18:28.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182422 2024-05-08T19:18:28.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:18:28.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182422 2024-05-08T19:18:28.501 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182422 2024-05-08T19:18:28.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182422' 2024-05-08T19:18:28.502 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:18:28.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182422 -lt 107374182422 2024-05-08T19:18:28.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:18:28.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018887 2024-05-08T19:18:28.940 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:18:28.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:18:28.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018887 2024-05-08T19:18:28.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:18:28.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018887 2024-05-08T19:18:28.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018887' 2024-05-08T19:18:28.944 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018887 2024-05-08T19:18:28.944 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:18:29.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018887 -lt 128849018887 2024-05-08T19:18:29.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:18:29.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:18:29.348 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:18:29.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:18:29.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:18:29.914 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:18:29.914 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:18:29.914 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:18:29.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:18:29.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:18:29.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:18:30.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:18:30.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:18:30.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:18:30.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:18:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:18:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:18:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:18:30.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: seq 1 200 2024-05-08T19:18:30.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:30.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj1 /dev/null 2024-05-08T19:18:31.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:31.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj2 /dev/null 2024-05-08T19:18:31.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:31.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj3 /dev/null 2024-05-08T19:18:31.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:31.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj4 /dev/null 2024-05-08T19:18:31.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:31.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj5 /dev/null 2024-05-08T19:18:32.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:32.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj6 /dev/null 2024-05-08T19:18:32.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:32.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj7 /dev/null 2024-05-08T19:18:32.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:32.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj8 /dev/null 2024-05-08T19:18:32.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:32.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj9 /dev/null 2024-05-08T19:18:33.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:33.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj10 /dev/null 2024-05-08T19:18:33.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:33.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj11 /dev/null 2024-05-08T19:18:33.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:33.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj12 /dev/null 2024-05-08T19:18:33.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:33.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj13 /dev/null 2024-05-08T19:18:34.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:34.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj14 /dev/null 2024-05-08T19:18:34.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:34.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj15 /dev/null 2024-05-08T19:18:34.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:34.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj16 /dev/null 2024-05-08T19:18:35.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:35.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj17 /dev/null 2024-05-08T19:18:35.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:35.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj18 /dev/null 2024-05-08T19:18:35.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:35.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj19 /dev/null 2024-05-08T19:18:35.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:35.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj20 /dev/null 2024-05-08T19:18:36.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:36.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj21 /dev/null 2024-05-08T19:18:36.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:36.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj22 /dev/null 2024-05-08T19:18:36.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:36.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj23 /dev/null 2024-05-08T19:18:36.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:36.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj24 /dev/null 2024-05-08T19:18:37.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:37.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj25 /dev/null 2024-05-08T19:18:37.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:37.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj26 /dev/null 2024-05-08T19:18:37.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:37.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj27 /dev/null 2024-05-08T19:18:38.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:38.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj28 /dev/null 2024-05-08T19:18:38.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:38.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj29 /dev/null 2024-05-08T19:18:38.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:38.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj30 /dev/null 2024-05-08T19:18:38.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:38.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj31 /dev/null 2024-05-08T19:18:39.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:39.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj32 /dev/null 2024-05-08T19:18:39.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:39.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj33 /dev/null 2024-05-08T19:18:39.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:39.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj34 /dev/null 2024-05-08T19:18:39.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:39.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj35 /dev/null 2024-05-08T19:18:40.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:40.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj36 /dev/null 2024-05-08T19:18:40.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:40.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj37 /dev/null 2024-05-08T19:18:40.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:40.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj38 /dev/null 2024-05-08T19:18:40.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:40.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj39 /dev/null 2024-05-08T19:18:41.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:41.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj40 /dev/null 2024-05-08T19:18:41.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:41.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj41 /dev/null 2024-05-08T19:18:41.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:41.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj42 /dev/null 2024-05-08T19:18:42.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:42.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj43 /dev/null 2024-05-08T19:18:42.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:42.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj44 /dev/null 2024-05-08T19:18:42.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:42.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj45 /dev/null 2024-05-08T19:18:42.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:42.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj46 /dev/null 2024-05-08T19:18:43.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:43.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj47 /dev/null 2024-05-08T19:18:43.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:43.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj48 /dev/null 2024-05-08T19:18:43.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:43.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj49 /dev/null 2024-05-08T19:18:43.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:43.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj50 /dev/null 2024-05-08T19:18:44.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:44.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj51 /dev/null 2024-05-08T19:18:44.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:44.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj52 /dev/null 2024-05-08T19:18:44.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:44.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj53 /dev/null 2024-05-08T19:18:44.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:44.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj54 /dev/null 2024-05-08T19:18:45.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:45.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj55 /dev/null 2024-05-08T19:18:45.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:45.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj56 /dev/null 2024-05-08T19:18:45.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:45.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj57 /dev/null 2024-05-08T19:18:46.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:46.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj58 /dev/null 2024-05-08T19:18:46.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:46.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj59 /dev/null 2024-05-08T19:18:46.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:46.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj60 /dev/null 2024-05-08T19:18:46.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:46.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj61 /dev/null 2024-05-08T19:18:47.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:47.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj62 /dev/null 2024-05-08T19:18:47.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:47.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj63 /dev/null 2024-05-08T19:18:47.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:47.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj64 /dev/null 2024-05-08T19:18:48.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:48.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj65 /dev/null 2024-05-08T19:18:48.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:48.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj66 /dev/null 2024-05-08T19:18:48.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:48.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj67 /dev/null 2024-05-08T19:18:48.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:48.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj68 /dev/null 2024-05-08T19:18:49.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:49.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj69 /dev/null 2024-05-08T19:18:49.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:49.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj70 /dev/null 2024-05-08T19:18:49.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:49.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj71 /dev/null 2024-05-08T19:18:50.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:50.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj72 /dev/null 2024-05-08T19:18:50.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:50.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj73 /dev/null 2024-05-08T19:18:50.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:50.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj74 /dev/null 2024-05-08T19:18:50.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:50.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj75 /dev/null 2024-05-08T19:18:51.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:51.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj76 /dev/null 2024-05-08T19:18:51.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:51.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj77 /dev/null 2024-05-08T19:18:51.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:51.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj78 /dev/null 2024-05-08T19:18:52.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:52.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj79 /dev/null 2024-05-08T19:18:52.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:52.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj80 /dev/null 2024-05-08T19:18:52.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:52.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj81 /dev/null 2024-05-08T19:18:52.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:52.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj82 /dev/null 2024-05-08T19:18:53.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:53.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj83 /dev/null 2024-05-08T19:18:53.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:53.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj84 /dev/null 2024-05-08T19:18:53.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:53.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj85 /dev/null 2024-05-08T19:18:53.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:53.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj86 /dev/null 2024-05-08T19:18:54.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:54.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj87 /dev/null 2024-05-08T19:18:54.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:54.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj88 /dev/null 2024-05-08T19:18:54.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:54.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj89 /dev/null 2024-05-08T19:18:54.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:54.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj90 /dev/null 2024-05-08T19:18:55.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:55.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj91 /dev/null 2024-05-08T19:18:55.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:55.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj92 /dev/null 2024-05-08T19:18:55.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:55.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj93 /dev/null 2024-05-08T19:18:56.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:56.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj94 /dev/null 2024-05-08T19:18:56.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:56.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj95 /dev/null 2024-05-08T19:18:56.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:56.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj96 /dev/null 2024-05-08T19:18:56.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:56.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj97 /dev/null 2024-05-08T19:18:57.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:57.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj98 /dev/null 2024-05-08T19:18:57.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:57.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj99 /dev/null 2024-05-08T19:18:57.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:57.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj100 /dev/null 2024-05-08T19:18:57.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:57.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj101 /dev/null 2024-05-08T19:18:58.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:58.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj102 /dev/null 2024-05-08T19:18:58.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:58.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj103 /dev/null 2024-05-08T19:18:58.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:58.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj104 /dev/null 2024-05-08T19:18:59.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:59.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj105 /dev/null 2024-05-08T19:18:59.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:59.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj106 /dev/null 2024-05-08T19:18:59.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:59.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj107 /dev/null 2024-05-08T19:18:59.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:18:59.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj108 /dev/null 2024-05-08T19:19:00.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:00.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj109 /dev/null 2024-05-08T19:19:00.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:00.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj110 /dev/null 2024-05-08T19:19:00.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:00.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj111 /dev/null 2024-05-08T19:19:01.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:01.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj112 /dev/null 2024-05-08T19:19:01.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:01.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj113 /dev/null 2024-05-08T19:19:01.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:01.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj114 /dev/null 2024-05-08T19:19:01.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:01.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj115 /dev/null 2024-05-08T19:19:02.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:02.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj116 /dev/null 2024-05-08T19:19:02.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:02.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj117 /dev/null 2024-05-08T19:19:02.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:02.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj118 /dev/null 2024-05-08T19:19:02.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:02.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj119 /dev/null 2024-05-08T19:19:03.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:03.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj120 /dev/null 2024-05-08T19:19:03.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:03.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj121 /dev/null 2024-05-08T19:19:03.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:03.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj122 /dev/null 2024-05-08T19:19:03.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:03.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj123 /dev/null 2024-05-08T19:19:04.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:04.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj124 /dev/null 2024-05-08T19:19:04.452 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj125 /dev/null 2024-05-08T19:19:04.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:04.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj126 /dev/null 2024-05-08T19:19:05.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:05.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj127 /dev/null 2024-05-08T19:19:05.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:05.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj128 /dev/null 2024-05-08T19:19:05.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:05.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj129 /dev/null 2024-05-08T19:19:05.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:05.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj130 /dev/null 2024-05-08T19:19:06.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:06.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj131 /dev/null 2024-05-08T19:19:06.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:06.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj132 /dev/null 2024-05-08T19:19:06.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:06.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj133 /dev/null 2024-05-08T19:19:06.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:06.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj134 /dev/null 2024-05-08T19:19:07.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:07.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj135 /dev/null 2024-05-08T19:19:07.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:07.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj136 /dev/null 2024-05-08T19:19:07.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:07.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj137 /dev/null 2024-05-08T19:19:08.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:08.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj138 /dev/null 2024-05-08T19:19:08.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:08.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj139 /dev/null 2024-05-08T19:19:08.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:08.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj140 /dev/null 2024-05-08T19:19:08.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:08.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj141 /dev/null 2024-05-08T19:19:08.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:08.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj142 /dev/null 2024-05-08T19:19:09.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:09.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj143 /dev/null 2024-05-08T19:19:09.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:09.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj144 /dev/null 2024-05-08T19:19:09.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:09.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj145 /dev/null 2024-05-08T19:19:10.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:10.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj146 /dev/null 2024-05-08T19:19:10.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:10.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj147 /dev/null 2024-05-08T19:19:10.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:10.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj148 /dev/null 2024-05-08T19:19:10.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:10.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj149 /dev/null 2024-05-08T19:19:11.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:11.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj150 /dev/null 2024-05-08T19:19:11.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:11.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj151 /dev/null 2024-05-08T19:19:11.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:11.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj152 /dev/null 2024-05-08T19:19:12.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:12.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj153 /dev/null 2024-05-08T19:19:12.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:12.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj154 /dev/null 2024-05-08T19:19:12.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:12.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj155 /dev/null 2024-05-08T19:19:12.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:12.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj156 /dev/null 2024-05-08T19:19:13.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:13.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj157 /dev/null 2024-05-08T19:19:13.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:13.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj158 /dev/null 2024-05-08T19:19:13.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:13.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj159 /dev/null 2024-05-08T19:19:13.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:13.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj160 /dev/null 2024-05-08T19:19:14.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:14.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj161 /dev/null 2024-05-08T19:19:14.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:14.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj162 /dev/null 2024-05-08T19:19:14.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:14.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj163 /dev/null 2024-05-08T19:19:14.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:14.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj164 /dev/null 2024-05-08T19:19:15.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:15.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj165 /dev/null 2024-05-08T19:19:15.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:15.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj166 /dev/null 2024-05-08T19:19:15.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:15.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj167 /dev/null 2024-05-08T19:19:16.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:16.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj168 /dev/null 2024-05-08T19:19:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj169 /dev/null 2024-05-08T19:19:16.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:16.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj170 /dev/null 2024-05-08T19:19:16.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:16.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj171 /dev/null 2024-05-08T19:19:17.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:17.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj172 /dev/null 2024-05-08T19:19:17.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:17.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj173 /dev/null 2024-05-08T19:19:17.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:17.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj174 /dev/null 2024-05-08T19:19:17.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:17.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj175 /dev/null 2024-05-08T19:19:18.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:18.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj176 /dev/null 2024-05-08T19:19:18.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:18.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj177 /dev/null 2024-05-08T19:19:19.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:19.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj178 /dev/null 2024-05-08T19:19:19.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:19.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj179 /dev/null 2024-05-08T19:19:19.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:19.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj180 /dev/null 2024-05-08T19:19:20.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:20.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj181 /dev/null 2024-05-08T19:19:20.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:20.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj182 /dev/null 2024-05-08T19:19:20.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:20.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj183 /dev/null 2024-05-08T19:19:20.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:20.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj184 /dev/null 2024-05-08T19:19:21.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:21.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj185 /dev/null 2024-05-08T19:19:21.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:21.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj186 /dev/null 2024-05-08T19:19:21.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:21.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj187 /dev/null 2024-05-08T19:19:21.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:21.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj188 /dev/null 2024-05-08T19:19:22.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:22.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj189 /dev/null 2024-05-08T19:19:22.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:22.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj190 /dev/null 2024-05-08T19:19:22.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:22.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj191 /dev/null 2024-05-08T19:19:23.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:23.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj192 /dev/null 2024-05-08T19:19:23.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:23.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj193 /dev/null 2024-05-08T19:19:23.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:23.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj194 /dev/null 2024-05-08T19:19:23.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:23.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj195 /dev/null 2024-05-08T19:19:24.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:24.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj196 /dev/null 2024-05-08T19:19:24.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:24.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj197 /dev/null 2024-05-08T19:19:24.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:24.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj198 /dev/null 2024-05-08T19:19:24.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:24.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj199 /dev/null 2024-05-08T19:19:25.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-05-08T19:19:25.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj200 /dev/null 2024-05-08T19:19:25.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:641: TEST_backfill_ec_down_all_out: get_pg test obj1 2024-05-08T19:19:25.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:19:25.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:19:25.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:19:25.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:19:25.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:641: TEST_backfill_ec_down_all_out: local PG=1.0 2024-05-08T19:19:25.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:643: TEST_backfill_ec_down_all_out: get_primary test obj1 2024-05-08T19:19:25.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:19:25.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:19:25.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:19:25.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:19:26.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:643: TEST_backfill_ec_down_all_out: local primary=1 2024-05-08T19:19:26.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:644: TEST_backfill_ec_down_all_out: get_not_primary test obj1 2024-05-08T19:19:26.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T19:19:26.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T19:19:26.258 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T19:19:26.258 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:19:26.258 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:19:26.258 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:19:26.258 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:19:26.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T19:19:26.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T19:19:26.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T19:19:27.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:644: TEST_backfill_ec_down_all_out: local otherosd=0 2024-05-08T19:19:27.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:645: TEST_backfill_ec_down_all_out: get_osds test obj1 2024-05-08T19:19:27.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=test 2024-05-08T19:19:27.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj1 2024-05-08T19:19:27.225 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2024-05-08T19:19:27.226 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map test obj1 2024-05-08T19:19:27.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=1 2024-05-08T19:19:27.652 INFO:tasks.workunit.client.0.smithi117.stderr:0 2024-05-08T19:19:27.652 INFO:tasks.workunit.client.0.smithi117.stderr:2' 2024-05-08T19:19:27.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 1 0 2 2024-05-08T19:19:27.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:645: TEST_backfill_ec_down_all_out: local 'allosds=1 0 2' 2024-05-08T19:19:27.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:647: TEST_backfill_ec_down_all_out: ceph osd set nobackfill 2024-05-08T19:19:28.502 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:19:28.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:648: TEST_backfill_ec_down_all_out: cat td/osd-backfill-stats/osd.0.pid 2024-05-08T19:19:28.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:648: TEST_backfill_ec_down_all_out: kill 509809 2024-05-08T19:19:28.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:649: TEST_backfill_ec_down_all_out: ceph osd down osd.0 2024-05-08T19:19:29.168 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already down. 2024-05-08T19:19:29.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2024-05-08T19:19:29.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.1 2024-05-08T19:19:30.545 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T19:19:30.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2024-05-08T19:19:30.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.0 2024-05-08T19:19:31.767 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T19:19:31.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2024-05-08T19:19:31.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.2 2024-05-08T19:19:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:osd.2 is already out. 2024-05-08T19:19:33.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:655: TEST_backfill_ec_down_all_out: sleep 2 2024-05-08T19:19:35.132 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:656: TEST_backfill_ec_down_all_out: get_primary test obj1 2024-05-08T19:19:35.132 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:19:35.132 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:19:35.132 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:19:35.132 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:19:35.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:656: TEST_backfill_ec_down_all_out: primary=1 2024-05-08T19:19:35.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:657: TEST_backfill_ec_down_all_out: ceph osd unset nobackfill 2024-05-08T19:19:36.480 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:19:36.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:658: TEST_backfill_ec_down_all_out: ceph tell osd.1 get_latest_osdmap 2024-05-08T19:19:36.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:659: TEST_backfill_ec_down_all_out: ceph tell osd.1 debug kick_recovery_wq 0 2024-05-08T19:19:36.935 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T19:19:36.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:660: TEST_backfill_ec_down_all_out: sleep 2 2024-05-08T19:19:38.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:661: TEST_backfill_ec_down_all_out: flush_pg_stats 2024-05-08T19:19:38.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:19:38.954 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:19:39.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:19:39.629 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:19:39.629 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:19:39.629 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:19:39.629 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:19:39.629 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:19:39.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:19:39.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:19:39.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:19:39.760 INFO:tasks.workunit.client.0.smithi117.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-05-08T19:19:39.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq= 2024-05-08T19:19:39.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z '' 2024-05-08T19:19:39.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: continue 2024-05-08T19:19:39.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:19:39.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:19:40.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673022 2024-05-08T19:19:40.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673022 2024-05-08T19:19:40.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673022' 2024-05-08T19:19:40.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:19:40.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:19:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509498 2024-05-08T19:19:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509498 2024-05-08T19:19:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673022 2-64424509498' 2024-05-08T19:19:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:19:40.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:19:40.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345967 2024-05-08T19:19:40.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345967 2024-05-08T19:19:40.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673022 2-64424509498 3-85899345967' 2024-05-08T19:19:40.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:19:40.350 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:19:40.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182439 2024-05-08T19:19:40.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182439 2024-05-08T19:19:40.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673022 2-64424509498 3-85899345967 4-107374182439' 2024-05-08T19:19:40.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:19:40.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:19:40.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018904 2024-05-08T19:19:40.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018904 2024-05-08T19:19:40.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673022 2-64424509498 3-85899345967 4-107374182439 5-128849018904' 2024-05-08T19:19:40.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:19:40.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673022 2024-05-08T19:19:40.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:19:40.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:19:40.653 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:19:40.653 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673022 2024-05-08T19:19:40.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673022 2024-05-08T19:19:40.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673022' 2024-05-08T19:19:40.655 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673022 2024-05-08T19:19:40.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:19:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673020 -lt 42949673022 2024-05-08T19:19:41.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:19:42.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:19:42.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:19:42.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673022 -lt 42949673022 2024-05-08T19:19:42.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:19:42.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:19:42.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509498 2024-05-08T19:19:42.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:19:42.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509498 2024-05-08T19:19:42.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:19:42.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509498 2024-05-08T19:19:42.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509498' 2024-05-08T19:19:42.580 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509498 2024-05-08T19:19:42.580 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:19:43.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509499 -lt 64424509498 2024-05-08T19:19:43.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:19:43.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345967 2024-05-08T19:19:43.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:19:43.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:19:43.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345967 2024-05-08T19:19:43.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:19:43.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345967 2024-05-08T19:19:43.446 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345967 2024-05-08T19:19:43.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345967' 2024-05-08T19:19:43.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:19:44.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345968 -lt 85899345967 2024-05-08T19:19:44.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:19:44.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182439 2024-05-08T19:19:44.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:19:44.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:19:44.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182439 2024-05-08T19:19:44.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:19:44.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182439 2024-05-08T19:19:44.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182439' 2024-05-08T19:19:44.232 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182439 2024-05-08T19:19:44.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:19:44.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182439 -lt 107374182439 2024-05-08T19:19:44.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:19:44.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018904 2024-05-08T19:19:44.842 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:19:44.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:19:44.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018904 2024-05-08T19:19:44.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:19:44.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018904 2024-05-08T19:19:44.845 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018904 2024-05-08T19:19:44.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018904' 2024-05-08T19:19:44.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:19:45.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018904 -lt 128849018904 2024-05-08T19:19:45.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:666: TEST_backfill_ec_down_all_out: true 2024-05-08T19:19:45.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:670: TEST_backfill_ec_down_all_out: jq '.pg_stats | [.[] | .state | select(. == "incomplete")] | length' 2024-05-08T19:19:45.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:669: TEST_backfill_ec_down_all_out: ceph --format json pg dump pgs 2024-05-08T19:19:45.966 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:45.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:669: TEST_backfill_ec_down_all_out: test 0 -ne 0 2024-05-08T19:19:45.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:674: TEST_backfill_ec_down_all_out: break 2024-05-08T19:19:45.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:676: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:46.378 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T19:19:46.379 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 200 0 182 364 0 0 0 0 100 100 100 active+undersized+degraded+remapped+backfilling 2024-05-08T19:19:34.505521+0000 38'200 50:328 [4,3,5] 4 [1,NONE,2] 1 0'0 2024-05-08T19:18:21.240500+0000 0'0 2024-05-08T19:18:21.240500+0000 0 0 no scrub is scheduled 0 0 2024-05-08T19:19:46.379 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T19:19:46.379 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T19:19:46.379 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:46.394 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: seq 1 240 2024-05-08T19:19:46.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:46.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:46.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:46.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:46.780 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:46.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 1 = 240 ']' 2024-05-08T19:19:46.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:47.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:47.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:47.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:47.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:48.188 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:48.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 2 = 240 ']' 2024-05-08T19:19:48.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:49.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:49.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:49.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:49.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:49.610 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:49.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 3 = 240 ']' 2024-05-08T19:19:49.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:50.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:50.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:50.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:50.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:51.021 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:51.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 4 = 240 ']' 2024-05-08T19:19:51.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:52.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:52.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:52.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:52.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:52.444 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:52.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 5 = 240 ']' 2024-05-08T19:19:52.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:53.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:53.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:53.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:53.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:53.842 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:53.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 6 = 240 ']' 2024-05-08T19:19:53.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:54.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:54.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:54.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:54.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:55.351 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:55.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 7 = 240 ']' 2024-05-08T19:19:55.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:56.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:56.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:56.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:56.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:56.777 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:56.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 8 = 240 ']' 2024-05-08T19:19:56.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:57.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:57.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:57.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:57.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:58.210 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:58.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 9 = 240 ']' 2024-05-08T19:19:58.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:19:59.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:19:59.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:19:59.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:19:59.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:19:59.639 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:19:59.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 10 = 240 ']' 2024-05-08T19:19:59.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:00.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:00.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:00.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:00.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:01.065 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:01.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 11 = 240 ']' 2024-05-08T19:20:01.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:02.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:02.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:02.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:02.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:02.492 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:02.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 12 = 240 ']' 2024-05-08T19:20:02.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:03.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:03.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:03.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:03.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:03.916 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:03.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 13 = 240 ']' 2024-05-08T19:20:03.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:04.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:04.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:04.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:04.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:05.341 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:05.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 14 = 240 ']' 2024-05-08T19:20:05.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:06.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:06.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:06.945 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:06.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 15 = 240 ']' 2024-05-08T19:20:06.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:07.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:07.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:07.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:08.359 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:08.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 16 = 240 ']' 2024-05-08T19:20:08.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:09.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:09.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:09.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:09.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:09.783 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:09.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 17 = 240 ']' 2024-05-08T19:20:09.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:10.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:10.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:10.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:10.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:11.184 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:11.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 18 = 240 ']' 2024-05-08T19:20:11.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:12.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:12.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:12.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:12.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:12.599 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:12.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 19 = 240 ']' 2024-05-08T19:20:12.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:13.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:13.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:13.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:13.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:14.008 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:14.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 20 = 240 ']' 2024-05-08T19:20:14.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:15.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:15.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:15.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:15.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:15.418 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:15.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 21 = 240 ']' 2024-05-08T19:20:15.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:16.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:16.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:16.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:16.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:16.829 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:16.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 22 = 240 ']' 2024-05-08T19:20:16.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:17.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:17.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:17.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:17.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:18.245 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:18.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 23 = 240 ']' 2024-05-08T19:20:18.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:19.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:19.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:19.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:19.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:19.666 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:19.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 24 = 240 ']' 2024-05-08T19:20:19.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:20.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:20.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:20.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:20.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:21.077 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:21.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 25 = 240 ']' 2024-05-08T19:20:21.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:22.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:22.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:22.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:22.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:22.483 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:22.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 26 = 240 ']' 2024-05-08T19:20:22.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:23.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:23.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:23.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:23.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:23.959 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:23.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 27 = 240 ']' 2024-05-08T19:20:23.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:24.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:24.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:24.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:24.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:25.362 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:25.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 28 = 240 ']' 2024-05-08T19:20:25.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:26.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:26.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:26.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:26.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:26.774 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:26.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 29 = 240 ']' 2024-05-08T19:20:26.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:27.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:27.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:27.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:27.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:28.195 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:28.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 30 = 240 ']' 2024-05-08T19:20:28.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:29.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:29.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:29.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:29.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:29.611 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:29.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 31 = 240 ']' 2024-05-08T19:20:29.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:30.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:30.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:30.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:30.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:31.021 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:31.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 32 = 240 ']' 2024-05-08T19:20:31.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:32.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:32.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:32.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:32.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:32.433 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:32.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 33 = 240 ']' 2024-05-08T19:20:32.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:33.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:33.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:33.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:33.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:33.890 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:33.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 34 = 240 ']' 2024-05-08T19:20:33.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:34.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:34.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:34.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:34.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:35.341 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:35.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 35 = 240 ']' 2024-05-08T19:20:35.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:36.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:36.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:36.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:36.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:36.856 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:36.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 36 = 240 ']' 2024-05-08T19:20:36.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:37.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:37.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:37.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:37.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:38.262 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 37 = 240 ']' 2024-05-08T19:20:38.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-05-08T19:20:39.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-05-08T19:20:39.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:39.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-05-08T19:20:39.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-05-08T19:20:39.695 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:39.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:681: TEST_backfill_ec_down_all_out: break 2024-05-08T19:20:39.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:691: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-05-08T19:20:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-05-08T19:20:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:1.0 200 0 0 0 0 0 0 0 10 190 10 active+clean 2024-05-08T19:20:37.052947+0000 38'200 52:1065 [4,3,5] 4 [4,3,5] 4 0'0 2024-05-08T19:18:21.240500+0000 0'0 2024-05-08T19:18:21.240500+0000 0 0 periodic scrub scheduled @ 2024-05-09T20:16:19.067383+0000 0 0 2024-05-08T19:20:40.078 INFO:tasks.workunit.client.0.smithi117.stdout: 2024-05-08T19:20:40.078 INFO:tasks.workunit.client.0.smithi117.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-05-08T19:20:40.078 INFO:tasks.workunit.client.0.smithi117.stderr:dumped pgs 2024-05-08T19:20:40.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:693: TEST_backfill_ec_down_all_out: expr 200 '*' 2 2024-05-08T19:20:40.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:693: TEST_backfill_ec_down_all_out: local misplaced=400 2024-05-08T19:20:40.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:694: TEST_backfill_ec_down_all_out: check td/osd-backfill-stats 1.0 1 erasure 200 0 400 0 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=erasure 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=200 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=400 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:20:40.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:20:40.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:20:40.106 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-05-08T19:20:40.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:20:40.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:20:40.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:20:40.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2024-05-08T19:20:40.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:89: check: addp=p 2024-05-08T19:20:40.134 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:20:40.135 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.135 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:20:40.135 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:20:40.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[4,3,5]/[1,NONE,2]' 2024-05-08T19:20:40.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[4,3,5]/[1,NONE,2]' ']' 2024-05-08T19:20:40.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:20:40.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:20:40.164 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.164 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [4,3,5]/[1,NONE,2]p' 2024-05-08T19:20:40.164 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:20:40.164 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:20:40.164 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:20:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=200 2024-05-08T19:20:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2024-05-08T19:20:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 200 200 2024-05-08T19:20:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-05-08T19:20:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:20:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-05-08T19:20:40.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:20:40.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:20:40.174 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.174 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:20:40.174 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=1 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 1 0 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [4,3,5]/[1,NONE,2]p' 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:20:40.193 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:20:40.194 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:20:40.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=400 2024-05-08T19:20:40.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2024-05-08T19:20:40.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 400 400 2024-05-08T19:20:40.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-05-08T19:20:40.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:20:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-05-08T19:20:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:20:40.203 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:20:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:20:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:20:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:20:40.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=2 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 2 ']' 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 2 0 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:696: TEST_backfill_ec_down_all_out: delete_pool test 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:20:40.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:20:40.952 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:20:40.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:697: TEST_backfill_ec_down_all_out: kill_daemons td/osd-backfill-stats 2024-05-08T19:20:40.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:20:40.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:20:40.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:20:40.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:20:40.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:20:42.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:20:42.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:20:42.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:20:42.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:20:42.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:20:42.289 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:20:42.289 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:20:42.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:20:42.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:20:42.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:20:42.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:20:42.300 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:20:42.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:20:42.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:20:42.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:20:42.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:20:42.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:20:42.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:20:42.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:20:42.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:20:42.304 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:20:42.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:20:42.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:20:42.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:20:42.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:20:42.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:20:42.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:20:42.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:20:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:20:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:20:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:20:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:20:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:20:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:20:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:20:42.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:20:42.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:20:42.360 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:20:42.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:20:42.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:20:42.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:20:42.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:20:42.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:20:42.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:20:42.362 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:20:42.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:20:42.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:20:42.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:20:42.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:20:42.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:20:42.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:20:42.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:20:42.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:20:42.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:20:42.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:20:42.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:20:42.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:20:42.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:20:42.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:20:42.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:20:42.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_ec_down_out td/osd-backfill-stats 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:708: TEST_backfill_ec_down_out: local dir=td/osd-backfill-stats 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:710: TEST_backfill_ec_down_out: run_mon td/osd-backfill-stats a 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:20:42.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:20:42.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:20:42.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:20:42.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:20:42.783 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:20:42.784 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:20:42.784 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:20:42.784 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:20:42.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:20:42.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:20:42.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:20:42.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:20:42.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:20:42.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:20:42.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:20:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:20:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:20:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:20:42.995 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:20:42.995 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:20:42.995 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:20:42.995 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:20:42.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:20:42.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:20:43.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:20:43.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:20:43.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:20:43.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:20:43.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:20:43.112 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:20:43.112 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:20:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:20:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:20:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:20:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:20:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:20:43.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:20:43.113 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:20:43.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:711: TEST_backfill_ec_down_out: run_mgr td/osd-backfill-stats x 2024-05-08T19:20:43.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:20:43.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:20:43.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:20:43.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:20:43.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:20:43.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:20:44.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:20:44.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:20:44.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:20:44.142 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:20:44.142 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:20:44.142 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:20:44.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:20:44.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:20:44.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:712: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 0 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:20:44.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:20:44.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:20:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:20:44.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:20:44.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ab67f67c-fa58-4269-bae7-206212bde100 2024-05-08T19:20:44.192 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 ab67f67c-fa58-4269-bae7-206212bde100 2024-05-08T19:20:44.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 ab67f67c-fa58-4269-bae7-206212bde100' 2024-05-08T19:20:44.192 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:20:44.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCM0DtmNY6oDBAAGF6OtjJRUp5PtP2JFje3Pw== 2024-05-08T19:20:44.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCM0DtmNY6oDBAAGF6OtjJRUp5PtP2JFje3Pw=="}' 2024-05-08T19:20:44.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ab67f67c-fa58-4269-bae7-206212bde100 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:20:44.523 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:20:44.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:20:44.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCM0DtmNY6oDBAAGF6OtjJRUp5PtP2JFje3Pw== --osd-uuid ab67f67c-fa58-4269-bae7-206212bde100 2024-05-08T19:20:44.580 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:44.585+0000 7f8f32a8e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:20:44.600 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:44.605+0000 7f8f32a8e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:20:44.602 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:44.609+0000 7f8f32a8e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:20:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:44.609+0000 7f8f32a8e7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:20:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:44.609+0000 7f8f32a8e7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:20:44.603 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:44.609+0000 7f8f32a8e7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:20:44.640 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:44.645+0000 7f8f32a8e7c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:20:50.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:20:50.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:20:50.997 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:20:50.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:20:50.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:20:51.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:20:51.530 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:20:51.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:20:51.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:20:51.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:20:51.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:20:51.562 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:51.568+0000 7f5af53f47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:20:51.597 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:51.604+0000 7f5af53f47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:20:51.599 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:51.604+0000 7f5af53f47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:20:52.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:20:52.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:20:52.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:20:52.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:20:52.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:20:52.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:20:52.016 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:20:52.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:20:52.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:20:52.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:20:52.182 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:52.188+0000 7f5af53f47c0 -1 Falling back to public interface 2024-05-08T19:20:52.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:20:53.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:20:53.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:20:53.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:20:53.466 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:20:53.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:20:53.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:20:53.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:20:54.726 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:20:54.732+0000 7f5af53f47c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:20:54.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:20:54.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:20:54.900 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:20:54.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:20:54.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:20:54.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:20:55.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:20:56.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:20:56.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:20:56.433 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:20:56.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:20:56.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:20:56.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:20:56.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:20:57.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:20:57.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:20:57.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:20:57.859 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:20:57.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:20:57.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:20:58.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:20:59.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:20:59.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:20:59.279 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:20:59.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:20:59.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:20:59.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:20:59.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:00.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:00.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:00.890 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:21:00.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:21:00.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:00.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:01.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:02.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:02.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:02.308 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:21:02.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:21:02.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:02.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:02.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:03.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:03.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:03.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:21:03.885 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:21:03.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:03.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:04.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:05.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:05.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:05.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:21:05.340 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:21:05.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:05.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:05.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:06.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:06.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:06.903 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:21:06.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:21:06.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:06.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:07.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:08.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:08.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:08.358 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:21:08.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:21:08.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:08.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:09.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:10.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:10.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:10.821 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:21:10.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:21:10.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:10.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:11.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:12.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:12.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:12.980 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:21:12.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:21:12.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:12.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:14.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:15.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:15.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:15.093 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:21:15.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:21:15.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:15.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:16.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:17.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:17.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:17.352 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:21:17.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:21:17.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:17.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:18.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:19.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:19.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:19.179 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:21:19.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:21:19.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:19.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:21:19.756 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3364581491,v1:127.0.0.1:6803/3364581491] [v2:127.0.0.1:6804/3364581491,v1:127.0.0.1:6805/3364581491] exists,up ab67f67c-fa58-4269-bae7-206212bde100 2024-05-08T19:21:19.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:21:19.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:713: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 1 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:21:19.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:21:19.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:21:19.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:21:19.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:21:19.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:21:19.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:21:19.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:21:19.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:21:19.761 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:21:19.762 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:21:19.762 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:21:19.762 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:21:19.762 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:21:19.762 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:21:19.762 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:21:19.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:21:19.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:21:19.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:21:19.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:21:19.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:21:19.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:21:19.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:21:19.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:21:19.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:21:19.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:21:19.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:21:19.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:21:19.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:21:19.764 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:21:19.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=33fc5fc4-03ae-442a-807c-f360448fbd17 2024-05-08T19:21:19.765 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 33fc5fc4-03ae-442a-807c-f360448fbd17 2024-05-08T19:21:19.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 33fc5fc4-03ae-442a-807c-f360448fbd17' 2024-05-08T19:21:19.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:21:19.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCv0DtmZWg4LxAA0ZBnisPe35Mp9JOkOB2tHw== 2024-05-08T19:21:19.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCv0DtmZWg4LxAA0ZBnisPe35Mp9JOkOB2tHw=="}' 2024-05-08T19:21:19.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 33fc5fc4-03ae-442a-807c-f360448fbd17 -i td/osd-backfill-stats/1/new.json 2024-05-08T19:21:20.335 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:21:20.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:21:20.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCv0DtmZWg4LxAA0ZBnisPe35Mp9JOkOB2tHw== --osd-uuid 33fc5fc4-03ae-442a-807c-f360448fbd17 2024-05-08T19:21:20.388 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:20.392+0000 7fd876f817c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:20.416 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:20.420+0000 7fd876f817c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:20.418 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:20.424+0000 7fd876f817c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:20.418 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:20.424+0000 7fd876f817c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:21:20.418 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:20.424+0000 7fd876f817c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:21:20.418 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:20.424+0000 7fd876f817c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:21:20.456 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:20.460+0000 7fd876f817c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:21:27.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:21:27.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:21:27.203 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:21:27.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:21:27.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:21:27.773 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:21:27.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:21:27.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:21:27.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:21:27.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:21:27.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:21:27.807 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:27.812+0000 7f040db2e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:27.809 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:27.816+0000 7f040db2e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:27.810 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:27.816+0000 7f040db2e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:28.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:21:28.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:21:28.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:21:28.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:21:28.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:21:28.240 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:21:28.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:28.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:21:28.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:28.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:28.370 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:28.376+0000 7f040db2e7c0 -1 Falling back to public interface 2024-05-08T19:21:28.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:29.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:29.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:29.800 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:21:29.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:21:29.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:29.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:30.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:31.021 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:31.028+0000 7f040db2e7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:21:31.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:31.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:31.092 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:21:31.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:21:31.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:31.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:31.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:32.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:32.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:32.812 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:21:32.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:21:32.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:32.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:33.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:34.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:34.630 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:21:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:21:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:34.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:35.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:36.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:36.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:36.353 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:21:36.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:21:36.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:36.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:36.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:37.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:37.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:37.998 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:21:37.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:21:37.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:37.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:38.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:39.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:39.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:39.453 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:21:39.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:21:39.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:39.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:40.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:41.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:41.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:41.013 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:21:41.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:21:41.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:41.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:41.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:42.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:42.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:42.553 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:21:42.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:21:42.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:42.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:43.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:44.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:44.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:44.156 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:21:44.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:21:44.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:44.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:44.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:45.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:45.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:45.584 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:21:45.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:21:45.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:45.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:46.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:47.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:47.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:47.889 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:21:47.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:21:47.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:47.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:48.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:49.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:49.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:49.756 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:21:49.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:21:49.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:49.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:50.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:51.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:51.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:51.624 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:21:51.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:21:51.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:51.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:52.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:53.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:53.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:53.537 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:21:53.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:21:53.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:53.537 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:54.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:55.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:55.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:55.126 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:21:55.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:21:55.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:55.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:56.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:21:57.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:21:57.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:21:57.235 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:21:57.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:21:57.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:21:57.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:21:57.697 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3508063483,v1:127.0.0.1:6811/3508063483] [v2:127.0.0.1:6812/3508063483,v1:127.0.0.1:6813/3508063483] exists,up 33fc5fc4-03ae-442a-807c-f360448fbd17 2024-05-08T19:21:57.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:21:57.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:21:57.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:21:57.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:714: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 2 2024-05-08T19:21:57.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:21:57.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:21:57.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:21:57.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:21:57.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:21:57.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:21:57.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:21:57.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:21:57.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:21:57.707 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:21:57.707 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:21:57.707 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:21:57.708 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:21:57.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:21:57.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:21:57.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:21:57.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:21:57.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:21:57.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:21:57.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:21:57.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:21:57.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:21:57.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:21:57.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:21:57.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:21:57.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:21:57.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:21:57.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=36fc53ef-52c0-4e22-b75c-dc07420d38db 2024-05-08T19:21:57.711 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 36fc53ef-52c0-4e22-b75c-dc07420d38db 2024-05-08T19:21:57.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 36fc53ef-52c0-4e22-b75c-dc07420d38db' 2024-05-08T19:21:57.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:21:57.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDV0DtmaHecKxAA9JCUXqgJ02O8o2UjOjhD7g== 2024-05-08T19:21:57.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDV0DtmaHecKxAA9JCUXqgJ02O8o2UjOjhD7g=="}' 2024-05-08T19:21:57.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 36fc53ef-52c0-4e22-b75c-dc07420d38db -i td/osd-backfill-stats/2/new.json 2024-05-08T19:21:58.239 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:21:58.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:21:58.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDV0DtmaHecKxAA9JCUXqgJ02O8o2UjOjhD7g== --osd-uuid 36fc53ef-52c0-4e22-b75c-dc07420d38db 2024-05-08T19:21:58.291 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:58.295+0000 7f852ffed7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:58.310 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:58.315+0000 7f852ffed7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:58.311 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:58.315+0000 7f852ffed7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:21:58.312 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:58.315+0000 7f852ffed7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:21:58.312 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:58.315+0000 7f852ffed7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:21:58.312 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:58.315+0000 7f852ffed7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:21:58.349 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:21:58.355+0000 7f852ffed7c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:22:05.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:22:05.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:22:05.075 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:22:05.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:22:05.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:22:05.640 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:22:05.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:22:05.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:22:05.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:22:05.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:22:05.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:22:05.674 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:05.679+0000 7f633743f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:05.676 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:05.679+0000 7f633743f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:05.677 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:05.683+0000 7f633743f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:06.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:22:06.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:22:06.036 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:22:06.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:22:06.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:22:06.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:22:06.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:06.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:22:06.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:06.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:06.238 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:06.243+0000 7f633743f7c0 -1 Falling back to public interface 2024-05-08T19:22:06.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:07.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:07.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:07.442 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:22:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:22:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:07.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:07.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:08.680 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:08.683+0000 7f633743f7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:22:08.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:08.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:08.849 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:22:08.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:22:08.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:08.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:09.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:10.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:10.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:10.498 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:22:10.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:22:10.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:10.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:11.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:12.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:12.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:12.050 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:22:12.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:22:12.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:12.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:12.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:13.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:13.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:13.647 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:22:13.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:22:13.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:13.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:14.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:15.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:15.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:15.208 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:22:15.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:22:15.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:15.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:15.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:16.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:22:16.790 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:22:16.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:16.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:17.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:18.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:18.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:18.214 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:22:18.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:22:18.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:18.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:18.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:19.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:19.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:19.714 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:22:19.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:22:19.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:19.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:20.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:21.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:21.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:21.145 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:22:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:22:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:21.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:21.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:22.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:22.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:22.693 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:22:22.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:22:22.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:22.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:23.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:24.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:24.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:24.366 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:22:24.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:22:24.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:24.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:25.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:26.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:26.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:26.155 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:22:26.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:22:26.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:26.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:27.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:28.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:28.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:28.023 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:22:28.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:22:28.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:28.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:28.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:29.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:29.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:29.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:22:29.894 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:22:29.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:29.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:30.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:31.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:31.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:31.717 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:22:31.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:22:31.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:31.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:32.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:33.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:33.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:33.369 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:22:33.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:22:33.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:33.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:34.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:35.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:35.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:35.186 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:22:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:22:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:35.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:22:35.618 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2591542478,v1:127.0.0.1:6819/2591542478] [v2:127.0.0.1:6820/2591542478,v1:127.0.0.1:6821/2591542478] exists,up 36fc53ef-52c0-4e22-b75c-dc07420d38db 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:715: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 3 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:22:35.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:22:35.622 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:22:35.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:22:35.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:22:35.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:22:35.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:22:35.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=bbb0ae79-857c-4b9f-9972-f75f4e45340a 2024-05-08T19:22:35.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 bbb0ae79-857c-4b9f-9972-f75f4e45340a' 2024-05-08T19:22:35.625 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 bbb0ae79-857c-4b9f-9972-f75f4e45340a 2024-05-08T19:22:35.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:22:35.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD70DtmgXkTJxAAU56lJWsxzeFwFkcPLQQGrA== 2024-05-08T19:22:35.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD70DtmgXkTJxAAU56lJWsxzeFwFkcPLQQGrA=="}' 2024-05-08T19:22:35.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new bbb0ae79-857c-4b9f-9972-f75f4e45340a -i td/osd-backfill-stats/3/new.json 2024-05-08T19:22:36.187 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:22:36.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:22:36.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD70DtmgXkTJxAAU56lJWsxzeFwFkcPLQQGrA== --osd-uuid bbb0ae79-857c-4b9f-9972-f75f4e45340a 2024-05-08T19:22:36.242 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:36.246+0000 7fb36f5467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:36.253 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:36.258+0000 7fb36f5467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:36.254 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:36.258+0000 7fb36f5467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:36.255 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:36.258+0000 7fb36f5467c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:22:36.255 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:36.258+0000 7fb36f5467c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:22:36.255 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:36.258+0000 7fb36f5467c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:22:36.293 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:36.298+0000 7fb36f5467c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:22:43.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:22:43.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:22:43.219 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:22:43.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:22:43.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:22:43.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:22:43.773 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:22:43.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:22:43.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:22:43.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:22:43.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:22:43.806 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:43.810+0000 7fc8050037c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:43.825 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:43.830+0000 7fc8050037c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:43.826 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:43.830+0000 7fc8050037c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:22:44.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:22:44.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:22:44.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:22:44.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:22:44.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:22:44.176 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:22:44.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:44.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:22:44.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:44.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:44.391 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:44.394+0000 7fc8050037c0 -1 Falling back to public interface 2024-05-08T19:22:44.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:45.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:45.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:45.593 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:22:45.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:22:45.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:45.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:46.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:47.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:47.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:47.023 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:22:47.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:22:47.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:47.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:47.076 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:22:47.078+0000 7fc8050037c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:22:47.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:48.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:48.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:48.473 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:22:48.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:22:48.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:48.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:49.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:50.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:50.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:50.174 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:22:50.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:22:50.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:50.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:50.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:51.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:51.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:51.633 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:22:51.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:22:51.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:51.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:52.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:53.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:53.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:53.166 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:22:53.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:22:53.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:53.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:53.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:54.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:54.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:54.722 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:22:54.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:22:54.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:54.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:55.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:56.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:56.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:56.565 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:22:56.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:22:56.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:56.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:57.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:58.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:58.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:58.243 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:22:58.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:22:58.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:58.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:22:58.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:22:59.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:22:59.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:22:59.703 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:22:59.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:22:59.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:22:59.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:00.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:01.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:01.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:01.225 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:23:01.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:23:01.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:01.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:01.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:02.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:02.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:02.708 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:23:02.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:23:02.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:02.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:03.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:04.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:04.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:04.875 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:23:04.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:23:04.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:04.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:06.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:07.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:07.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:07.246 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:23:07.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:23:07.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:07.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:08.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:09.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:09.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:09.218 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:23:09.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:23:09.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:09.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:10.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:11.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:11.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:11.206 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:23:11.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:23:11.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:11.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:11.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:12.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:12.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:12.735 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:23:12.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:23:12.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:12.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:13.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:14.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:14.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:14.815 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:23:14.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:23:14.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:23:15.235 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1373181443,v1:127.0.0.1:6827/1373181443] [v2:127.0.0.1:6828/1373181443,v1:127.0.0.1:6829/1373181443] exists,up bbb0ae79-857c-4b9f-9972-f75f4e45340a 2024-05-08T19:23:15.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:23:15.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:23:15.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:23:15.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:716: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 4 2024-05-08T19:23:15.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:23:15.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:23:15.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:23:15.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:23:15.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:23:15.239 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:23:15.239 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:23:15.239 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:23:15.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:23:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:23:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:23:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:23:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:23:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:23:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:23:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:23:15.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:23:15.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:23:15.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:23:15.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:23:15.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:23:15.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:23:15.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:23:15.241 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 6b2635ea-3122-46ce-abcc-e180001446b2 2024-05-08T19:23:15.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6b2635ea-3122-46ce-abcc-e180001446b2 2024-05-08T19:23:15.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 6b2635ea-3122-46ce-abcc-e180001446b2' 2024-05-08T19:23:15.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:23:15.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAj0TtmIoEzEBAAVUfrGcZ0M6DVchFZBwKIpg== 2024-05-08T19:23:15.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAj0TtmIoEzEBAAVUfrGcZ0M6DVchFZBwKIpg=="}' 2024-05-08T19:23:15.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6b2635ea-3122-46ce-abcc-e180001446b2 -i td/osd-backfill-stats/4/new.json 2024-05-08T19:23:15.879 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:23:15.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:23:15.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAj0TtmIoEzEBAAVUfrGcZ0M6DVchFZBwKIpg== --osd-uuid 6b2635ea-3122-46ce-abcc-e180001446b2 2024-05-08T19:23:15.933 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:15.942+0000 7fa5411a07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:15.935 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:15.942+0000 7fa5411a07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:15.938 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:15.946+0000 7fa5411a07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:15.938 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:15.946+0000 7fa5411a07c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:23:15.938 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:15.946+0000 7fa5411a07c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:23:15.938 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:15.946+0000 7fa5411a07c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:23:16.009 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:16.018+0000 7fa5411a07c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:23:22.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:23:22.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:23:22.964 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:23:22.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:23:22.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:23:23.560 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:23:23.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:23:23.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:23:23.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:23:23.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:23:23.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:23:23.593 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:23.602+0000 7ffad15647c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:23.595 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:23.602+0000 7ffad15647c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:23.596 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:23.602+0000 7ffad15647c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:24.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:23:24.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:23:24.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:23:24.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:23:24.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:23:24.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:24.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:23:24.016 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:23:24.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:24.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:24.142 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:24.150+0000 7ffad15647c0 -1 Falling back to public interface 2024-05-08T19:23:24.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:25.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:25.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:25.434 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:23:25.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:23:25.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:25.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:25.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:26.818 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:26.821+0000 7ffad15647c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:23:26.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:26.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:26.836 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:23:26.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:23:26.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:26.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:27.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:28.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:28.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:28.414 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:23:28.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:23:28.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:28.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:28.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:29.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:29.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:29.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:23:29.858 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:23:29.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:29.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:30.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:31.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:31.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:31.299 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:23:31.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:23:31.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:31.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:31.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:32.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:32.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:32.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:23:32.938 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:23:32.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:32.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:33.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:34.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:34.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:34.364 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:23:34.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:23:34.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:34.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:34.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:35.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:35.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:35.883 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:23:35.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:23:35.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:35.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:36.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:37.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:37.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:37.372 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:23:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:23:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:37.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:38.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:38.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:38.966 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:23:38.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:23:38.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:38.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:39.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:40.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:40.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:40.557 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:23:40.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:23:40.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:40.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:41.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:42.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:42.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:42.363 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:23:42.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:23:42.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:42.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:42.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:43.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:43.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:43.851 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:23:43.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:23:43.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:43.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:44.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:45.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:45.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:45.557 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:23:45.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:23:45.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:45.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:46.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:47.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:47.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:47.608 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:23:47.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:23:47.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:47.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:48.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:49.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:49.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:49.443 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:23:49.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:23:49.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:49.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:50.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:51.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:51.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:51.307 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:23:51.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:23:51.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:51.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:52.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:23:53.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:23:53.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:23:53.160 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:23:53.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:23:53.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:23:53.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:23:53.606 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2039601569,v1:127.0.0.1:6835/2039601569] [v2:127.0.0.1:6836/2039601569,v1:127.0.0.1:6837/2039601569] exists,up 6b2635ea-3122-46ce-abcc-e180001446b2 2024-05-08T19:23:53.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:23:53.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:23:53.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:23:53.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:717: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 5 2024-05-08T19:23:53.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/5 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-05-08T19:23:53.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:23:53.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/5 2024-05-08T19:23:53.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:23:53.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=476d7799-75af-4391-a877-5dba35346228 2024-05-08T19:23:53.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 476d7799-75af-4391-a877-5dba35346228' 2024-05-08T19:23:53.613 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 476d7799-75af-4391-a877-5dba35346228 2024-05-08T19:23:53.614 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:23:53.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBJ0TtmACcmJhAAXB/94KWYNcjg2OOpi/sw2g== 2024-05-08T19:23:53.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBJ0TtmACcmJhAAXB/94KWYNcjg2OOpi/sw2g=="}' 2024-05-08T19:23:53.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 476d7799-75af-4391-a877-5dba35346228 -i td/osd-backfill-stats/5/new.json 2024-05-08T19:23:54.287 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:23:54.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/5/new.json 2024-05-08T19:23:54.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBJ0TtmACcmJhAAXB/94KWYNcjg2OOpi/sw2g== --osd-uuid 476d7799-75af-4391-a877-5dba35346228 2024-05-08T19:23:54.339 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:54.345+0000 7f1f68cde7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:54.376 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:54.381+0000 7f1f68cde7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:54.378 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:54.385+0000 7f1f68cde7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:23:54.378 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:54.385+0000 7f1f68cde7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:23:54.378 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:54.385+0000 7f1f68cde7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:23:54.379 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:54.385+0000 7f1f68cde7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:23:54.417 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:23:54.421+0000 7f1f68cde7c0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-05-08T19:24:01.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-05-08T19:24:01.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:24:01.372 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T19:24:01.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T19:24:01.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:24:01.914 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T19:24:01.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T19:24:01.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:24:01.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:24:01.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:24:01.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:24:01.942 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:24:01.949+0000 7f1def63c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:24:01.946 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:24:01.953+0000 7f1def63c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:24:01.946 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:24:01.953+0000 7f1def63c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:24:02.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T19:24:02.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:24:02.347 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:24:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T19:24:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:24:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:24:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:24:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:02.498 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:24:02.505+0000 7f1def63c7c0 -1 Falling back to public interface 2024-05-08T19:24:02.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:03.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:03.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:03.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:24:03.784 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:24:03.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:03.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:04.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:05.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:05.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:05.194 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:24:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:24:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:05.218 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:24:05.225+0000 7f1def63c7c0 -1 osd.5 0 log_to_monitors true 2024-05-08T19:24:05.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:06.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:06.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:06.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:24:06.628 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:24:06.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:06.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:07.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:08.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:08.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:08.075 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:24:08.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:24:08.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:08.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:08.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:09.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:09.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:09.585 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:24:09.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:24:09.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:09.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:10.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:11.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:11.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:11.223 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:24:11.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:24:11.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:11.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:11.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:12.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:12.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:12.767 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:24:12.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:24:12.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:12.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:13.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:14.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:14.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:14.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:24:14.329 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:24:14.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:14.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:14.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:15.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:15.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:15.709 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:24:15.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:24:15.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:15.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:16.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:17.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:17.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:17.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:24:17.199 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:24:17.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:17.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:17.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:18.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:18.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:18.670 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:24:18.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:24:18.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:18.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:20.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:20.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:20.091 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:24:20.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:24:20.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:20.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:21.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:22.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:22.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:22.003 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:24:22.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:24:22.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:22.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:22.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:23.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:23.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:23.650 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:24:23.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:24:23.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:23.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:24.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:25.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:25.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:25.534 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:24:25.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:24:25.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:25.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:26.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:27.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:27.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:27.371 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:24:27.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:24:27.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:27.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:28.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:29.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:29.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:29.239 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:24:29.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:24:29.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:29.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:30.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:31.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:31.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:31.266 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:24:31.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:24:31.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:31.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:31.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:24:32.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:24:32.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:24:32.827 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:24:32.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:24:32.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:24:32.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:24:33.251 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 29 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3290350393,v1:127.0.0.1:6843/3290350393] [v2:127.0.0.1:6844/3290350393,v1:127.0.0.1:6845/3290350393] exists,up 476d7799-75af-4391-a877-5dba35346228 2024-05-08T19:24:33.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:24:33.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:24:33.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:24:33.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:719: TEST_backfill_ec_down_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T19:24:33.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:720: TEST_backfill_ec_down_out: create_pool test 1 1 erasure myprofile 2024-05-08T19:24:33.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 erasure myprofile 2024-05-08T19:24:34.868 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:24:34.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:24:35.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:721: TEST_backfill_ec_down_out: ceph osd pool set test min_size 2 2024-05-08T19:24:36.795 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 min_size to 2 2024-05-08T19:24:36.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:723: TEST_backfill_ec_down_out: wait_for_clean 2024-05-08T19:24:36.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:24:36.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:24:36.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:24:36.816 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:24:36.817 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:24:36.817 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:24:36.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:24:36.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:24:36.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:24:36.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:24:36.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:24:36.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:24:36.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:24:36.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:24:36.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:24:37.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:24:37.425 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:24:37.425 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:24:37.425 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:24:37.425 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:24:37.425 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:24:37.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:24:37.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:24:37.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:24:37.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836526 2024-05-08T19:24:37.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836526 2024-05-08T19:24:37.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526' 2024-05-08T19:24:37.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:24:37.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:24:37.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672999 2024-05-08T19:24:37.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672999 2024-05-08T19:24:37.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672999' 2024-05-08T19:24:37.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:24:37.943 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:24:38.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=60129542177 2024-05-08T19:24:38.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 60129542177 2024-05-08T19:24:38.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672999 2-60129542177' 2024-05-08T19:24:38.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:24:38.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:24:38.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=81604378647 2024-05-08T19:24:38.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 81604378647 2024-05-08T19:24:38.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672999 2-60129542177 3-81604378647' 2024-05-08T19:24:38.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:24:38.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:24:38.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=103079215119 2024-05-08T19:24:38.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 103079215119 2024-05-08T19:24:38.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672999 2-60129542177 3-81604378647 4-103079215119' 2024-05-08T19:24:38.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:24:38.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:24:38.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=124554051593 2024-05-08T19:24:38.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 124554051593 2024-05-08T19:24:38.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836526 1-42949672999 2-60129542177 3-81604378647 4-103079215119 5-124554051593' 2024-05-08T19:24:38.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:24:38.554 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836526 2024-05-08T19:24:38.554 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:24:38.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:24:38.556 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836526 2024-05-08T19:24:38.556 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:24:38.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836526 2024-05-08T19:24:38.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836526' 2024-05-08T19:24:38.557 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836526 2024-05-08T19:24:38.557 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:24:38.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836526 -lt 21474836526 2024-05-08T19:24:38.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:24:38.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672999 2024-05-08T19:24:38.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:24:38.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:24:38.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:24:38.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672999 2024-05-08T19:24:38.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672999 2024-05-08T19:24:38.969 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672999 2024-05-08T19:24:38.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672999' 2024-05-08T19:24:38.970 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:24:39.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672999 -lt 42949672999 2024-05-08T19:24:39.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:24:39.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-60129542177 2024-05-08T19:24:39.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:24:39.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:24:39.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-60129542177 2024-05-08T19:24:39.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:24:39.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=60129542177 2024-05-08T19:24:39.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 60129542177' 2024-05-08T19:24:39.399 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 60129542177 2024-05-08T19:24:39.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:24:39.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 60129542177 -lt 60129542177 2024-05-08T19:24:39.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:24:39.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-81604378647 2024-05-08T19:24:39.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:24:39.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:24:39.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-81604378647 2024-05-08T19:24:39.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:24:39.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=81604378647 2024-05-08T19:24:39.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 81604378647' 2024-05-08T19:24:39.796 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 81604378647 2024-05-08T19:24:39.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:24:40.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 81604378647 -lt 81604378647 2024-05-08T19:24:40.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:24:40.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-103079215119 2024-05-08T19:24:40.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:24:40.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:24:40.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-103079215119 2024-05-08T19:24:40.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:24:40.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=103079215119 2024-05-08T19:24:40.262 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 103079215119 2024-05-08T19:24:40.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 103079215119' 2024-05-08T19:24:40.262 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:24:40.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 103079215120 -lt 103079215119 2024-05-08T19:24:40.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:24:40.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-124554051593 2024-05-08T19:24:40.674 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:24:40.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:24:40.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-124554051593 2024-05-08T19:24:40.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:24:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=124554051593 2024-05-08T19:24:40.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 124554051593' 2024-05-08T19:24:40.679 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 124554051593 2024-05-08T19:24:40.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:24:41.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 124554051593 -lt 124554051593 2024-05-08T19:24:41.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:24:41.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:24:41.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:24:41.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:24:41.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:24:41.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:24:41.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:24:41.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:24:41.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:24:41.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:24:41.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:24:42.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:24:42.166 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:24:42.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:24:42.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:24:42.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:24:42.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:24:42.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:24:42.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: seq 1 200 2024-05-08T19:24:42.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:42.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj1 /dev/null 2024-05-08T19:24:42.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:42.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj2 /dev/null 2024-05-08T19:24:43.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:43.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj3 /dev/null 2024-05-08T19:24:43.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:43.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj4 /dev/null 2024-05-08T19:24:43.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:43.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj5 /dev/null 2024-05-08T19:24:43.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:43.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj6 /dev/null 2024-05-08T19:24:44.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:44.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj7 /dev/null 2024-05-08T19:24:44.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:44.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj8 /dev/null 2024-05-08T19:24:44.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:44.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj9 /dev/null 2024-05-08T19:24:44.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:44.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj10 /dev/null 2024-05-08T19:24:44.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:44.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj11 /dev/null 2024-05-08T19:24:45.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:45.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj12 /dev/null 2024-05-08T19:24:45.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:45.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj13 /dev/null 2024-05-08T19:24:45.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:45.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj14 /dev/null 2024-05-08T19:24:45.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:45.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj15 /dev/null 2024-05-08T19:24:46.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:46.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj16 /dev/null 2024-05-08T19:24:46.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:46.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj17 /dev/null 2024-05-08T19:24:46.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:46.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj18 /dev/null 2024-05-08T19:24:46.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:46.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj19 /dev/null 2024-05-08T19:24:46.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:46.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj20 /dev/null 2024-05-08T19:24:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:47.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj21 /dev/null 2024-05-08T19:24:47.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:47.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj22 /dev/null 2024-05-08T19:24:47.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:47.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj23 /dev/null 2024-05-08T19:24:47.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:47.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj24 /dev/null 2024-05-08T19:24:48.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:48.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj25 /dev/null 2024-05-08T19:24:48.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:48.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj26 /dev/null 2024-05-08T19:24:48.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:48.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj27 /dev/null 2024-05-08T19:24:48.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:48.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj28 /dev/null 2024-05-08T19:24:49.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:49.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj29 /dev/null 2024-05-08T19:24:49.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:49.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj30 /dev/null 2024-05-08T19:24:49.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:49.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj31 /dev/null 2024-05-08T19:24:49.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:49.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj32 /dev/null 2024-05-08T19:24:49.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:49.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj33 /dev/null 2024-05-08T19:24:50.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:50.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj34 /dev/null 2024-05-08T19:24:50.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:50.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj35 /dev/null 2024-05-08T19:24:50.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:50.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj36 /dev/null 2024-05-08T19:24:50.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:50.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj37 /dev/null 2024-05-08T19:24:51.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:51.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj38 /dev/null 2024-05-08T19:24:51.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:51.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj39 /dev/null 2024-05-08T19:24:51.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:51.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj40 /dev/null 2024-05-08T19:24:51.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:51.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj41 /dev/null 2024-05-08T19:24:51.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:51.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj42 /dev/null 2024-05-08T19:24:52.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:52.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj43 /dev/null 2024-05-08T19:24:52.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:52.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj44 /dev/null 2024-05-08T19:24:52.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:52.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj45 /dev/null 2024-05-08T19:24:52.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:52.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj46 /dev/null 2024-05-08T19:24:53.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:53.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj47 /dev/null 2024-05-08T19:24:53.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:53.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj48 /dev/null 2024-05-08T19:24:53.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:53.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj49 /dev/null 2024-05-08T19:24:53.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:53.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj50 /dev/null 2024-05-08T19:24:54.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:54.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj51 /dev/null 2024-05-08T19:24:54.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:54.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj52 /dev/null 2024-05-08T19:24:54.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:54.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj53 /dev/null 2024-05-08T19:24:54.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:54.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj54 /dev/null 2024-05-08T19:24:54.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:54.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj55 /dev/null 2024-05-08T19:24:55.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:55.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj56 /dev/null 2024-05-08T19:24:55.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:55.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj57 /dev/null 2024-05-08T19:24:55.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:55.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj58 /dev/null 2024-05-08T19:24:55.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:55.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj59 /dev/null 2024-05-08T19:24:56.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:56.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj60 /dev/null 2024-05-08T19:24:56.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:56.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj61 /dev/null 2024-05-08T19:24:56.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:56.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj62 /dev/null 2024-05-08T19:24:56.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:56.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj63 /dev/null 2024-05-08T19:24:56.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:56.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj64 /dev/null 2024-05-08T19:24:57.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:57.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj65 /dev/null 2024-05-08T19:24:57.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:57.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj66 /dev/null 2024-05-08T19:24:57.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:57.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj67 /dev/null 2024-05-08T19:24:57.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:57.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj68 /dev/null 2024-05-08T19:24:58.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:58.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj69 /dev/null 2024-05-08T19:24:58.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:58.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj70 /dev/null 2024-05-08T19:24:58.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:58.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj71 /dev/null 2024-05-08T19:24:58.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:58.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj72 /dev/null 2024-05-08T19:24:58.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:58.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj73 /dev/null 2024-05-08T19:24:59.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:59.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj74 /dev/null 2024-05-08T19:24:59.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:59.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj75 /dev/null 2024-05-08T19:24:59.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:59.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj76 /dev/null 2024-05-08T19:24:59.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:24:59.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj77 /dev/null 2024-05-08T19:25:00.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:00.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj78 /dev/null 2024-05-08T19:25:00.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:00.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj79 /dev/null 2024-05-08T19:25:00.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:00.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj80 /dev/null 2024-05-08T19:25:00.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:00.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj81 /dev/null 2024-05-08T19:25:01.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:01.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj82 /dev/null 2024-05-08T19:25:01.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:01.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj83 /dev/null 2024-05-08T19:25:01.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:01.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj84 /dev/null 2024-05-08T19:25:01.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:01.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj85 /dev/null 2024-05-08T19:25:01.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:01.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj86 /dev/null 2024-05-08T19:25:02.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:02.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj87 /dev/null 2024-05-08T19:25:02.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:02.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj88 /dev/null 2024-05-08T19:25:02.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:02.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj89 /dev/null 2024-05-08T19:25:02.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:02.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj90 /dev/null 2024-05-08T19:25:03.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:03.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj91 /dev/null 2024-05-08T19:25:03.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:03.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj92 /dev/null 2024-05-08T19:25:03.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:03.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj93 /dev/null 2024-05-08T19:25:03.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:03.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj94 /dev/null 2024-05-08T19:25:04.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:04.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj95 /dev/null 2024-05-08T19:25:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:04.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj96 /dev/null 2024-05-08T19:25:04.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:04.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj97 /dev/null 2024-05-08T19:25:04.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:04.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj98 /dev/null 2024-05-08T19:25:04.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:04.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj99 /dev/null 2024-05-08T19:25:05.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:05.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj100 /dev/null 2024-05-08T19:25:05.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:05.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj101 /dev/null 2024-05-08T19:25:05.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:05.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj102 /dev/null 2024-05-08T19:25:05.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:05.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj103 /dev/null 2024-05-08T19:25:05.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:05.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj104 /dev/null 2024-05-08T19:25:06.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:06.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj105 /dev/null 2024-05-08T19:25:06.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:06.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj106 /dev/null 2024-05-08T19:25:06.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:06.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj107 /dev/null 2024-05-08T19:25:06.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:06.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj108 /dev/null 2024-05-08T19:25:07.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:07.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj109 /dev/null 2024-05-08T19:25:07.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:07.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj110 /dev/null 2024-05-08T19:25:07.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:07.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj111 /dev/null 2024-05-08T19:25:07.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:07.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj112 /dev/null 2024-05-08T19:25:08.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:08.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj113 /dev/null 2024-05-08T19:25:08.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:08.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj114 /dev/null 2024-05-08T19:25:08.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:08.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj115 /dev/null 2024-05-08T19:25:09.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:09.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj116 /dev/null 2024-05-08T19:25:09.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:09.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj117 /dev/null 2024-05-08T19:25:09.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:09.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj118 /dev/null 2024-05-08T19:25:09.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:09.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj119 /dev/null 2024-05-08T19:25:10.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:10.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj120 /dev/null 2024-05-08T19:25:10.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:10.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj121 /dev/null 2024-05-08T19:25:10.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:10.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj122 /dev/null 2024-05-08T19:25:10.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:10.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj123 /dev/null 2024-05-08T19:25:10.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:10.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj124 /dev/null 2024-05-08T19:25:11.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:11.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj125 /dev/null 2024-05-08T19:25:11.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:11.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj126 /dev/null 2024-05-08T19:25:11.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:11.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj127 /dev/null 2024-05-08T19:25:11.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:11.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj128 /dev/null 2024-05-08T19:25:11.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:11.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj129 /dev/null 2024-05-08T19:25:12.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:12.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj130 /dev/null 2024-05-08T19:25:12.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:12.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj131 /dev/null 2024-05-08T19:25:12.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:12.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj132 /dev/null 2024-05-08T19:25:12.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:12.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj133 /dev/null 2024-05-08T19:25:13.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:13.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj134 /dev/null 2024-05-08T19:25:13.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:13.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj135 /dev/null 2024-05-08T19:25:13.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:13.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj136 /dev/null 2024-05-08T19:25:13.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:13.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj137 /dev/null 2024-05-08T19:25:14.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:14.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj138 /dev/null 2024-05-08T19:25:14.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:14.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj139 /dev/null 2024-05-08T19:25:14.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:14.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj140 /dev/null 2024-05-08T19:25:14.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:14.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj141 /dev/null 2024-05-08T19:25:14.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:14.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj142 /dev/null 2024-05-08T19:25:15.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:15.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj143 /dev/null 2024-05-08T19:25:15.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:15.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj144 /dev/null 2024-05-08T19:25:15.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:15.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj145 /dev/null 2024-05-08T19:25:15.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:15.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj146 /dev/null 2024-05-08T19:25:15.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:15.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj147 /dev/null 2024-05-08T19:25:16.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:16.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj148 /dev/null 2024-05-08T19:25:16.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:16.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj149 /dev/null 2024-05-08T19:25:16.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:16.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj150 /dev/null 2024-05-08T19:25:16.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:16.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj151 /dev/null 2024-05-08T19:25:17.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:17.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj152 /dev/null 2024-05-08T19:25:17.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:17.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj153 /dev/null 2024-05-08T19:25:17.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:17.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj154 /dev/null 2024-05-08T19:25:17.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:17.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj155 /dev/null 2024-05-08T19:25:17.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:17.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj156 /dev/null 2024-05-08T19:25:18.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:18.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj157 /dev/null 2024-05-08T19:25:18.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:18.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj158 /dev/null 2024-05-08T19:25:18.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:18.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj159 /dev/null 2024-05-08T19:25:18.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:18.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj160 /dev/null 2024-05-08T19:25:19.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:19.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj161 /dev/null 2024-05-08T19:25:19.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:19.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj162 /dev/null 2024-05-08T19:25:19.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:19.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj163 /dev/null 2024-05-08T19:25:19.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:19.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj164 /dev/null 2024-05-08T19:25:20.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:20.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj165 /dev/null 2024-05-08T19:25:20.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:20.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj166 /dev/null 2024-05-08T19:25:20.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:20.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj167 /dev/null 2024-05-08T19:25:20.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:20.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj168 /dev/null 2024-05-08T19:25:20.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:20.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj169 /dev/null 2024-05-08T19:25:21.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:21.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj170 /dev/null 2024-05-08T19:25:21.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:21.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj171 /dev/null 2024-05-08T19:25:21.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:21.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj172 /dev/null 2024-05-08T19:25:21.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:21.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj173 /dev/null 2024-05-08T19:25:22.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:22.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj174 /dev/null 2024-05-08T19:25:22.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:22.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj175 /dev/null 2024-05-08T19:25:22.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:22.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj176 /dev/null 2024-05-08T19:25:22.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:22.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj177 /dev/null 2024-05-08T19:25:22.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj178 /dev/null 2024-05-08T19:25:23.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:23.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj179 /dev/null 2024-05-08T19:25:23.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:23.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj180 /dev/null 2024-05-08T19:25:23.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:23.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj181 /dev/null 2024-05-08T19:25:23.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:23.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj182 /dev/null 2024-05-08T19:25:23.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:23.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj183 /dev/null 2024-05-08T19:25:24.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:24.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj184 /dev/null 2024-05-08T19:25:24.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:24.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj185 /dev/null 2024-05-08T19:25:24.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:24.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj186 /dev/null 2024-05-08T19:25:24.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:24.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj187 /dev/null 2024-05-08T19:25:25.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:25.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj188 /dev/null 2024-05-08T19:25:25.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:25.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj189 /dev/null 2024-05-08T19:25:25.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:25.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj190 /dev/null 2024-05-08T19:25:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj191 /dev/null 2024-05-08T19:25:26.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:26.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj192 /dev/null 2024-05-08T19:25:26.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:26.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj193 /dev/null 2024-05-08T19:25:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:26.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj194 /dev/null 2024-05-08T19:25:26.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:26.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj195 /dev/null 2024-05-08T19:25:26.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:26.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj196 /dev/null 2024-05-08T19:25:27.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:27.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj197 /dev/null 2024-05-08T19:25:27.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:27.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj198 /dev/null 2024-05-08T19:25:27.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:27.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj199 /dev/null 2024-05-08T19:25:27.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-05-08T19:25:27.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj200 /dev/null 2024-05-08T19:25:28.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:730: TEST_backfill_ec_down_out: get_pg test obj1 2024-05-08T19:25:28.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:25:28.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:25:28.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:25:28.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:25:28.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:730: TEST_backfill_ec_down_out: local PG=1.0 2024-05-08T19:25:28.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:732: TEST_backfill_ec_down_out: get_primary test obj1 2024-05-08T19:25:28.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:25:28.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:25:28.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:25:28.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:25:28.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:732: TEST_backfill_ec_down_out: local primary=1 2024-05-08T19:25:28.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:733: TEST_backfill_ec_down_out: get_not_primary test obj1 2024-05-08T19:25:28.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T19:25:28.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T19:25:28.934 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T19:25:28.934 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:25:28.934 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:25:28.934 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:25:28.934 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:25:29.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T19:25:29.394 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T19:25:29.394 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T19:25:29.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:733: TEST_backfill_ec_down_out: local otherosd=0 2024-05-08T19:25:29.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:735: TEST_backfill_ec_down_out: ceph osd set nobackfill 2024-05-08T19:25:30.570 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:25:30.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:736: TEST_backfill_ec_down_out: cat td/osd-backfill-stats/osd.0.pid 2024-05-08T19:25:30.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:736: TEST_backfill_ec_down_out: kill 527617 2024-05-08T19:25:30.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:737: TEST_backfill_ec_down_out: ceph osd down osd.0 2024-05-08T19:25:31.178 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already down. 2024-05-08T19:25:31.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:738: TEST_backfill_ec_down_out: ceph osd out osd.0 2024-05-08T19:25:32.051 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T19:25:32.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:740: TEST_backfill_ec_down_out: sleep 2 2024-05-08T19:25:34.072 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:741: TEST_backfill_ec_down_out: get_primary test obj1 2024-05-08T19:25:34.072 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:25:34.072 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:25:34.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:25:34.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:25:34.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:741: TEST_backfill_ec_down_out: primary=1 2024-05-08T19:25:34.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:742: TEST_backfill_ec_down_out: ceph osd unset nobackfill 2024-05-08T19:25:35.457 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:25:35.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:743: TEST_backfill_ec_down_out: ceph tell osd.1 get_latest_osdmap 2024-05-08T19:25:35.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:744: TEST_backfill_ec_down_out: ceph tell osd.1 debug kick_recovery_wq 0 2024-05-08T19:25:35.947 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T19:25:35.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:745: TEST_backfill_ec_down_out: sleep 2 2024-05-08T19:25:37.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:747: TEST_backfill_ec_down_out: wait_for_clean 2024-05-08T19:25:37.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:25:37.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:25:37.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:25:37.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:25:37.963 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:25:37.963 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:25:37.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:25:37.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:25:37.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:25:38.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:25:38.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:25:38.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:25:38.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:25:38.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:25:38.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:25:38.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:25:38.521 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:25:38.521 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:25:38.521 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:25:38.521 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:25:38.521 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:25:38.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:25:38.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:25:38.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:25:38.695 INFO:tasks.workunit.client.0.smithi117.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-05-08T19:25:38.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq= 2024-05-08T19:25:38.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z '' 2024-05-08T19:25:38.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: continue 2024-05-08T19:25:38.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:25:38.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:25:38.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673013 2024-05-08T19:25:38.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673013 2024-05-08T19:25:38.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673013' 2024-05-08T19:25:38.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:25:38.860 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:25:39.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=60129542191 2024-05-08T19:25:39.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 60129542191 2024-05-08T19:25:39.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673013 2-60129542191' 2024-05-08T19:25:39.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:25:39.043 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:25:39.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=81604378661 2024-05-08T19:25:39.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 81604378661 2024-05-08T19:25:39.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673013 2-60129542191 3-81604378661' 2024-05-08T19:25:39.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:25:39.191 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:25:39.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=103079215134 2024-05-08T19:25:39.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 103079215134 2024-05-08T19:25:39.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673013 2-60129542191 3-81604378661 4-103079215134' 2024-05-08T19:25:39.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:25:39.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:25:39.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=124554051607 2024-05-08T19:25:39.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 124554051607 2024-05-08T19:25:39.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 1-42949673013 2-60129542191 3-81604378661 4-103079215134 5-124554051607' 2024-05-08T19:25:39.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:25:39.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673013 2024-05-08T19:25:39.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:25:39.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:25:39.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673013 2024-05-08T19:25:39.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:25:39.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673013 2024-05-08T19:25:39.532 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673013 2024-05-08T19:25:39.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673013' 2024-05-08T19:25:39.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:25:39.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673011 -lt 42949673013 2024-05-08T19:25:39.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:25:40.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:25:40.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:25:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673013 -lt 42949673013 2024-05-08T19:25:41.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:25:41.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-60129542191 2024-05-08T19:25:41.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:25:41.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:25:41.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:25:41.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-60129542191 2024-05-08T19:25:41.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=60129542191 2024-05-08T19:25:41.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 60129542191' 2024-05-08T19:25:41.371 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 60129542191 2024-05-08T19:25:41.372 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:25:41.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 60129542191 -lt 60129542191 2024-05-08T19:25:41.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:25:41.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-81604378661 2024-05-08T19:25:41.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:25:41.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:25:41.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-81604378661 2024-05-08T19:25:41.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:25:41.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=81604378661 2024-05-08T19:25:41.831 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 81604378661 2024-05-08T19:25:41.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 81604378661' 2024-05-08T19:25:41.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:25:42.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 81604378662 -lt 81604378661 2024-05-08T19:25:42.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:25:42.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-103079215134 2024-05-08T19:25:42.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:25:42.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:25:42.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-103079215134 2024-05-08T19:25:42.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:25:42.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=103079215134 2024-05-08T19:25:42.362 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 103079215134 2024-05-08T19:25:42.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 103079215134' 2024-05-08T19:25:42.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:25:42.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 103079215134 -lt 103079215134 2024-05-08T19:25:42.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:25:42.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-124554051607 2024-05-08T19:25:42.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:25:42.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:25:42.895 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:25:42.895 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-124554051607 2024-05-08T19:25:42.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=124554051607 2024-05-08T19:25:42.897 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 124554051607 2024-05-08T19:25:42.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 124554051607' 2024-05-08T19:25:42.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:25:43.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 124554051607 -lt 124554051607 2024-05-08T19:25:43.411 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:25:43.411 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:43.411 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:44.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:25:44.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:44.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:44.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:44.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:44.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:44.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:44.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:44.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:44.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:44.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:44.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:45.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:45.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:25:45.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:25:45.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:25:45.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:45.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:45.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:45.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:45.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:45.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:45.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:45.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:45.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:45.168 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:45.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:45.584 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:45.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:45.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:46.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:46.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:25:46.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:25:46.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:25:46.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:25:46.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:25:46.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:25:46.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:25:46.104 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:25:46.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:25:46.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:25:46.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:25:46.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:46.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:46.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:46.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:46.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:46.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:46.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:46.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:46.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:46.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:47.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:47.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:47.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:47.377 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:47.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:47.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:25:47.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:25:47.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:25:47.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:25:47.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:25:47.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:25:47.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:25:47.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:25:48.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:25:48.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:25:48.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:25:48.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:48.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:48.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:48.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:48.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:48.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:48.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:48.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:49.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:49.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:49.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:49.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:49.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:49.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:25:49.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:25:49.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:25:49.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:25:49.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:25:49.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:25:49.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:25:49.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:25:50.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=7 2024-05-08T19:25:50.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 7 '!=' null 2024-05-08T19:25:50.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:25:50.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:50.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:50.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:50.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:50.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:50.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:50.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:50.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:50.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:50.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:50.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:50.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:50.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:50.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:51.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:51.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:25:51.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:25:51.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:25:51.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:25:51.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:25:51.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:25:51.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:25:51.403 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:25:52.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:25:52.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:25:52.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:25:52.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:52.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:52.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:52.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:52.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:52.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:52.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:52.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:52.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:52.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:52.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:52.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:52.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:52.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:25:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:25:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:25:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:25:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:25:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:25:53.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:25:53.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:25:53.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:25:53.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:25:53.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:25:53.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:53.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:53.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:53.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:53.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:53.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:53.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:53.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:53.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:53.813 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:54.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:54.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:54.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:54.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:55.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:55.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:25:55.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:25:55.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:25:55.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:25:55.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:25:55.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:25:55.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:25:55.089 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:25:55.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:25:55.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:25:55.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:25:55.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:55.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:55.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:55.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:55.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:55.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:55.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:55.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:55.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:55.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:56.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:56.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:56.244 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:56.244 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:56.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:56.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:25:56.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:25:56.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:25:56.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:25:56.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:25:56.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:25:56.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:25:56.929 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:25:57.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:25:57.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:25:57.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:25:57.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:57.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:57.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:57.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:57.549 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:57.549 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:57.549 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:57.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:57.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:57.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:57.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:57.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:57.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:25:57.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:58.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:25:58.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:25:58.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:25:58.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:25:58.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:25:58.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:25:58.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:25:58.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:25:58.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:25:59.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:25:59.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:25:59.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:25:59.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:25:59.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:25:59.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:25:59.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:25:59.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:25:59.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:25:59.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:25:59.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:25:59.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:25:59.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:25:59.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:25:59.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:25:59.798 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:25:59.799 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:26:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:26:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:26:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:26:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:26:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:26:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:26:00.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:26:00.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:26:00.355 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:26:00.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:26:00.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:26:00.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:26:00.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:26:00.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:26:00.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:26:00.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:26:00.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:26:00.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:26:00.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:26:00.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:26:00.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:26:00.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:26:01.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:26:01.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:26:01.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:26:01.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:26:02.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:26:02.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:26:02.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:26:02.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:26:02.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:26:02.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:26:02.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:26:02.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:26:02.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:26:02.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:26:02.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:26:02.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:26:02.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:26:02.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:26:02.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:26:02.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:26:02.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:26:02.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:26:02.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:26:02.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:26:02.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:26:02.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:26:03.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:26:03.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:26:03.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:26:03.294 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:26:04.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:26:04.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:26:04.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:26:04.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:26:04.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:26:04.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:26:04.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:26:04.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:26:04.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:26:04.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:26:04.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:26:04.819 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:26:04.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:26:04.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:26:05.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:26:05.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:26:05.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:26:05.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:26:05.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:26:05.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:26:05.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:26:05.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:26:05.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:26:05.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:26:05.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:26:05.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:26:05.769 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:26:06.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:26:06.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:26:06.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:26:06.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:26:06.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:26:06.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:26:06.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:26:06.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:26:06.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:26:06.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:26:06.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:26:06.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:26:06.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:26:06.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:26:06.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:26:06.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:26:06.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:26:07.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:26:07.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:26:07.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:26:07.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:26:07.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:26:07.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:26:07.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:26:07.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:26:07.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:26:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:26:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:26:07.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:26:07.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:26:07.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:26:08.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:26:08.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:26:08.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:26:08.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:26:08.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:26:08.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:26:08.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:26:08.068 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:26:08.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:26:08.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:26:08.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:26:08.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:26:08.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:26:08.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:26:08.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:26:08.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:26:08.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:26:08.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:26:08.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:26:08.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:26:08.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:26:09.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:26:09.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:26:09.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:26:09.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:26:09.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:26:09.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:26:09.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:26:09.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:26:09.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:26:09.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:26:09.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:26:09.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:26:09.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:26:10.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:26:10.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:26:10.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:26:10.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:26:10.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:26:10.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:26:10.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:26:10.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:749: TEST_backfill_ec_down_out: expr 200 '*' 2 2024-05-08T19:26:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:749: TEST_backfill_ec_down_out: local misplaced=400 2024-05-08T19:26:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:750: TEST_backfill_ec_down_out: check td/osd-backfill-stats 1.0 1 erasure 200 0 0 0 2024-05-08T19:26:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:26:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:26:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T19:26:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=erasure 2024-05-08T19:26:10.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=200 2024-05-08T19:26:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:26:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=0 2024-05-08T19:26:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-05-08T19:26:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:26:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:26:10.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:26:10.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:26:10.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-05-08T19:26:10.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:26:10.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:26:10.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:26:10.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2024-05-08T19:26:10.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:89: check: addp=p 2024-05-08T19:26:10.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:26:10.627 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.627 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:26:10.627 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[1,3,2]/[1,NONE,2]' 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[1,3,2]/[1,NONE,2]' ']' 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [1,3,2]/[1,NONE,2]p' 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:26:10.654 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:26:10.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=200 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 200 200 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:26:10.658 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:26:10.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=1 2024-05-08T19:26:10.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2024-05-08T19:26:10.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 1 0 2024-05-08T19:26:10.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-05-08T19:26:10.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:26:10.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:26:10.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:26:10.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:26:10.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:26:10.665 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.665 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [1,3,2]/[1,NONE,2]p' 2024-05-08T19:26:10.665 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:26:10.665 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:26:10.665 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:26:10.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=0 2024-05-08T19:26:10.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2024-05-08T19:26:10.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 0 0 2024-05-08T19:26:10.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-05-08T19:26:10.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:26:10.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-05-08T19:26:10.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:26:10.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:26:10.689 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:26:10.689 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:26:10.689 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:26:10.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=0 2024-05-08T19:26:10.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2024-05-08T19:26:10.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 0 0 2024-05-08T19:26:10.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-05-08T19:26:10.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:26:10.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:26:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:26:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:26:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:752: TEST_backfill_ec_down_out: delete_pool test 2024-05-08T19:26:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:26:10.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:26:11.296 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:26:11.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:753: TEST_backfill_ec_down_out: kill_daemons td/osd-backfill-stats 2024-05-08T19:26:11.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:26:11.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:26:11.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:26:11.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:26:11.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:26:16.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:26:16.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:26:16.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:26:16.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:26:16.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:26:16.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:26:16.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:26:16.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:26:16.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:26:16.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:26:16.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:26:16.651 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:26:16.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:26:16.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:26:16.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:26:16.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:16.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:16.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:26:16.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:26:16.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:26:16.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:26:16.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:26:16.698 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:26:16.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:26:16.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:26:16.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:26:16.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:26:16.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:26:16.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:26:16.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:26:16.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:26:16.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:26:16.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:26:16.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:26:16.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:26:16.706 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:26:16.706 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:16.706 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:16.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:26:16.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:26:16.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:26:16.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:26:16.713 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:26:16.713 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_ec_prim_out td/osd-backfill-stats 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:569: TEST_backfill_ec_prim_out: local dir=td/osd-backfill-stats 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:571: TEST_backfill_ec_prim_out: run_mon td/osd-backfill-stats a 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:26:16.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:26:16.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:26:17.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:26:17.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:26:17.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:26:17.103 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:26:17.103 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:17.103 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:17.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:26:17.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:26:17.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:26:17.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:26:17.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:26:17.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:26:17.323 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:26:17.323 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:26:17.324 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:26:17.324 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:26:17.324 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:26:17.324 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:26:17.324 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:17.324 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:17.324 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:26:17.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:26:17.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:26:17.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:26:17.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:26:17.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:26:17.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:26:17.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:26:17.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:572: TEST_backfill_ec_prim_out: run_mgr td/osd-backfill-stats x 2024-05-08T19:26:17.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:26:17.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:26:17.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:26:17.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:26:17.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:26:17.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:26:18.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:26:18.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:26:18.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:26:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:26:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:18.471 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:18.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:26:18.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:26:18.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:26:18.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:573: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 0 2024-05-08T19:26:18.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:26:18.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:26:18.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:26:18.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:26:18.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:26:18.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:26:18.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:26:18.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:26:18.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:26:18.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:26:18.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:26:18.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:26:18.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:26:18.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:26:18.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:26:18.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:26:18.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:26:18.519 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:26:18.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:26:18.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:26:18.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:26:18.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:26:18.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:26:18.521 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:26:18.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=05f463f2-aab4-429c-84c3-8d9ed2d76541 2024-05-08T19:26:18.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 05f463f2-aab4-429c-84c3-8d9ed2d76541' 2024-05-08T19:26:18.522 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 05f463f2-aab4-429c-84c3-8d9ed2d76541 2024-05-08T19:26:18.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:26:18.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDa0TtmD4IQIBAAS87f2dewD4L3DU8PUWTZRw== 2024-05-08T19:26:18.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDa0TtmD4IQIBAAS87f2dewD4L3DU8PUWTZRw=="}' 2024-05-08T19:26:18.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 05f463f2-aab4-429c-84c3-8d9ed2d76541 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:26:18.844 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:26:18.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:26:18.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDa0TtmD4IQIBAAS87f2dewD4L3DU8PUWTZRw== --osd-uuid 05f463f2-aab4-429c-84c3-8d9ed2d76541 2024-05-08T19:26:18.892 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:18.898+0000 7fe33e4357c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:18.921 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:18.930+0000 7fe33e4357c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:18.922 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:18.930+0000 7fe33e4357c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:18.922 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:18.930+0000 7fe33e4357c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:26:18.922 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:18.930+0000 7fe33e4357c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:26:18.923 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:18.930+0000 7fe33e4357c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:26:18.960 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:18.966+0000 7fe33e4357c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:26:25.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:26:25.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:26:25.324 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:26:25.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:26:25.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:26:25.883 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:26:25.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:26:25.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:26:25.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:26:25.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:26:25.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:26:25.917 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:25.926+0000 7f498b3fc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:25.951 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:25.958+0000 7f498b3fc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:25.952 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:25.958+0000 7f498b3fc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:26.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:26:26.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:26:26.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:26:26.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:26:26.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:26:26.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:26.310 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:26:26.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:26:26.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:26.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:26.526 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:26.534+0000 7f498b3fc7c0 -1 Falling back to public interface 2024-05-08T19:26:26.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:27.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:27.759 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:26:27.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:27.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:26:27.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:27.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:28.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:29.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:29.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:29.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:26:29.178 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:26:29.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:29.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:29.197 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:29.206+0000 7f498b3fc7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:26:29.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:30.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:30.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:30.671 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:26:30.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:26:30.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:30.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:31.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:32.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:32.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:32.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:26:32.137 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:26:32.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:32.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:32.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:33.578 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:26:33.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:26:33.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:33.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:34.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:35.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:35.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:35.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:26:35.163 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:26:35.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:35.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:35.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:36.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:36.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:36.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:26:36.613 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:26:36.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:36.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:37.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:38.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:38.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:38.172 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:26:38.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:26:38.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:38.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:38.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:39.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:39.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:39.613 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:26:39.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:26:39.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:39.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:40.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:41.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:41.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:41.182 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:26:41.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:26:41.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:41.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:41.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:42.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:42.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:42.722 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:26:42.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:26:42.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:42.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:43.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:44.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:44.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:44.548 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:26:44.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:26:44.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:44.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:45.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:46.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:26:46.400 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:26:46.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:46.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:47.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:48.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:48.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:48.159 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:26:48.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:26:48.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:48.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:49.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:50.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:50.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:50.079 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:26:50.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:26:50.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:50.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:51.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:52.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:52.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:52.371 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:26:52.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:26:52.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:52.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:53.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:26:54.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:26:54.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:26:54.411 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:26:54.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:26:54.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:26:54.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:26:54.843 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4044977653,v1:127.0.0.1:6803/4044977653] [v2:127.0.0.1:6804/4044977653,v1:127.0.0.1:6805/4044977653] exists,up 05f463f2-aab4-429c-84c3-8d9ed2d76541 2024-05-08T19:26:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:26:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:26:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:26:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:574: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 1 2024-05-08T19:26:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:26:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:26:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:26:54.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:26:54.847 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:26:54.848 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:26:54.848 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:26:54.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:26:54.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:26:54.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:26:54.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:26:54.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:26:54.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:26:54.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:26:54.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=081a098d-3a09-4813-93f6-f21a414300cc 2024-05-08T19:26:54.851 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 081a098d-3a09-4813-93f6-f21a414300cc 2024-05-08T19:26:54.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 081a098d-3a09-4813-93f6-f21a414300cc' 2024-05-08T19:26:54.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:26:54.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD+0TtmjvKbNBAAcGHWTX9NTcbqwnvroMoM4w== 2024-05-08T19:26:54.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD+0TtmjvKbNBAAcGHWTX9NTcbqwnvroMoM4w=="}' 2024-05-08T19:26:54.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 081a098d-3a09-4813-93f6-f21a414300cc -i td/osd-backfill-stats/1/new.json 2024-05-08T19:26:55.503 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:26:55.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:26:55.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD+0TtmjvKbNBAAcGHWTX9NTcbqwnvroMoM4w== --osd-uuid 081a098d-3a09-4813-93f6-f21a414300cc 2024-05-08T19:26:55.560 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:55.565+0000 7fd1247c77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:55.569 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:55.577+0000 7fd1247c77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:55.570 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:55.577+0000 7fd1247c77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:26:55.570 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:55.577+0000 7fd1247c77c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:26:55.571 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:55.577+0000 7fd1247c77c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:26:55.571 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:55.577+0000 7fd1247c77c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:26:55.651 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:26:55.657+0000 7fd1247c77c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:27:02.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:27:02.490 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:27:02.491 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:27:02.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:27:02.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:27:03.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:27:03.044 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:27:03.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:27:03.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:27:03.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:27:03.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:27:03.071 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:03.077+0000 7f95c4efc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:03.074 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:03.081+0000 7f95c4efc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:03.074 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:03.081+0000 7f95c4efc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:03.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:27:03.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:27:03.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:27:03.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:27:03.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:27:03.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:03.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:27:03.489 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:27:03.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:03.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:03.634 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:03.641+0000 7f95c4efc7c0 -1 Falling back to public interface 2024-05-08T19:27:03.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:04.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:04.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:04.926 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:27:04.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:27:04.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:04.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:05.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:06.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:06.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:06.348 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:27:06.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:27:06.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:06.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:06.379 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:06.385+0000 7f95c4efc7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:27:06.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:07.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:07.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:07.932 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:27:07.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:27:07.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:07.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:08.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:09.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:09.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:09.422 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:27:09.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:27:09.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:09.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:09.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:10.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:10.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:10.900 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:27:10.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:27:10.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:10.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:11.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:12.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:12.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:12.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:27:12.454 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:27:12.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:12.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:12.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:13.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:13.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:13.921 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:27:13.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:27:13.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:13.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:14.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:15.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:15.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:15.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:27:15.413 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:27:15.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:15.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:15.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:16.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:16.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:16.927 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:27:16.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:27:16.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:16.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:17.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:18.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:18.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:18.577 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:27:18.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:27:18.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:18.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:19.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:20.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:20.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:20.038 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:27:20.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:27:20.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:20.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:20.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:21.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:21.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:21.548 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:27:21.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:27:21.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:21.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:22.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:23.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:23.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:23.600 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:27:23.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:27:23.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:23.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:24.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:25.316 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:27:25.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:27:25.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:25.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:26.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:27.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:27.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:27.487 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:27:27.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:27:27.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:27.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:28.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:29.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:29.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:29.209 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:27:29.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:27:29.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:29.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:30.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:31.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:31.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:31.255 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:27:31.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:27:31.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:31.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:32.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:33.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:33.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:33.162 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:27:33.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:27:33.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:33.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:27:33.572 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/54408400,v1:127.0.0.1:6811/54408400] [v2:127.0.0.1:6812/54408400,v1:127.0.0.1:6813/54408400] exists,up 081a098d-3a09-4813-93f6-f21a414300cc 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:575: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 2 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:27:33.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:27:33.576 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:27:33.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:27:33.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:27:33.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:27:33.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f6f8bdab-78a4-4d70-aa1e-fc8f2632aa47 2024-05-08T19:27:33.578 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 f6f8bdab-78a4-4d70-aa1e-fc8f2632aa47 2024-05-08T19:27:33.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 f6f8bdab-78a4-4d70-aa1e-fc8f2632aa47' 2024-05-08T19:27:33.579 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:27:33.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAl0jtmMCoNJBAA8s88fFWb5X5zwrH59rlGxQ== 2024-05-08T19:27:33.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAl0jtmMCoNJBAA8s88fFWb5X5zwrH59rlGxQ=="}' 2024-05-08T19:27:33.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f6f8bdab-78a4-4d70-aa1e-fc8f2632aa47 -i td/osd-backfill-stats/2/new.json 2024-05-08T19:27:34.127 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:27:34.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:27:34.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAl0jtmMCoNJBAA8s88fFWb5X5zwrH59rlGxQ== --osd-uuid f6f8bdab-78a4-4d70-aa1e-fc8f2632aa47 2024-05-08T19:27:34.179 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:34.185+0000 7f61328347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:34.203 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:34.209+0000 7f61328347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:34.204 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:34.209+0000 7f61328347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:34.204 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:34.213+0000 7f61328347c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:27:34.204 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:34.213+0000 7f61328347c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:27:34.204 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:34.213+0000 7f61328347c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:27:34.242 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:34.249+0000 7f61328347c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:27:41.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:27:41.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:27:41.211 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:27:41.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:27:41.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:27:41.817 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:27:41.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:27:41.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:27:41.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:27:41.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:27:41.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:27:41.847 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:41.853+0000 7fa7301ab7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:41.869 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:41.877+0000 7fa7301ab7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:41.870 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:41.877+0000 7fa7301ab7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:27:42.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:27:42.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:27:42.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:27:42.230 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:27:42.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:27:42.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:27:42.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:42.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:27:42.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:42.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:42.421+0000 7fa7301ab7c0 -1 Falling back to public interface 2024-05-08T19:27:42.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:43.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:43.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:43.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:27:43.689 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:27:43.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:43.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:44.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:45.064 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:27:45.073+0000 7fa7301ab7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:27:45.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:45.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:45.095 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:27:45.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:27:45.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:45.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:45.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:46.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:46.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:46.590 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:27:46.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:27:46.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:46.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:47.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:48.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:48.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:48.171 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:27:48.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:27:48.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:48.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:48.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:49.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:49.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:49.647 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:27:49.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:27:49.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:49.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:50.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:51.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:51.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:51.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:27:51.240 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:27:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:51.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:51.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:52.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:52.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:52.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:27:52.646 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:27:52.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:52.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:53.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:54.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:54.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:54.150 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:27:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:27:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:54.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:54.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:55.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:55.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:55.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:27:55.619 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:27:55.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:55.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:56.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:57.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:57.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:57.256 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:27:57.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:27:57.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:57.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:57.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:27:58.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:27:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:27:58.692 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:27:58.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:27:58.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:27:58.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:27:59.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:00.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:00.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:00.293 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:28:00.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:28:00.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:00.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:28:01.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:02.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:02.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:02.239 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:28:02.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:28:02.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:02.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:28:03.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:04.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:04.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:04.110 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:28:04.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:28:04.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:04.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:28:04.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:05.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:05.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:05.897 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:28:05.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:28:05.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:05.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:28:07.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:08.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:08.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:08.169 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:28:08.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:28:08.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:08.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:28:08.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:09.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:09.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:09.942 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:28:09.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:28:09.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:09.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:28:10.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:11.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:11.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:11.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:28:11.480 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:28:11.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:11.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:28:11.988 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1756401793,v1:127.0.0.1:6819/1756401793] [v2:127.0.0.1:6820/1756401793,v1:127.0.0.1:6821/1756401793] exists,up f6f8bdab-78a4-4d70-aa1e-fc8f2632aa47 2024-05-08T19:28:11.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:576: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 3 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:28:11.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:28:11.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:28:11.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:28:11.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:28:11.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7c771d70-e78a-42fa-b86e-2ab2057f88fb 2024-05-08T19:28:11.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 7c771d70-e78a-42fa-b86e-2ab2057f88fb' 2024-05-08T19:28:11.997 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 7c771d70-e78a-42fa-b86e-2ab2057f88fb 2024-05-08T19:28:11.997 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:28:12.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBM0jtmF9+UARAA5dp2BEl46AUDUSdT+ppruQ== 2024-05-08T19:28:12.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBM0jtmF9+UARAA5dp2BEl46AUDUSdT+ppruQ=="}' 2024-05-08T19:28:12.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7c771d70-e78a-42fa-b86e-2ab2057f88fb -i td/osd-backfill-stats/3/new.json 2024-05-08T19:28:12.696 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:28:12.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:28:12.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBM0jtmF9+UARAA5dp2BEl46AUDUSdT+ppruQ== --osd-uuid 7c771d70-e78a-42fa-b86e-2ab2057f88fb 2024-05-08T19:28:12.743 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:12.748+0000 7fed7f9537c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:12.777 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:12.784+0000 7fed7f9537c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:12.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:12.784+0000 7fed7f9537c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:12.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:12.784+0000 7fed7f9537c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:28:12.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:12.784+0000 7fed7f9537c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:28:12.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:12.784+0000 7fed7f9537c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:28:12.816 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:12.824+0000 7fed7f9537c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:28:19.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:28:19.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:28:19.507 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:28:19.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:28:19.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:28:20.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:28:20.059 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:28:20.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:28:20.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:28:20.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:28:20.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:28:20.087 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:20.092+0000 7f9ecead37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:20.089 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:20.096+0000 7f9ecead37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:20.090 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:20.096+0000 7f9ecead37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:28:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:28:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:28:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:28:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:28:20.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:20.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:28:20.458 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:28:20.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:20.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:20.642 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:20.648+0000 7f9ecead37c0 -1 Falling back to public interface 2024-05-08T19:28:20.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:21.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:21.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:21.918 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:28:21.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:28:21.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:21.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:22.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:23.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:23.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:23.323 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:28:23.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:28:23.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:23.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:23.365 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:23.372+0000 7f9ecead37c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:28:23.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:24.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:24.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:24.783 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:28:24.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:28:24.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:24.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:25.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:26.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:26.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:26.443 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:28:26.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:28:26.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:26.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:26.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:27.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:27.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:27.898 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:28:27.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:28:27.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:27.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:28.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:29.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:29.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:29.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:28:29.465 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:28:29.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:29.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:30.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:31.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:31.037 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:31.037 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:28:31.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:28:31.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:31.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:31.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:32.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:32.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:32.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:28:32.668 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:28:32.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:32.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:33.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:34.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:34.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:34.111 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:28:34.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:28:34.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:34.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:34.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:35.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:35.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:35.704 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:28:35.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:28:35.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:35.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:36.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:37.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:37.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:37.139 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:28:37.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:28:37.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:37.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:37.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:38.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:38.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:38.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:28:38.961 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:28:38.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:38.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:40.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:41.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:41.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:41.039 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:28:41.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:28:41.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:41.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:42.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:43.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:43.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:43.339 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:28:43.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:28:43.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:43.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:44.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:45.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:45.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:45.623 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:28:45.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:28:45.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:45.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:46.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:47.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:47.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:47.553 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:28:47.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:28:47.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:47.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:47.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:48.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:48.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:48.972 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:28:48.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:28:48.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:48.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:50.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:28:51.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:28:51.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:28:51.036 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:28:51.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:28:51.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:28:51.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:28:51.475 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/763210301,v1:127.0.0.1:6827/763210301] [v2:127.0.0.1:6828/763210301,v1:127.0.0.1:6829/763210301] exists,up 7c771d70-e78a-42fa-b86e-2ab2057f88fb 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:577: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 4 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:28:51.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:28:51.480 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:28:51.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:28:51.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:28:51.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:28:51.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:28:51.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=79311c1f-7e01-4f34-8ade-b41220c90fff 2024-05-08T19:28:51.483 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 79311c1f-7e01-4f34-8ade-b41220c90fff 2024-05-08T19:28:51.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 79311c1f-7e01-4f34-8ade-b41220c90fff' 2024-05-08T19:28:51.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:28:51.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBz0jtmVfJhHhAAFQaCQCmnPWXvHug2RzDaSA== 2024-05-08T19:28:51.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBz0jtmVfJhHhAAFQaCQCmnPWXvHug2RzDaSA=="}' 2024-05-08T19:28:51.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 79311c1f-7e01-4f34-8ade-b41220c90fff -i td/osd-backfill-stats/4/new.json 2024-05-08T19:28:52.014 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:28:52.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:28:52.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBz0jtmVfJhHhAAFQaCQCmnPWXvHug2RzDaSA== --osd-uuid 79311c1f-7e01-4f34-8ade-b41220c90fff 2024-05-08T19:28:52.075 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:52.079+0000 7f4dad7427c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:52.101 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:52.107+0000 7f4dad7427c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:52.102 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:52.107+0000 7f4dad7427c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:52.103 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:52.107+0000 7f4dad7427c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:28:52.103 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:52.107+0000 7f4dad7427c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:28:52.103 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:52.107+0000 7f4dad7427c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:28:52.139 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:52.143+0000 7f4dad7427c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:28:59.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:28:59.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:28:59.154 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:28:59.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:28:59.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:28:59.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:28:59.718 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:28:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:28:59.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:28:59.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:28:59.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:28:59.750 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:59.755+0000 7f66e7f007c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:59.752 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:59.759+0000 7f66e7f007c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:28:59.753 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:28:59.759+0000 7f66e7f007c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:29:00.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:29:00.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:29:00.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:29:00.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:29:00.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:29:00.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:00.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:29:00.126 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:29:00.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:00.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:00.310 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:29:00.315+0000 7f66e7f007c0 -1 Falling back to public interface 2024-05-08T19:29:00.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:01.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:01.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:01.565 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:29:01.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:29:01.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:01.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:01.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:02.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:02.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:02.970 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:29:02.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:29:02.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:02.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:03.006 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:29:03.011+0000 7f66e7f007c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:29:03.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:04.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:04.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:04.401 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:29:04.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:29:04.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:04.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:04.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:05.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:05.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:05.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:29:05.857 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:29:05.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:05.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:06.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:07.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:07.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:07.436 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:29:07.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:29:07.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:07.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:07.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:08.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:08.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:08.982 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:29:08.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:29:08.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:08.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:09.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:10.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:10.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:10.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:29:10.557 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:29:10.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:10.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:11.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:12.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:12.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:12.176 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:29:12.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:29:12.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:12.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:12.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:13.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:13.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:13.667 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:29:13.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:29:13.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:13.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:14.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:15.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:15.240 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:29:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:29:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:15.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:15.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:16.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:16.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:16.672 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:29:16.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:29:16.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:16.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:17.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:18.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:18.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:18.182 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:29:18.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:29:18.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:18.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:19.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:20.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:20.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:20.010 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:29:20.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:29:20.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:20.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:21.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:22.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:22.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:22.092 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:29:22.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:29:22.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:22.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:22.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:23.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:23.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:23.966 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:29:23.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:29:23.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:23.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:24.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:25.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:25.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:25.830 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:29:25.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:29:25.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:25.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:26.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:27.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:27.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:27.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:29:27.399 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:29:27.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:27.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:28.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:29.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:29.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:29.471 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:29:29.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:29:29.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:29.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:29.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:29:30.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:29:30.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:29:30.935 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:29:30.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:29:30.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:29:30.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:29:31.406 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1622920302,v1:127.0.0.1:6835/1622920302] [v2:127.0.0.1:6836/1622920302,v1:127.0.0.1:6837/1622920302] exists,up 79311c1f-7e01-4f34-8ade-b41220c90fff 2024-05-08T19:29:31.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:29:31.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:29:31.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:29:31.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:579: TEST_backfill_ec_prim_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T19:29:32.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:580: TEST_backfill_ec_prim_out: create_pool test 1 1 erasure myprofile 2024-05-08T19:29:32.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 erasure myprofile 2024-05-08T19:29:33.094 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:29:33.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:29:34.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:582: TEST_backfill_ec_prim_out: wait_for_clean 2024-05-08T19:29:34.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:29:34.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:29:34.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:29:34.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:29:34.115 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:29:34.115 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:29:34.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:29:34.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:29:34.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:29:34.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:29:34.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:29:34.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:29:34.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:29:34.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:29:34.241 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:29:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:29:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:29:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:29:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:29:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T19:29:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:29:34.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:29:34.754 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:29:34.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836518 2024-05-08T19:29:34.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836518 2024-05-08T19:29:34.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836518' 2024-05-08T19:29:34.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:29:34.944 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:29:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672992 2024-05-08T19:29:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672992 2024-05-08T19:29:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836518 1-42949672992' 2024-05-08T19:29:35.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:29:35.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:29:35.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509461 2024-05-08T19:29:35.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509461 2024-05-08T19:29:35.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836518 1-42949672992 2-64424509461' 2024-05-08T19:29:35.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:29:35.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:29:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345940 2024-05-08T19:29:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345940 2024-05-08T19:29:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836518 1-42949672992 2-64424509461 3-85899345940' 2024-05-08T19:29:35.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:29:35.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:29:35.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182407 2024-05-08T19:29:35.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182407 2024-05-08T19:29:35.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836518 1-42949672992 2-64424509461 3-85899345940 4-107374182407' 2024-05-08T19:29:35.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:29:35.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836518 2024-05-08T19:29:35.564 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:29:35.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:29:35.565 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836518 2024-05-08T19:29:35.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:29:35.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836518 2024-05-08T19:29:35.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836518' 2024-05-08T19:29:35.567 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836518 2024-05-08T19:29:35.567 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:29:36.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836518 -lt 21474836518 2024-05-08T19:29:36.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:29:36.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672992 2024-05-08T19:29:36.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:29:36.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:29:36.009 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672992 2024-05-08T19:29:36.010 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:29:36.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672992 2024-05-08T19:29:36.011 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672992 2024-05-08T19:29:36.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672992' 2024-05-08T19:29:36.011 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:29:36.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672991 -lt 42949672992 2024-05-08T19:29:36.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:29:37.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:29:37.467 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:29:37.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672992 -lt 42949672992 2024-05-08T19:29:37.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:29:37.944 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509461 2024-05-08T19:29:37.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:29:37.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:29:37.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509461 2024-05-08T19:29:37.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:29:37.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509461 2024-05-08T19:29:37.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509461' 2024-05-08T19:29:37.949 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509461 2024-05-08T19:29:37.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:29:38.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509462 -lt 64424509461 2024-05-08T19:29:38.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:29:38.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345940 2024-05-08T19:29:38.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:29:38.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:29:38.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345940 2024-05-08T19:29:38.370 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:29:38.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345940 2024-05-08T19:29:38.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345940' 2024-05-08T19:29:38.371 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345940 2024-05-08T19:29:38.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:29:38.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345941 -lt 85899345940 2024-05-08T19:29:38.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:29:38.822 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182407 2024-05-08T19:29:38.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:29:38.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:29:38.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182407 2024-05-08T19:29:38.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:29:38.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182407 2024-05-08T19:29:38.827 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182407 2024-05-08T19:29:38.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182407' 2024-05-08T19:29:38.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:29:39.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182408 -lt 107374182407 2024-05-08T19:29:39.297 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:29:39.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:29:39.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:29:39.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:29:39.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:29:39.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:29:39.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:29:39.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:29:39.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:29:39.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:29:39.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:29:40.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:29:40.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:29:40.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:29:40.316 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:29:40.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:29:40.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:29:40.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:29:40.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: seq 1 200 2024-05-08T19:29:40.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:40.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj1 /dev/null 2024-05-08T19:29:41.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:41.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj2 /dev/null 2024-05-08T19:29:41.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:41.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj3 /dev/null 2024-05-08T19:29:41.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:41.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj4 /dev/null 2024-05-08T19:29:41.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:41.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj5 /dev/null 2024-05-08T19:29:41.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:41.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj6 /dev/null 2024-05-08T19:29:42.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:42.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj7 /dev/null 2024-05-08T19:29:42.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:42.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj8 /dev/null 2024-05-08T19:29:42.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:42.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj9 /dev/null 2024-05-08T19:29:42.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:42.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj10 /dev/null 2024-05-08T19:29:43.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:43.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj11 /dev/null 2024-05-08T19:29:43.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:43.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj12 /dev/null 2024-05-08T19:29:43.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:43.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj13 /dev/null 2024-05-08T19:29:43.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:43.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj14 /dev/null 2024-05-08T19:29:44.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:44.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj15 /dev/null 2024-05-08T19:29:44.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:44.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj16 /dev/null 2024-05-08T19:29:44.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:44.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj17 /dev/null 2024-05-08T19:29:44.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:44.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj18 /dev/null 2024-05-08T19:29:44.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:44.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj19 /dev/null 2024-05-08T19:29:45.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:45.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj20 /dev/null 2024-05-08T19:29:45.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:45.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj21 /dev/null 2024-05-08T19:29:45.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:45.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj22 /dev/null 2024-05-08T19:29:45.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:45.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj23 /dev/null 2024-05-08T19:29:46.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:46.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj24 /dev/null 2024-05-08T19:29:46.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:46.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj25 /dev/null 2024-05-08T19:29:46.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:46.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj26 /dev/null 2024-05-08T19:29:46.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:46.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj27 /dev/null 2024-05-08T19:29:46.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:46.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj28 /dev/null 2024-05-08T19:29:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:47.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj29 /dev/null 2024-05-08T19:29:47.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:47.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj30 /dev/null 2024-05-08T19:29:47.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:47.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj31 /dev/null 2024-05-08T19:29:47.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:47.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj32 /dev/null 2024-05-08T19:29:47.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:47.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj33 /dev/null 2024-05-08T19:29:48.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:48.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj34 /dev/null 2024-05-08T19:29:48.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:48.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj35 /dev/null 2024-05-08T19:29:48.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:48.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj36 /dev/null 2024-05-08T19:29:48.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:48.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj37 /dev/null 2024-05-08T19:29:49.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:49.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj38 /dev/null 2024-05-08T19:29:49.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:49.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj39 /dev/null 2024-05-08T19:29:49.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:49.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj40 /dev/null 2024-05-08T19:29:49.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:49.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj41 /dev/null 2024-05-08T19:29:49.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:49.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj42 /dev/null 2024-05-08T19:29:50.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:50.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj43 /dev/null 2024-05-08T19:29:50.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:50.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj44 /dev/null 2024-05-08T19:29:50.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:50.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj45 /dev/null 2024-05-08T19:29:50.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:50.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj46 /dev/null 2024-05-08T19:29:50.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:50.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj47 /dev/null 2024-05-08T19:29:51.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:51.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj48 /dev/null 2024-05-08T19:29:51.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:51.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj49 /dev/null 2024-05-08T19:29:51.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:51.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj50 /dev/null 2024-05-08T19:29:51.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:51.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj51 /dev/null 2024-05-08T19:29:52.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:52.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj52 /dev/null 2024-05-08T19:29:52.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:52.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj53 /dev/null 2024-05-08T19:29:52.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:52.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj54 /dev/null 2024-05-08T19:29:52.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:52.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj55 /dev/null 2024-05-08T19:29:52.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:52.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj56 /dev/null 2024-05-08T19:29:53.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:53.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj57 /dev/null 2024-05-08T19:29:53.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:53.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj58 /dev/null 2024-05-08T19:29:53.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:53.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj59 /dev/null 2024-05-08T19:29:53.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:53.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj60 /dev/null 2024-05-08T19:29:54.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:54.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj61 /dev/null 2024-05-08T19:29:54.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:54.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj62 /dev/null 2024-05-08T19:29:54.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:54.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj63 /dev/null 2024-05-08T19:29:54.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:54.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj64 /dev/null 2024-05-08T19:29:54.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:54.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj65 /dev/null 2024-05-08T19:29:55.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:55.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj66 /dev/null 2024-05-08T19:29:55.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:55.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj67 /dev/null 2024-05-08T19:29:55.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:55.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj68 /dev/null 2024-05-08T19:29:55.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:55.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj69 /dev/null 2024-05-08T19:29:56.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:56.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj70 /dev/null 2024-05-08T19:29:56.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:56.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj71 /dev/null 2024-05-08T19:29:56.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:56.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj72 /dev/null 2024-05-08T19:29:57.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:57.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj73 /dev/null 2024-05-08T19:29:57.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:57.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj74 /dev/null 2024-05-08T19:29:57.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:57.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj75 /dev/null 2024-05-08T19:29:57.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:57.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj76 /dev/null 2024-05-08T19:29:57.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:57.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj77 /dev/null 2024-05-08T19:29:58.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:58.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj78 /dev/null 2024-05-08T19:29:58.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:58.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj79 /dev/null 2024-05-08T19:29:58.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:58.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj80 /dev/null 2024-05-08T19:29:58.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:58.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj81 /dev/null 2024-05-08T19:29:59.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:59.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj82 /dev/null 2024-05-08T19:29:59.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:59.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj83 /dev/null 2024-05-08T19:29:59.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:59.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj84 /dev/null 2024-05-08T19:29:59.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:59.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj85 /dev/null 2024-05-08T19:29:59.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:29:59.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj86 /dev/null 2024-05-08T19:30:00.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:00.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj87 /dev/null 2024-05-08T19:30:00.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:00.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj88 /dev/null 2024-05-08T19:30:00.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:00.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj89 /dev/null 2024-05-08T19:30:00.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:00.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj90 /dev/null 2024-05-08T19:30:01.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:01.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj91 /dev/null 2024-05-08T19:30:01.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:01.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj92 /dev/null 2024-05-08T19:30:01.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:01.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj93 /dev/null 2024-05-08T19:30:01.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:01.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj94 /dev/null 2024-05-08T19:30:01.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:01.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj95 /dev/null 2024-05-08T19:30:02.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:02.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj96 /dev/null 2024-05-08T19:30:02.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:02.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj97 /dev/null 2024-05-08T19:30:02.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:02.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj98 /dev/null 2024-05-08T19:30:02.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:02.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj99 /dev/null 2024-05-08T19:30:03.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:03.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj100 /dev/null 2024-05-08T19:30:03.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:03.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj101 /dev/null 2024-05-08T19:30:03.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:03.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj102 /dev/null 2024-05-08T19:30:03.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:03.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj103 /dev/null 2024-05-08T19:30:03.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:03.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj104 /dev/null 2024-05-08T19:30:04.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:04.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj105 /dev/null 2024-05-08T19:30:04.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:04.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj106 /dev/null 2024-05-08T19:30:04.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:04.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj107 /dev/null 2024-05-08T19:30:04.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:04.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj108 /dev/null 2024-05-08T19:30:04.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:04.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj109 /dev/null 2024-05-08T19:30:05.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:05.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj110 /dev/null 2024-05-08T19:30:05.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:05.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj111 /dev/null 2024-05-08T19:30:05.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:05.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj112 /dev/null 2024-05-08T19:30:05.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:05.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj113 /dev/null 2024-05-08T19:30:06.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:06.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj114 /dev/null 2024-05-08T19:30:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj115 /dev/null 2024-05-08T19:30:06.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:06.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj116 /dev/null 2024-05-08T19:30:06.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:06.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj117 /dev/null 2024-05-08T19:30:06.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:06.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj118 /dev/null 2024-05-08T19:30:07.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:07.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj119 /dev/null 2024-05-08T19:30:07.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:07.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj120 /dev/null 2024-05-08T19:30:07.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:07.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj121 /dev/null 2024-05-08T19:30:07.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:07.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj122 /dev/null 2024-05-08T19:30:08.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:08.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj123 /dev/null 2024-05-08T19:30:08.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:08.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj124 /dev/null 2024-05-08T19:30:08.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:08.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj125 /dev/null 2024-05-08T19:30:08.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:08.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj126 /dev/null 2024-05-08T19:30:08.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:08.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj127 /dev/null 2024-05-08T19:30:09.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:09.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj128 /dev/null 2024-05-08T19:30:09.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:09.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj129 /dev/null 2024-05-08T19:30:09.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:09.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj130 /dev/null 2024-05-08T19:30:09.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:09.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj131 /dev/null 2024-05-08T19:30:10.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:10.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj132 /dev/null 2024-05-08T19:30:10.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:10.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj133 /dev/null 2024-05-08T19:30:10.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:10.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj134 /dev/null 2024-05-08T19:30:10.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:10.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj135 /dev/null 2024-05-08T19:30:10.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:10.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj136 /dev/null 2024-05-08T19:30:11.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:11.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj137 /dev/null 2024-05-08T19:30:11.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:11.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj138 /dev/null 2024-05-08T19:30:11.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:11.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj139 /dev/null 2024-05-08T19:30:11.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:11.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj140 /dev/null 2024-05-08T19:30:12.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:12.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj141 /dev/null 2024-05-08T19:30:12.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:12.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj142 /dev/null 2024-05-08T19:30:12.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:12.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj143 /dev/null 2024-05-08T19:30:12.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:12.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj144 /dev/null 2024-05-08T19:30:13.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:13.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj145 /dev/null 2024-05-08T19:30:13.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:13.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj146 /dev/null 2024-05-08T19:30:13.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:13.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj147 /dev/null 2024-05-08T19:30:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:13.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj148 /dev/null 2024-05-08T19:30:14.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:14.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj149 /dev/null 2024-05-08T19:30:14.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:14.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj150 /dev/null 2024-05-08T19:30:14.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:14.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj151 /dev/null 2024-05-08T19:30:14.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:14.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj152 /dev/null 2024-05-08T19:30:14.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:14.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj153 /dev/null 2024-05-08T19:30:15.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:15.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj154 /dev/null 2024-05-08T19:30:15.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:15.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj155 /dev/null 2024-05-08T19:30:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj156 /dev/null 2024-05-08T19:30:15.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:15.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj157 /dev/null 2024-05-08T19:30:15.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:15.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj158 /dev/null 2024-05-08T19:30:16.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:16.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj159 /dev/null 2024-05-08T19:30:16.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:16.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj160 /dev/null 2024-05-08T19:30:16.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:16.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj161 /dev/null 2024-05-08T19:30:16.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:16.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj162 /dev/null 2024-05-08T19:30:17.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:17.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj163 /dev/null 2024-05-08T19:30:17.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:17.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj164 /dev/null 2024-05-08T19:30:17.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:17.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj165 /dev/null 2024-05-08T19:30:17.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:17.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj166 /dev/null 2024-05-08T19:30:18.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:18.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj167 /dev/null 2024-05-08T19:30:18.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:18.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj168 /dev/null 2024-05-08T19:30:18.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:18.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj169 /dev/null 2024-05-08T19:30:18.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:18.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj170 /dev/null 2024-05-08T19:30:18.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:18.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj171 /dev/null 2024-05-08T19:30:19.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:19.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj172 /dev/null 2024-05-08T19:30:19.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:19.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj173 /dev/null 2024-05-08T19:30:19.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:19.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj174 /dev/null 2024-05-08T19:30:19.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:19.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj175 /dev/null 2024-05-08T19:30:20.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:20.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj176 /dev/null 2024-05-08T19:30:20.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:20.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj177 /dev/null 2024-05-08T19:30:20.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:20.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj178 /dev/null 2024-05-08T19:30:20.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:20.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj179 /dev/null 2024-05-08T19:30:21.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:21.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj180 /dev/null 2024-05-08T19:30:21.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:21.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj181 /dev/null 2024-05-08T19:30:21.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:21.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj182 /dev/null 2024-05-08T19:30:21.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:21.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj183 /dev/null 2024-05-08T19:30:21.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:21.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj184 /dev/null 2024-05-08T19:30:22.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:22.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj185 /dev/null 2024-05-08T19:30:22.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:22.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj186 /dev/null 2024-05-08T19:30:22.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:22.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj187 /dev/null 2024-05-08T19:30:22.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:22.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj188 /dev/null 2024-05-08T19:30:23.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:23.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj189 /dev/null 2024-05-08T19:30:23.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:23.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj190 /dev/null 2024-05-08T19:30:23.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:23.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj191 /dev/null 2024-05-08T19:30:23.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:23.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj192 /dev/null 2024-05-08T19:30:24.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:24.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj193 /dev/null 2024-05-08T19:30:24.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:24.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj194 /dev/null 2024-05-08T19:30:24.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:24.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj195 /dev/null 2024-05-08T19:30:24.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:24.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj196 /dev/null 2024-05-08T19:30:24.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:24.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj197 /dev/null 2024-05-08T19:30:25.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:25.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj198 /dev/null 2024-05-08T19:30:25.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:25.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj199 /dev/null 2024-05-08T19:30:25.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-05-08T19:30:25.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj200 /dev/null 2024-05-08T19:30:25.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:589: TEST_backfill_ec_prim_out: get_pg test obj1 2024-05-08T19:30:25.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:30:25.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:30:25.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:30:25.780 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:30:26.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:589: TEST_backfill_ec_prim_out: local PG=1.0 2024-05-08T19:30:26.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:591: TEST_backfill_ec_prim_out: get_primary test obj1 2024-05-08T19:30:26.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:30:26.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:30:26.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:30:26.210 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:30:26.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:591: TEST_backfill_ec_prim_out: local primary=1 2024-05-08T19:30:26.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:593: TEST_backfill_ec_prim_out: ceph osd set nobackfill 2024-05-08T19:30:27.746 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:30:27.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:594: TEST_backfill_ec_prim_out: ceph osd out osd.1 2024-05-08T19:30:28.374 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T19:30:28.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:596: TEST_backfill_ec_prim_out: sleep 2 2024-05-08T19:30:30.392 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:597: TEST_backfill_ec_prim_out: get_primary test obj1 2024-05-08T19:30:30.392 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:30:30.392 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:30:30.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:30:30.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:30:30.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:597: TEST_backfill_ec_prim_out: primary=1 2024-05-08T19:30:30.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:598: TEST_backfill_ec_prim_out: ceph osd unset nobackfill 2024-05-08T19:30:31.604 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:30:31.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:599: TEST_backfill_ec_prim_out: ceph tell osd.1 get_latest_osdmap 2024-05-08T19:30:31.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:600: TEST_backfill_ec_prim_out: ceph tell osd.1 debug kick_recovery_wq 0 2024-05-08T19:30:31.918 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T19:30:31.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:601: TEST_backfill_ec_prim_out: sleep 2 2024-05-08T19:30:33.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:603: TEST_backfill_ec_prim_out: wait_for_clean 2024-05-08T19:30:33.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:30:33.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:30:33.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:30:33.935 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:30:33.936 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:30:33.936 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:30:33.937 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:30:33.937 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:30:33.937 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:30:34.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:30:34.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:30:34.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:30:34.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:30:34.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:30:34.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:30:34.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:30:34.509 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:30:34.509 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:30:34.509 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:30:34.509 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T19:30:34.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:30:34.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:30:34.510 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:30:34.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836532 2024-05-08T19:30:34.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836532 2024-05-08T19:30:34.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836532' 2024-05-08T19:30:34.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:30:34.717 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:30:34.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673006 2024-05-08T19:30:34.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673006 2024-05-08T19:30:34.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836532 1-42949673006' 2024-05-08T19:30:34.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:30:34.879 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:30:35.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509475 2024-05-08T19:30:35.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509475 2024-05-08T19:30:35.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836532 1-42949673006 2-64424509475' 2024-05-08T19:30:35.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:30:35.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:30:35.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345954 2024-05-08T19:30:35.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345954 2024-05-08T19:30:35.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836532 1-42949673006 2-64424509475 3-85899345954' 2024-05-08T19:30:35.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:30:35.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:30:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182421 2024-05-08T19:30:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182421 2024-05-08T19:30:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836532 1-42949673006 2-64424509475 3-85899345954 4-107374182421' 2024-05-08T19:30:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:30:35.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836532 2024-05-08T19:30:35.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:30:35.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:30:35.397 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836532 2024-05-08T19:30:35.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:30:35.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836532 2024-05-08T19:30:35.399 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836532 2024-05-08T19:30:35.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836532' 2024-05-08T19:30:35.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:30:35.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836532 -lt 21474836532 2024-05-08T19:30:35.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:30:35.953 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673006 2024-05-08T19:30:35.953 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:30:35.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:30:35.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673006 2024-05-08T19:30:35.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:30:35.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673006 2024-05-08T19:30:35.958 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673006 2024-05-08T19:30:35.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673006' 2024-05-08T19:30:35.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:30:36.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673006 -lt 42949673006 2024-05-08T19:30:36.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:30:36.472 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509475 2024-05-08T19:30:36.473 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:30:36.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:30:36.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509475 2024-05-08T19:30:36.475 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:30:36.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509475 2024-05-08T19:30:36.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509475' 2024-05-08T19:30:36.477 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509475 2024-05-08T19:30:36.477 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:30:36.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509475 -lt 64424509475 2024-05-08T19:30:36.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:30:36.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345954 2024-05-08T19:30:36.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:30:36.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:30:36.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345954 2024-05-08T19:30:36.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:30:36.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345954 2024-05-08T19:30:36.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345954' 2024-05-08T19:30:36.951 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345954 2024-05-08T19:30:36.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:30:37.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345952 -lt 85899345954 2024-05-08T19:30:37.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:30:38.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:30:38.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:30:38.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345955 -lt 85899345954 2024-05-08T19:30:38.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:30:38.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182421 2024-05-08T19:30:38.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:30:38.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:30:38.865 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182421 2024-05-08T19:30:38.865 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:30:38.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182421 2024-05-08T19:30:38.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182421' 2024-05-08T19:30:38.867 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182421 2024-05-08T19:30:38.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:30:39.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182422 -lt 107374182421 2024-05-08T19:30:39.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:30:39.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:39.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:40.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:30:40.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:40.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:40.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:40.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:40.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:40.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:40.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:40.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:40.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:40.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:40.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:40.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:40.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:30:40.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:30:40.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:30:40.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:40.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:41.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:41.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:41.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:41.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:41.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:41.098 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:41.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:41.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:41.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:41.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:41.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:41.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:42.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:42.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:42.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:42.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:42.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:42.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:42.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:42.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:42.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:42.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:30:42.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:30:42.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:42.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:42.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:42.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:42.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:42.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:42.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:42.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:42.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:42.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:42.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:43.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:43.230 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:43.230 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:43.230 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:43.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:43.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:43.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:43.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:43.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:43.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:43.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:43.809 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:43.809 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:44.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:30:44.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:30:44.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:44.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:44.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:44.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:44.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:44.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:44.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:44.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:44.680 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:44.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:44.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:45.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:45.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:45.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:45.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:45.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:45.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:45.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:45.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:45.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:45.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:45.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:45.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:45.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:46.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:30:46.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:30:46.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:46.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:46.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:46.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:46.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:46.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:46.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:46.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:46.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:46.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:46.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:46.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:46.730 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:46.730 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:46.730 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:47.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:47.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:47.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:47.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:47.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:30:47.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:30:47.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:47.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:47.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:47.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:47.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:47.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:47.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:47.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:47.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:47.949 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:47.950 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:48.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:48.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:48.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:48.345 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:48.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:48.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:48.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:48.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:48.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:48.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:48.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:48.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:48.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:49.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=7 2024-05-08T19:30:49.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 7 '!=' null 2024-05-08T19:30:49.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:49.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:49.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:49.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:49.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:49.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:49.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:49.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:49.629 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:49.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:49.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:50.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:50.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:50.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:50.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:50.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:50.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:50.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:50.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:50.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:50.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:50.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:50.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:50.658 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:51.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:30:51.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:30:51.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:51.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:51.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:51.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:51.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:51.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:51.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:51.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:51.398 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:51.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:51.399 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:51.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:51.930 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:51.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:51.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:52.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:52.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:52.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:52.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:52.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:52.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:52.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:52.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:52.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:53.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:30:53.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:30:53.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:53.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:53.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:53.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:53.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:53.424 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:53.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:53.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:53.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:53.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:53.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:53.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:53.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:53.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:53.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:54.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:54.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:54.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:54.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:54.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:54.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:54.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:54.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:54.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:55.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=9 2024-05-08T19:30:55.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 9 '!=' null 2024-05-08T19:30:55.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:55.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:55.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:55.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:55.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:55.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:55.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:55.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:55.143 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:55.144 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:55.144 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:55.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:55.533 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:55.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:55.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:56.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:56.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:56.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:56.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:56.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:56.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:56.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:56.176 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:56.176 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:30:56.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:30:56.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:56.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:56.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:56.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:56.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:56.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:56.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:56.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:56.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:57.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:57.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:57.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:57.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:57.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:57.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:57.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:57.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:57.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:57.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:57.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:57.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:57.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:30:58.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:30:58.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:30:58.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:30:58.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:30:58.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:30:58.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:30:58.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:30:58.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:30:58.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:30:58.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:30:58.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:30:58.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:30:58.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:30:59.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:30:59.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:30:59.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:30:59.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:30:59.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:30:59.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:30:59.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:30:59.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:30:59.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:30:59.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:30:59.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:30:59.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:30:59.915 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:31:00.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=9 2024-05-08T19:31:00.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 9 '!=' null 2024-05-08T19:31:00.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:31:00.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:31:00.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:31:00.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:31:00.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:31:00.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:31:00.693 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:31:00.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:31:00.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:31:00.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:31:00.694 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:31:01.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:31:01.090 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:31:01.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:31:01.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:31:01.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:31:01.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:31:01.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:31:01.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:31:01.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:31:01.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:31:01.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:31:01.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:31:01.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:31:02.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T19:31:02.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T19:31:02.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 1 >= 13 )) 2024-05-08T19:31:02.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:31:02.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.2 2024-05-08T19:31:02.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:31:02.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:31:02.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:31:02.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:31:02.458 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:31:02.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:31:02.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:31:02.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:31:02.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:31:02.878 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:31:02.878 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:31:02.878 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:31:03.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:31:03.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:31:03.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:31:03.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:605: TEST_backfill_ec_prim_out: expr 200 '*' 3 2024-05-08T19:31:03.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:605: TEST_backfill_ec_prim_out: local misplaced=600 2024-05-08T19:31:03.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:606: TEST_backfill_ec_prim_out: check td/osd-backfill-stats 1.0 1 erasure 0 0 200 0 2024-05-08T19:31:03.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:31:03.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=erasure 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=0 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=200 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:31:03.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:31:03.424 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2024-05-08T19:31:03.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:31:03.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:31:03.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:31:03.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2024-05-08T19:31:03.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:89: check: addp=p 2024-05-08T19:31:03.440 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:31:03.440 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.440 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:31:03.440 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:31:03.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[4,0,2]/[1,0,2]' 2024-05-08T19:31:03.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[4,0,2]/[1,0,2]' ']' 2024-05-08T19:31:03.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:31:03.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:31:03.461 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.462 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:31:03.462 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [4,0,2]/[1,0,2]p' 2024-05-08T19:31:03.462 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:31:03.462 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:31:03.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=0 2024-05-08T19:31:03.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2024-05-08T19:31:03.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 0 0 2024-05-08T19:31:03.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-05-08T19:31:03.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:31:03.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-05-08T19:31:03.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:31:03.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:31:03.471 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.471 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:31:03.471 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:31:03.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=0 2024-05-08T19:31:03.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2024-05-08T19:31:03.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 0 0 2024-05-08T19:31:03.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-05-08T19:31:03.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:31:03.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:31:03.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:31:03.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:31:03.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:31:03.485 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.485 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [4,0,2]/[1,0,2]p' 2024-05-08T19:31:03.485 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:31:03.485 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:31:03.486 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:31:03.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=200 2024-05-08T19:31:03.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 200 200 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:31:03.493 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=1 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 1 0 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:608: TEST_backfill_ec_prim_out: delete_pool test 2024-05-08T19:31:03.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:31:03.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:31:04.179 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:31:04.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:609: TEST_backfill_ec_prim_out: kill_daemons td/osd-backfill-stats 2024-05-08T19:31:04.197 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:31:04.197 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:31:04.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:31:04.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:31:04.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:31:09.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:31:09.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:31:09.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:31:09.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:31:09.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:31:09.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:31:09.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:31:09.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:31:09.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:31:09.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:31:09.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:31:09.527 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:31:09.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:31:09.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:31:09.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:31:09.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:31:09.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:31:09.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:31:09.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:31:09.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:31:09.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:31:09.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:31:09.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:31:09.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:31:09.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:31:09.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:09.573 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:09.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:31:09.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:31:09.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:31:09.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:31:09.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:31:09.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:31:09.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:31:09.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:31:09.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:31:09.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:31:09.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:31:09.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:31:09.579 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:31:09.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:31:09.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:31:09.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:31:09.580 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:31:09.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:31:09.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:31:09.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:31:09.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:31:09.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:09.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:09.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:31:09.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:31:09.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:31:09.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:31:09.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:31:09.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:09.585 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:09.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:31:09.587 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:31:09.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:31:09.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:31:09.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:31:09.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_out td/osd-backfill-stats 2024-05-08T19:31:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:230: TEST_backfill_out: local dir=td/osd-backfill-stats 2024-05-08T19:31:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:232: TEST_backfill_out: run_mon td/osd-backfill-stats a 2024-05-08T19:31:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:31:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:31:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:31:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:31:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:31:09.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:31:10.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:31:10.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:31:10.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:31:10.003 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:31:10.003 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:10.003 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:10.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:31:10.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:31:10.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:10.224 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:31:10.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:31:10.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:31:10.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:31:10.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:31:10.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:31:10.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:31:10.339 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:31:10.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:31:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:233: TEST_backfill_out: run_mgr td/osd-backfill-stats x 2024-05-08T19:31:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:31:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:31:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:31:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:31:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:31:10.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:31:11.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:31:11.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:31:11.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:31:11.367 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:31:11.368 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:11.368 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:11.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:31:11.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:31:11.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:31:11.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:234: TEST_backfill_out: run_osd td/osd-backfill-stats 0 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:31:11.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:31:11.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:31:11.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:31:11.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:31:11.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:31:11.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:31:11.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:31:11.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:31:11.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:31:11.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:31:11.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:31:11.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:31:11.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:31:11.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=93b934a1-96ed-4725-b6c4-ae4a6606dea4 2024-05-08T19:31:11.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 93b934a1-96ed-4725-b6c4-ae4a6606dea4' 2024-05-08T19:31:11.409 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 93b934a1-96ed-4725-b6c4-ae4a6606dea4 2024-05-08T19:31:11.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:31:11.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD/0jtm8efRGRAAXmLXojOM8zdZomz0UlZtJw== 2024-05-08T19:31:11.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD/0jtm8efRGRAAXmLXojOM8zdZomz0UlZtJw=="}' 2024-05-08T19:31:11.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 93b934a1-96ed-4725-b6c4-ae4a6606dea4 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:31:11.775 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:31:11.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:31:11.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD/0jtm8efRGRAAXmLXojOM8zdZomz0UlZtJw== --osd-uuid 93b934a1-96ed-4725-b6c4-ae4a6606dea4 2024-05-08T19:31:11.825 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:11.833+0000 7ff73e94c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:11.853 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:11.861+0000 7ff73e94c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:11.854 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:11.861+0000 7ff73e94c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:11.855 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:11.861+0000 7ff73e94c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:31:11.855 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:11.861+0000 7ff73e94c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:31:11.855 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:11.861+0000 7ff73e94c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:31:11.892 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:11.901+0000 7ff73e94c7c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:31:18.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:31:18.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:31:18.371 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:31:18.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:31:18.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:31:18.925 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:31:18.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:31:18.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:31:18.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:31:18.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:31:18.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:31:18.958 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:18.964+0000 7f0a0f7477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:18.960 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:18.968+0000 7f0a0f7477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:18.961 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:18.968+0000 7f0a0f7477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:19.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:31:19.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:31:19.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:31:19.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:31:19.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:31:19.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:19.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:31:19.414 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:31:19.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:19.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:19.534 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:19.540+0000 7f0a0f7477c0 -1 Falling back to public interface 2024-05-08T19:31:19.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:20.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:20.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:20.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:31:20.862 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:31:20.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:21.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:22.139 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:22.144+0000 7f0a0f7477c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:31:22.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:22.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:22.281 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:31:22.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:31:22.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:22.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:22.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:23.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:23.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:23.872 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:31:23.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:31:23.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:23.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:24.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:25.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:25.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:25.305 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:31:25.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:31:25.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:25.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:25.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:26.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:26.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:26.782 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:31:26.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:31:26.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:26.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:27.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:28.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:28.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:28.317 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:31:28.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:31:28.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:28.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:28.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:29.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:29.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:29.788 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:31:29.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:31:29.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:29.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:30.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:31.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:31.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:31.310 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:31:31.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:31:31.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:31.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:31.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:32.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:32.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:32.773 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:31:32.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:31:32.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:32.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:33.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:34.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:34.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:34.345 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:31:34.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:31:34.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:34.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:34.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:35.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:35.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:35.785 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:31:35.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:31:35.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:35.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:36.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:37.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:37.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:37.749 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:31:37.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:31:37.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:37.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:38.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:39.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:39.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:39.348 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:31:39.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:31:39.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:39.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:40.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:41.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:41.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:41.157 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:31:41.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:31:41.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:41.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:42.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:43.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:43.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:43.146 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:31:43.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:31:43.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:43.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:43.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:44.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:44.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:44.964 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:31:44.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:31:44.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:44.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:46.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:47.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:47.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:47.225 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:31:47.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:31:47.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:47.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:47.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:48.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:48.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:48.648 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:31:48.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:31:48.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:48.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:31:49.048 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2343223534,v1:127.0.0.1:6803/2343223534] [v2:127.0.0.1:6804/2343223534,v1:127.0.0.1:6805/2343223534] exists,up 93b934a1-96ed-4725-b6c4-ae4a6606dea4 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:235: TEST_backfill_out: run_osd td/osd-backfill-stats 1 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:31:49.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:31:49.051 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:31:49.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:31:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:31:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:31:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:31:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:31:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:31:49.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=3ab7f557-b7f3-4b38-8b91-1fa41bfcb330 2024-05-08T19:31:49.054 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 3ab7f557-b7f3-4b38-8b91-1fa41bfcb330 2024-05-08T19:31:49.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 3ab7f557-b7f3-4b38-8b91-1fa41bfcb330' 2024-05-08T19:31:49.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:31:49.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAl0ztmWOYaBRAAQdIXYKbtLNf/qQxXGOZlSw== 2024-05-08T19:31:49.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAl0ztmWOYaBRAAQdIXYKbtLNf/qQxXGOZlSw=="}' 2024-05-08T19:31:49.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 3ab7f557-b7f3-4b38-8b91-1fa41bfcb330 -i td/osd-backfill-stats/1/new.json 2024-05-08T19:31:49.551 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:31:49.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:31:49.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAl0ztmWOYaBRAAQdIXYKbtLNf/qQxXGOZlSw== --osd-uuid 3ab7f557-b7f3-4b38-8b91-1fa41bfcb330 2024-05-08T19:31:49.599 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:49.604+0000 7f2f8d0687c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:49.620 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:49.628+0000 7f2f8d0687c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:49.621 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:49.628+0000 7f2f8d0687c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:49.622 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:49.628+0000 7f2f8d0687c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:31:49.622 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:49.628+0000 7f2f8d0687c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:31:49.622 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:49.628+0000 7f2f8d0687c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:31:49.659 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:49.664+0000 7f2f8d0687c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:31:56.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:31:56.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:31:56.393 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:31:56.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:31:56.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:31:57.019 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:31:57.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:31:57.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:31:57.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:31:57.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:31:57.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:31:57.053 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:57.060+0000 7ff66c8917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:57.055 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:57.060+0000 7ff66c8917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:57.057 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:57.064+0000 7ff66c8917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:31:57.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:31:57.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:31:57.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:31:57.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:31:57.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:31:57.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:57.492 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:31:57.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:31:57.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:57.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:31:57.661 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:31:57.668+0000 7ff66c8917c0 -1 Falling back to public interface 2024-05-08T19:31:57.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:31:58.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:31:58.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:31:58.918 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:31:58.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:31:58.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:31:58.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:31:59.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:00.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:00.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:00.349 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:32:00.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:32:00.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:00.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:00.425 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:00.432+0000 7ff66c8917c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:32:00.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:01.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:01.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:01.802 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:32:01.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:32:01.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:01.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:02.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:03.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:03.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:03.421 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:32:03.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:32:03.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:03.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:03.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:04.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:04.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:04.852 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:32:04.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:32:04.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:04.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:05.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:06.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:06.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:06.410 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:32:06.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:32:06.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:06.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:06.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:07.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:07.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:07.919 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:32:07.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:32:07.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:07.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:08.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:09.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:09.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:09.502 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:32:09.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:32:09.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:09.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:09.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:10.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:10.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:10.976 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:32:10.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:32:10.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:10.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:11.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:12.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:12.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:12.558 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:32:12.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:32:12.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:12.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:14.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:14.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:14.029 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:32:14.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:32:14.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:14.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:14.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:15.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:15.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:15.458 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:32:15.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:32:15.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:15.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:16.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:17.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:17.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:17.252 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:32:17.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:32:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:18.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:19.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:19.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:19.088 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:32:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:32:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:19.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:19.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:20.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:20.863 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:32:20.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:32:20.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:20.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:21.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:22.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:22.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:22.752 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:32:22.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:32:22.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:22.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:23.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:24.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:24.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:24.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:32:24.901 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:32:24.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:24.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:25.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:26.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:26.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:26.794 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:32:26.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:32:26.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:26.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:32:27.214 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1648909280,v1:127.0.0.1:6811/1648909280] [v2:127.0.0.1:6812/1648909280,v1:127.0.0.1:6813/1648909280] exists,up 3ab7f557-b7f3-4b38-8b91-1fa41bfcb330 2024-05-08T19:32:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:32:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:32:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:32:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:236: TEST_backfill_out: run_osd td/osd-backfill-stats 2 2024-05-08T19:32:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:32:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:32:27.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:32:27.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:32:27.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:32:27.218 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:32:27.218 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:32:27.218 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:32:27.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:32:27.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:32:27.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:32:27.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:32:27.219 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:32:27.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=a2369a49-c3ef-4330-bcff-7dce7ced9d6d 2024-05-08T19:32:27.220 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 a2369a49-c3ef-4330-bcff-7dce7ced9d6d 2024-05-08T19:32:27.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 a2369a49-c3ef-4330-bcff-7dce7ced9d6d' 2024-05-08T19:32:27.220 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:32:27.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBL0ztmJp27DhAAkWb2CTGMl8Rk3dav3Zelgg== 2024-05-08T19:32:27.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBL0ztmJp27DhAAkWb2CTGMl8Rk3dav3Zelgg=="}' 2024-05-08T19:32:27.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new a2369a49-c3ef-4330-bcff-7dce7ced9d6d -i td/osd-backfill-stats/2/new.json 2024-05-08T19:32:27.839 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:32:27.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:32:27.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBL0ztmJp27DhAAkWb2CTGMl8Rk3dav3Zelgg== --osd-uuid a2369a49-c3ef-4330-bcff-7dce7ced9d6d 2024-05-08T19:32:27.894 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:27.899+0000 7f9ef18217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:32:27.924 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:27.931+0000 7f9ef18217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:32:27.926 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:27.931+0000 7f9ef18217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:32:27.926 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:27.931+0000 7f9ef18217c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:32:27.927 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:27.931+0000 7f9ef18217c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:32:27.927 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:27.931+0000 7f9ef18217c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:32:28.042 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:28.051+0000 7f9ef18217c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:32:34.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:32:34.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:32:34.781 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:32:34.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:32:34.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:32:35.346 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:32:35.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:32:35.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:32:35.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:32:35.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:32:35.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:32:35.379 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:35.383+0000 7f1250b867c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:32:35.381 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:35.387+0000 7f1250b867c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:32:35.382 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:35.387+0000 7f1250b867c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:32:35.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:32:35.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:32:35.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:32:35.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:32:35.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:32:35.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:35.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:32:35.793 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:32:35.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:35.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:35.961 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:35.967+0000 7f1250b867c0 -1 Falling back to public interface 2024-05-08T19:32:36.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:37.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:37.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:37.289 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:32:37.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:32:37.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:37.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:37.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:38.699 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:32:38.703+0000 7f1250b867c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:32:38.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:38.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:38.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:32:38.701 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:32:38.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:38.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:39.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:40.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:40.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:40.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:32:40.297 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:32:40.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:40.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:40.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:41.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:41.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:41.797 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:32:41.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:32:41.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:41.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:42.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:43.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:43.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:43.244 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:32:43.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:32:43.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:43.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:43.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:44.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:44.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:44.766 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:32:44.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:32:44.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:44.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:45.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:46.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:46.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:46.231 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:32:46.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:32:46.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:46.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:46.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:47.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:47.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:47.765 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:32:47.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:32:47.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:47.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:48.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:49.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:49.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:49.195 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:32:49.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:32:49.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:49.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:49.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:50.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:50.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:50.676 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:32:50.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:32:50.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:50.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:51.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:52.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:52.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:52.270 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:32:52.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:32:52.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:52.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:52.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:53.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:53.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:53.764 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:32:53.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:32:53.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:53.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:54.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:55.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:55.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:55.913 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:32:55.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:32:55.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:55.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:57.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:32:58.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:32:58.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:32:58.127 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:32:58.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:32:58.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:32:58.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:32:59.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:00.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:00.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:00.350 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:33:00.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:33:00.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:00.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:33:01.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:02.317 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:33:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:33:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:33:03.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:04.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:04.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:04.253 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:33:04.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:33:04.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:04.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:33:04.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:05.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:05.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:05.893 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:33:05.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:33:05.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:05.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:33:06.332 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3509432242,v1:127.0.0.1:6819/3509432242] [v2:127.0.0.1:6820/3509432242,v1:127.0.0.1:6821/3509432242] exists,up a2369a49-c3ef-4330-bcff-7dce7ced9d6d 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:237: TEST_backfill_out: run_osd td/osd-backfill-stats 3 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:33:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:33:06.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:33:06.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:33:06.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6bfe15f7-7eb2-4511-adb9-beb7d768413d 2024-05-08T19:33:06.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 6bfe15f7-7eb2-4511-adb9-beb7d768413d' 2024-05-08T19:33:06.339 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 6bfe15f7-7eb2-4511-adb9-beb7d768413d 2024-05-08T19:33:06.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:33:06.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBy0ztmbhAHFhAAepNWNvjvuNbcJOdEFjkYhw== 2024-05-08T19:33:06.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBy0ztmbhAHFhAAepNWNvjvuNbcJOdEFjkYhw=="}' 2024-05-08T19:33:06.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6bfe15f7-7eb2-4511-adb9-beb7d768413d -i td/osd-backfill-stats/3/new.json 2024-05-08T19:33:06.881 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:33:06.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:33:06.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBy0ztmbhAHFhAAepNWNvjvuNbcJOdEFjkYhw== --osd-uuid 6bfe15f7-7eb2-4511-adb9-beb7d768413d 2024-05-08T19:33:06.930 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:06.934+0000 7fc3ce41a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:06.975 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:06.978+0000 7fc3ce41a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:06.977 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:06.982+0000 7fc3ce41a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:06.977 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:06.982+0000 7fc3ce41a7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:33:06.977 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:06.982+0000 7fc3ce41a7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:33:06.977 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:06.982+0000 7fc3ce41a7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:33:07.014 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:07.018+0000 7fc3ce41a7c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:33:14.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:33:14.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:33:14.035 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:33:14.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:33:14.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:33:14.582 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:33:14.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:33:14.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:33:14.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:33:14.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:33:14.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:33:14.610 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:14.618+0000 7f6af3ce57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:14.612 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:14.622+0000 7f6af3ce57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:14.614 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:14.622+0000 7f6af3ce57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:15.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:33:15.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:33:15.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:33:15.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:33:15.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:33:15.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:15.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:33:15.031 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:33:15.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:15.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:15.181 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:15.190+0000 7f6af3ce57c0 -1 Falling back to public interface 2024-05-08T19:33:15.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:16.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:16.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:16.451 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:33:16.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:33:16.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:16.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:16.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:17.818 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:17.826+0000 7f6af3ce57c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:33:17.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:17.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:17.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:33:17.876 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:33:17.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:17.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:18.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:19.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:19.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:19.585 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:33:19.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:33:19.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:19.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:20.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:21.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:21.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:21.088 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:33:21.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:33:21.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:21.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:21.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:22.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:22.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:22.515 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:33:22.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:33:22.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:22.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:22.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:23.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:23.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:23.944 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:33:23.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:33:23.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:23.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:24.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:25.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:25.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:25.353 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:33:25.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:33:25.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:25.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:25.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:26.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:26.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:26.930 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:33:26.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:33:26.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:26.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:27.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:28.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:28.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:28.373 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:33:28.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:33:28.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:28.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:29.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:30.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:30.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:30.041 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:33:30.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:33:30.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:30.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:30.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:31.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:31.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:31.467 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:33:31.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:33:31.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:31.468 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:32.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:32.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:32.919 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:33:32.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:33:32.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:32.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:33.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:34.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:34.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:34.777 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:33:34.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:33:34.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:34.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:35.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:36.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:36.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:36.662 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:33:36.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:33:36.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:36.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:37.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:38.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:38.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:38.538 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:33:38.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:33:38.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:38.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:39.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:40.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:40.325 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:33:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:33:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:41.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:42.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:42.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:42.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:33:42.539 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:33:42.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:42.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:43.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:44.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:44.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:44.599 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:33:44.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:33:44.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:44.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:33:45.022 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1546699624,v1:127.0.0.1:6827/1546699624] [v2:127.0.0.1:6828/1546699624,v1:127.0.0.1:6829/1546699624] exists,up 6bfe15f7-7eb2-4511-adb9-beb7d768413d 2024-05-08T19:33:45.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:33:45.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:238: TEST_backfill_out: run_osd td/osd-backfill-stats 4 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:33:45.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:33:45.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:33:45.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:33:45.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:33:45.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=db45ddd0-99e2-47f5-a4bf-61e5af9051e6 2024-05-08T19:33:45.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 db45ddd0-99e2-47f5-a4bf-61e5af9051e6' 2024-05-08T19:33:45.030 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 db45ddd0-99e2-47f5-a4bf-61e5af9051e6 2024-05-08T19:33:45.030 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:33:45.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCZ0ztm2QenAxAAq/Ht5c+9KW16Z0i0Ve/M+g== 2024-05-08T19:33:45.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCZ0ztm2QenAxAAq/Ht5c+9KW16Z0i0Ve/M+g=="}' 2024-05-08T19:33:45.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new db45ddd0-99e2-47f5-a4bf-61e5af9051e6 -i td/osd-backfill-stats/4/new.json 2024-05-08T19:33:45.592 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:33:45.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:33:45.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCZ0ztm2QenAxAAq/Ht5c+9KW16Z0i0Ve/M+g== --osd-uuid db45ddd0-99e2-47f5-a4bf-61e5af9051e6 2024-05-08T19:33:45.640 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:45.650+0000 7fa1771c67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:45.677 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:45.686+0000 7fa1771c67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:45.678 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:45.686+0000 7fa1771c67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:45.678 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:45.686+0000 7fa1771c67c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:33:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:45.686+0000 7fa1771c67c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:33:45.679 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:45.686+0000 7fa1771c67c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:33:45.716 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:45.726+0000 7fa1771c67c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:33:52.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:33:52.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:33:52.668 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:33:52.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:33:52.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:33:53.234 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:33:53.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:33:53.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:33:53.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:33:53.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:33:53.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:33:53.268 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:53.277+0000 7f1826ded7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:53.270 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:53.277+0000 7f1826ded7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:53.271 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:53.277+0000 7f1826ded7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:33:53.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:33:53.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:33:53.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:33:53.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:33:53.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:33:53.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:53.645 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:33:53.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:33:53.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:53.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:33:53.837 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:53.845+0000 7f1826ded7c0 -1 Falling back to public interface 2024-05-08T19:33:54.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:55.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:55.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:55.075 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:33:55.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:33:55.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:55.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:33:55.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:56.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:56.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:56.497 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:33:56.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:33:56.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:56.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:33:56.660 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:33:56.669+0000 7f1826ded7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:33:57.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:58.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:58.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:58.069 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:33:58.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:33:58.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:58.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:33:58.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:33:59.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:33:59.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:33:59.666 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:33:59.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:33:59.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:33:59.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:00.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:01.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:01.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:01.200 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:34:01.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:34:01.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:01.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:01.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:02.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:02.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:02.722 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:34:02.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:34:02.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:02.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:03.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:04.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:04.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:04.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:34:04.320 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:34:04.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:04.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:05.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:06.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:06.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:06.067 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:34:06.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:34:06.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:06.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:06.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:07.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:07.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:07.635 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:34:07.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:34:07.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:07.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:08.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:09.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:09.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:09.044 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:34:09.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:34:09.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:09.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:09.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:10.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:10.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:10.575 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:34:10.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:34:10.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:10.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:11.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:12.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:12.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:12.052 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:34:12.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:34:12.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:12.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:12.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:13.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:13.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:13.794 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:34:13.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:34:13.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:13.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:14.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:15.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:34:15.505 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:34:15.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:15.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:16.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:17.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:17.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:17.265 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:34:17.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:34:17.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:17.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:17.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:18.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:18.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:18.911 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:34:18.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:34:18.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:18.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:20.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:21.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:21.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:21.186 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:34:21.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:34:21.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:21.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:22.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:23.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:23.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:23.141 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:34:23.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:34:23.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:23.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:34:23.612 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1501429456,v1:127.0.0.1:6835/1501429456] [v2:127.0.0.1:6836/1501429456,v1:127.0.0.1:6837/1501429456] exists,up db45ddd0-99e2-47f5-a4bf-61e5af9051e6 2024-05-08T19:34:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:34:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:34:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:239: TEST_backfill_out: run_osd td/osd-backfill-stats 5 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/5 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-05-08T19:34:23.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:34:23.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:34:23.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/5 2024-05-08T19:34:23.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:34:23.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=58b60106-1f0c-4abf-9d4a-684c53ffd553 2024-05-08T19:34:23.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 58b60106-1f0c-4abf-9d4a-684c53ffd553' 2024-05-08T19:34:23.619 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 58b60106-1f0c-4abf-9d4a-684c53ffd553 2024-05-08T19:34:23.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:34:23.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC/0ztm126HJhAACAL2OLbsEVZbksHpL94EjQ== 2024-05-08T19:34:23.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC/0ztm126HJhAACAL2OLbsEVZbksHpL94EjQ=="}' 2024-05-08T19:34:23.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 58b60106-1f0c-4abf-9d4a-684c53ffd553 -i td/osd-backfill-stats/5/new.json 2024-05-08T19:34:24.325 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:34:24.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/5/new.json 2024-05-08T19:34:24.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC/0ztm126HJhAACAL2OLbsEVZbksHpL94EjQ== --osd-uuid 58b60106-1f0c-4abf-9d4a-684c53ffd553 2024-05-08T19:34:24.373 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:24.381+0000 7fdc375ae7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:34:24.421 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:24.429+0000 7fdc375ae7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:34:24.422 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:24.429+0000 7fdc375ae7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:34:24.423 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:24.429+0000 7fdc375ae7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:34:24.423 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:24.429+0000 7fdc375ae7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:34:24.423 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:24.429+0000 7fdc375ae7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:34:24.467 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:24.473+0000 7fdc375ae7c0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-05-08T19:34:31.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-05-08T19:34:31.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:34:31.556 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T19:34:31.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T19:34:31.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:34:32.162 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T19:34:32.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T19:34:32.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:34:32.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:34:32.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:34:32.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:34:32.195 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:32.201+0000 7f5fb41667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:34:32.197 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:32.205+0000 7f5fb41667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:34:32.198 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:32.205+0000 7f5fb41667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:34:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T19:34:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:34:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T19:34:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:34:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:34:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:32.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:34:32.641 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:34:32.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:32.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:32.765 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:32.773+0000 7f5fb41667c0 -1 Falling back to public interface 2024-05-08T19:34:33.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:34.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:34.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:34.057 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:34:34.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:34:34.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:34.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:34.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:35.434 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:34:35.441+0000 7f5fb41667c0 -1 osd.5 0 log_to_monitors true 2024-05-08T19:34:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:34:35.482 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:34:35.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:35.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:36.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:37.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:37.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:37.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:34:37.289 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:34:37.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:37.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:37.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:38.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:38.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:38.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:34:38.821 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:34:38.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:38.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:39.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:40.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:40.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:40.296 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:34:40.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:34:40.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:40.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:40.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:41.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:41.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:41.893 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:34:41.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:34:41.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:41.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:42.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:43.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:43.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:43.462 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:34:43.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:34:43.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:43.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:43.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:44.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:44.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:44.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:34:44.904 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:34:44.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:44.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:45.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:46.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:46.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:46.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:34:46.428 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:34:46.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:46.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:46.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:47.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:47.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:47.931 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:34:47.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:34:47.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:47.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:48.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:49.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:49.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:49.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:34:49.446 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:34:49.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:49.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:50.088 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:51.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:51.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:51.090 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:34:51.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:34:51.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:51.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:51.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:52.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:52.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:52.959 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:34:52.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:34:52.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:52.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:53.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:54.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:54.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:54.596 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:34:54.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:34:54.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:54.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:55.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:56.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:56.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:56.174 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:34:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:34:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:56.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:57.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:34:58.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:34:58.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:34:58.665 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:34:58.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:34:58.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:34:58.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:34:59.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:35:00.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:35:00.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:35:00.343 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:35:00.343 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:35:00.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:35:00.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:35:01.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:35:02.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:35:02.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:35:02.372 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:35:02.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:35:02.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:35:02.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:35:02.779 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1807860191,v1:127.0.0.1:6843/1807860191] [v2:127.0.0.1:6844/1807860191,v1:127.0.0.1:6845/1807860191] exists,up 58b60106-1f0c-4abf-9d4a-684c53ffd553 2024-05-08T19:35:02.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:35:02.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:35:02.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:35:02.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:241: TEST_backfill_out: create_pool test 1 1 2024-05-08T19:35:02.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T19:35:03.369 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:35:03.386 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:35:04.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:242: TEST_backfill_out: ceph osd pool set test size 2 2024-05-08T19:35:05.565 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T19:35:05.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:243: TEST_backfill_out: sleep 5 2024-05-08T19:35:10.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:245: TEST_backfill_out: wait_for_clean 2024-05-08T19:35:10.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:35:10.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:35:10.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:35:10.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:35:10.592 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:35:10.592 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:35:10.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:35:10.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:35:10.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:35:10.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:35:10.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:35:10.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:35:10.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:35:10.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:35:10.715 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:35:11.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:35:11.145 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:35:11.145 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:35:11.146 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:35:11.146 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:35:11.146 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:35:11.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:35:11.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:11.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:35:11.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836529 2024-05-08T19:35:11.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836529 2024-05-08T19:35:11.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836529' 2024-05-08T19:35:11.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:11.347 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:35:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673000 2024-05-08T19:35:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673000 2024-05-08T19:35:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836529 1-42949673000' 2024-05-08T19:35:11.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:11.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:35:11.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509470 2024-05-08T19:35:11.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509470 2024-05-08T19:35:11.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836529 1-42949673000 2-64424509470' 2024-05-08T19:35:11.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:11.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:35:11.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345946 2024-05-08T19:35:11.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345946 2024-05-08T19:35:11.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836529 1-42949673000 2-64424509470 3-85899345946' 2024-05-08T19:35:11.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:11.819 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:35:11.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182414 2024-05-08T19:35:11.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182414 2024-05-08T19:35:11.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836529 1-42949673000 2-64424509470 3-85899345946 4-107374182414' 2024-05-08T19:35:11.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:11.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:35:12.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018889 2024-05-08T19:35:12.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018889 2024-05-08T19:35:12.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836529 1-42949673000 2-64424509470 3-85899345946 4-107374182414 5-128849018889' 2024-05-08T19:35:12.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:12.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836529 2024-05-08T19:35:12.127 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:12.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:35:12.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836529 2024-05-08T19:35:12.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:12.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836529 2024-05-08T19:35:12.129 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836529 2024-05-08T19:35:12.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836529' 2024-05-08T19:35:12.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:35:12.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836529 -lt 21474836529 2024-05-08T19:35:12.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:12.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673000 2024-05-08T19:35:12.532 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:12.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:35:12.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673000 2024-05-08T19:35:12.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:12.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673000 2024-05-08T19:35:12.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673000' 2024-05-08T19:35:12.536 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673000 2024-05-08T19:35:12.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:35:12.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673000 -lt 42949673000 2024-05-08T19:35:12.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:12.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:12.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509470 2024-05-08T19:35:13.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:35:13.000 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509470 2024-05-08T19:35:13.001 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:13.002 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509470 2024-05-08T19:35:13.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509470 2024-05-08T19:35:13.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509470' 2024-05-08T19:35:13.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:35:13.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509470 -lt 64424509470 2024-05-08T19:35:13.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:13.407 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345946 2024-05-08T19:35:13.408 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:13.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:35:13.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345946 2024-05-08T19:35:13.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:13.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345946 2024-05-08T19:35:13.411 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345946 2024-05-08T19:35:13.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345946' 2024-05-08T19:35:13.411 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:35:13.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345946 -lt 85899345946 2024-05-08T19:35:13.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:13.873 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:13.873 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182414 2024-05-08T19:35:13.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:35:13.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182414 2024-05-08T19:35:13.876 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:13.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182414 2024-05-08T19:35:13.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182414' 2024-05-08T19:35:13.877 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182414 2024-05-08T19:35:13.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:35:14.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182414 -lt 107374182414 2024-05-08T19:35:14.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:14.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:14.361 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018889 2024-05-08T19:35:14.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:35:14.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018889 2024-05-08T19:35:14.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:14.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018889 2024-05-08T19:35:14.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018889' 2024-05-08T19:35:14.365 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018889 2024-05-08T19:35:14.365 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:35:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018889 -lt 128849018889 2024-05-08T19:35:14.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:35:14.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:35:14.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:35:15.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:35:15.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:35:15.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:35:15.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:35:15.363 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:35:15.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:35:15.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:35:15.364 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:35:15.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:35:15.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:35:15.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:35:15.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:35:16.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:35:16.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:35:16.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:35:16.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: seq 1 200 2024-05-08T19:35:16.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:16.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj1 /dev/null 2024-05-08T19:35:16.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:16.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj2 /dev/null 2024-05-08T19:35:16.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:16.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj3 /dev/null 2024-05-08T19:35:16.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:16.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj4 /dev/null 2024-05-08T19:35:16.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:16.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj5 /dev/null 2024-05-08T19:35:16.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:16.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj6 /dev/null 2024-05-08T19:35:17.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:17.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj7 /dev/null 2024-05-08T19:35:17.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:17.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj8 /dev/null 2024-05-08T19:35:17.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:17.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj9 /dev/null 2024-05-08T19:35:17.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:17.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj10 /dev/null 2024-05-08T19:35:17.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:17.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj11 /dev/null 2024-05-08T19:35:17.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:17.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj12 /dev/null 2024-05-08T19:35:17.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:17.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj13 /dev/null 2024-05-08T19:35:17.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:17.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj14 /dev/null 2024-05-08T19:35:18.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:18.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj15 /dev/null 2024-05-08T19:35:18.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:18.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj16 /dev/null 2024-05-08T19:35:18.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:18.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj17 /dev/null 2024-05-08T19:35:18.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:18.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj18 /dev/null 2024-05-08T19:35:18.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:18.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj19 /dev/null 2024-05-08T19:35:18.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:18.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj20 /dev/null 2024-05-08T19:35:18.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:18.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj21 /dev/null 2024-05-08T19:35:18.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:18.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj22 /dev/null 2024-05-08T19:35:19.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:19.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj23 /dev/null 2024-05-08T19:35:19.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:19.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj24 /dev/null 2024-05-08T19:35:19.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:19.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj25 /dev/null 2024-05-08T19:35:19.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:19.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj26 /dev/null 2024-05-08T19:35:19.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:19.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj27 /dev/null 2024-05-08T19:35:19.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:19.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj28 /dev/null 2024-05-08T19:35:19.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:19.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj29 /dev/null 2024-05-08T19:35:19.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:19.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj30 /dev/null 2024-05-08T19:35:20.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:20.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj31 /dev/null 2024-05-08T19:35:20.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:20.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj32 /dev/null 2024-05-08T19:35:20.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:20.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj33 /dev/null 2024-05-08T19:35:20.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:20.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj34 /dev/null 2024-05-08T19:35:20.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:20.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj35 /dev/null 2024-05-08T19:35:20.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:20.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj36 /dev/null 2024-05-08T19:35:20.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:20.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj37 /dev/null 2024-05-08T19:35:20.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:20.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj38 /dev/null 2024-05-08T19:35:21.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj39 /dev/null 2024-05-08T19:35:21.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj40 /dev/null 2024-05-08T19:35:21.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj41 /dev/null 2024-05-08T19:35:21.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj42 /dev/null 2024-05-08T19:35:21.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj43 /dev/null 2024-05-08T19:35:21.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj44 /dev/null 2024-05-08T19:35:21.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj45 /dev/null 2024-05-08T19:35:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj46 /dev/null 2024-05-08T19:35:21.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:21.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj47 /dev/null 2024-05-08T19:35:22.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:22.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj48 /dev/null 2024-05-08T19:35:22.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:22.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj49 /dev/null 2024-05-08T19:35:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:22.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj50 /dev/null 2024-05-08T19:35:22.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:22.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj51 /dev/null 2024-05-08T19:35:22.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:22.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj52 /dev/null 2024-05-08T19:35:22.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:22.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj53 /dev/null 2024-05-08T19:35:22.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:22.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj54 /dev/null 2024-05-08T19:35:23.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj55 /dev/null 2024-05-08T19:35:23.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj56 /dev/null 2024-05-08T19:35:23.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj57 /dev/null 2024-05-08T19:35:23.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj58 /dev/null 2024-05-08T19:35:23.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj59 /dev/null 2024-05-08T19:35:23.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj60 /dev/null 2024-05-08T19:35:23.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj61 /dev/null 2024-05-08T19:35:23.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj62 /dev/null 2024-05-08T19:35:23.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:23.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj63 /dev/null 2024-05-08T19:35:24.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:24.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj64 /dev/null 2024-05-08T19:35:24.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:24.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj65 /dev/null 2024-05-08T19:35:24.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:24.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj66 /dev/null 2024-05-08T19:35:24.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:24.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj67 /dev/null 2024-05-08T19:35:24.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:24.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj68 /dev/null 2024-05-08T19:35:24.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:24.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj69 /dev/null 2024-05-08T19:35:24.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:24.860 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj70 /dev/null 2024-05-08T19:35:24.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:24.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj71 /dev/null 2024-05-08T19:35:25.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:25.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj72 /dev/null 2024-05-08T19:35:25.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:25.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj73 /dev/null 2024-05-08T19:35:25.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:25.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj74 /dev/null 2024-05-08T19:35:25.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:25.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj75 /dev/null 2024-05-08T19:35:25.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:25.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj76 /dev/null 2024-05-08T19:35:25.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:25.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj77 /dev/null 2024-05-08T19:35:25.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:25.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj78 /dev/null 2024-05-08T19:35:25.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:25.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj79 /dev/null 2024-05-08T19:35:26.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:26.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj80 /dev/null 2024-05-08T19:35:26.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:26.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj81 /dev/null 2024-05-08T19:35:26.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:26.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj82 /dev/null 2024-05-08T19:35:26.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:26.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj83 /dev/null 2024-05-08T19:35:26.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:26.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj84 /dev/null 2024-05-08T19:35:26.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:26.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj85 /dev/null 2024-05-08T19:35:26.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:26.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj86 /dev/null 2024-05-08T19:35:26.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:26.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj87 /dev/null 2024-05-08T19:35:27.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj88 /dev/null 2024-05-08T19:35:27.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj89 /dev/null 2024-05-08T19:35:27.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj90 /dev/null 2024-05-08T19:35:27.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj91 /dev/null 2024-05-08T19:35:27.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj92 /dev/null 2024-05-08T19:35:27.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj93 /dev/null 2024-05-08T19:35:27.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj94 /dev/null 2024-05-08T19:35:27.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj95 /dev/null 2024-05-08T19:35:27.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:27.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj96 /dev/null 2024-05-08T19:35:28.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:28.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj97 /dev/null 2024-05-08T19:35:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:28.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj98 /dev/null 2024-05-08T19:35:28.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:28.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj99 /dev/null 2024-05-08T19:35:28.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:28.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj100 /dev/null 2024-05-08T19:35:28.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:28.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj101 /dev/null 2024-05-08T19:35:28.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:28.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj102 /dev/null 2024-05-08T19:35:28.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:28.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj103 /dev/null 2024-05-08T19:35:28.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:28.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj104 /dev/null 2024-05-08T19:35:29.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:29.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj105 /dev/null 2024-05-08T19:35:29.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:29.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj106 /dev/null 2024-05-08T19:35:29.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:29.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj107 /dev/null 2024-05-08T19:35:29.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:29.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj108 /dev/null 2024-05-08T19:35:29.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:29.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj109 /dev/null 2024-05-08T19:35:29.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:29.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj110 /dev/null 2024-05-08T19:35:29.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:29.820 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj111 /dev/null 2024-05-08T19:35:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj112 /dev/null 2024-05-08T19:35:30.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:30.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj113 /dev/null 2024-05-08T19:35:30.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:30.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj114 /dev/null 2024-05-08T19:35:30.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:30.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj115 /dev/null 2024-05-08T19:35:30.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:30.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj116 /dev/null 2024-05-08T19:35:30.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:30.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj117 /dev/null 2024-05-08T19:35:30.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:30.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj118 /dev/null 2024-05-08T19:35:30.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:30.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj119 /dev/null 2024-05-08T19:35:31.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj120 /dev/null 2024-05-08T19:35:31.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj121 /dev/null 2024-05-08T19:35:31.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj122 /dev/null 2024-05-08T19:35:31.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj123 /dev/null 2024-05-08T19:35:31.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj124 /dev/null 2024-05-08T19:35:31.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj125 /dev/null 2024-05-08T19:35:31.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj126 /dev/null 2024-05-08T19:35:31.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj127 /dev/null 2024-05-08T19:35:31.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:31.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj128 /dev/null 2024-05-08T19:35:32.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:32.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj129 /dev/null 2024-05-08T19:35:32.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:32.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj130 /dev/null 2024-05-08T19:35:32.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:32.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj131 /dev/null 2024-05-08T19:35:32.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:32.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj132 /dev/null 2024-05-08T19:35:32.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:32.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj133 /dev/null 2024-05-08T19:35:32.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:32.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj134 /dev/null 2024-05-08T19:35:32.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:32.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj135 /dev/null 2024-05-08T19:35:33.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj136 /dev/null 2024-05-08T19:35:33.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj137 /dev/null 2024-05-08T19:35:33.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj138 /dev/null 2024-05-08T19:35:33.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj139 /dev/null 2024-05-08T19:35:33.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj140 /dev/null 2024-05-08T19:35:33.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj141 /dev/null 2024-05-08T19:35:33.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj142 /dev/null 2024-05-08T19:35:33.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj143 /dev/null 2024-05-08T19:35:33.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:33.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj144 /dev/null 2024-05-08T19:35:34.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:34.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj145 /dev/null 2024-05-08T19:35:34.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:34.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj146 /dev/null 2024-05-08T19:35:34.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:34.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj147 /dev/null 2024-05-08T19:35:34.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:34.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj148 /dev/null 2024-05-08T19:35:34.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:34.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj149 /dev/null 2024-05-08T19:35:34.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:34.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj150 /dev/null 2024-05-08T19:35:34.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:34.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj151 /dev/null 2024-05-08T19:35:34.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:34.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj152 /dev/null 2024-05-08T19:35:35.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:35.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj153 /dev/null 2024-05-08T19:35:35.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:35.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj154 /dev/null 2024-05-08T19:35:35.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:35.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj155 /dev/null 2024-05-08T19:35:35.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:35.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj156 /dev/null 2024-05-08T19:35:35.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:35.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj157 /dev/null 2024-05-08T19:35:35.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:35.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj158 /dev/null 2024-05-08T19:35:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:35.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj159 /dev/null 2024-05-08T19:35:36.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj160 /dev/null 2024-05-08T19:35:36.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj161 /dev/null 2024-05-08T19:35:36.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj162 /dev/null 2024-05-08T19:35:36.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj163 /dev/null 2024-05-08T19:35:36.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj164 /dev/null 2024-05-08T19:35:36.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj165 /dev/null 2024-05-08T19:35:36.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj166 /dev/null 2024-05-08T19:35:36.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj167 /dev/null 2024-05-08T19:35:36.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:36.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj168 /dev/null 2024-05-08T19:35:37.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:37.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj169 /dev/null 2024-05-08T19:35:37.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:37.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj170 /dev/null 2024-05-08T19:35:37.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:37.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj171 /dev/null 2024-05-08T19:35:37.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:37.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj172 /dev/null 2024-05-08T19:35:37.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:37.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj173 /dev/null 2024-05-08T19:35:37.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:37.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj174 /dev/null 2024-05-08T19:35:37.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:37.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj175 /dev/null 2024-05-08T19:35:37.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:37.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj176 /dev/null 2024-05-08T19:35:38.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:38.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj177 /dev/null 2024-05-08T19:35:38.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:38.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj178 /dev/null 2024-05-08T19:35:38.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:38.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj179 /dev/null 2024-05-08T19:35:38.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:38.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj180 /dev/null 2024-05-08T19:35:38.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:38.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj181 /dev/null 2024-05-08T19:35:38.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:38.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj182 /dev/null 2024-05-08T19:35:38.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:38.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj183 /dev/null 2024-05-08T19:35:39.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:39.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj184 /dev/null 2024-05-08T19:35:39.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:39.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj185 /dev/null 2024-05-08T19:35:39.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:39.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj186 /dev/null 2024-05-08T19:35:39.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:39.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj187 /dev/null 2024-05-08T19:35:39.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:39.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj188 /dev/null 2024-05-08T19:35:39.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:39.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj189 /dev/null 2024-05-08T19:35:39.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:39.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj190 /dev/null 2024-05-08T19:35:39.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:39.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj191 /dev/null 2024-05-08T19:35:40.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:40.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj192 /dev/null 2024-05-08T19:35:40.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:40.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj193 /dev/null 2024-05-08T19:35:40.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:40.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj194 /dev/null 2024-05-08T19:35:40.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:40.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj195 /dev/null 2024-05-08T19:35:40.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:40.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj196 /dev/null 2024-05-08T19:35:40.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:40.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj197 /dev/null 2024-05-08T19:35:40.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:40.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj198 /dev/null 2024-05-08T19:35:40.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:40.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj199 /dev/null 2024-05-08T19:35:41.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-05-08T19:35:41.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj200 /dev/null 2024-05-08T19:35:41.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:252: TEST_backfill_out: get_pg test obj1 2024-05-08T19:35:41.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:35:41.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:35:41.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:35:41.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:35:41.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:252: TEST_backfill_out: local PG=1.0 2024-05-08T19:35:41.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:254: TEST_backfill_out: get_primary test obj1 2024-05-08T19:35:41.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:35:41.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:35:41.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:35:41.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:35:42.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:254: TEST_backfill_out: local primary=1 2024-05-08T19:35:42.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:256: TEST_backfill_out: ceph osd set nobackfill 2024-05-08T19:35:42.681 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:35:42.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:257: TEST_backfill_out: get_not_primary test obj1 2024-05-08T19:35:42.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T19:35:42.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T19:35:42.704 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T19:35:42.704 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:35:42.704 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:35:42.704 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:35:42.704 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:35:43.153 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T19:35:43.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T19:35:43.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T19:35:43.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:257: TEST_backfill_out: ceph osd out osd.0 2024-05-08T19:35:44.104 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T19:35:44.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:258: TEST_backfill_out: sleep 2 2024-05-08T19:35:46.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:259: TEST_backfill_out: ceph osd unset nobackfill 2024-05-08T19:35:47.202 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:35:47.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:261: TEST_backfill_out: wait_for_clean 2024-05-08T19:35:47.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:35:47.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:35:47.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:35:47.223 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:35:47.224 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:35:47.224 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:35:47.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:35:47.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:35:47.225 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:35:47.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:35:47.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:35:47.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:35:47.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:35:47.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:35:47.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:35:47.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:35:47.810 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:35:47.810 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:35:47.810 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:35:47.810 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:35:47.810 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:35:47.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:35:47.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:47.811 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:35:47.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836538 2024-05-08T19:35:47.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836538 2024-05-08T19:35:47.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538' 2024-05-08T19:35:47.983 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:47.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:35:48.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673010 2024-05-08T19:35:48.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673010 2024-05-08T19:35:48.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673010' 2024-05-08T19:35:48.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:48.137 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:35:48.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509479 2024-05-08T19:35:48.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509479 2024-05-08T19:35:48.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673010 2-64424509479' 2024-05-08T19:35:48.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:48.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:35:48.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345955 2024-05-08T19:35:48.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345955 2024-05-08T19:35:48.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673010 2-64424509479 3-85899345955' 2024-05-08T19:35:48.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:48.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:35:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182423 2024-05-08T19:35:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182423 2024-05-08T19:35:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673010 2-64424509479 3-85899345955 4-107374182423' 2024-05-08T19:35:48.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:35:48.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:35:48.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018898 2024-05-08T19:35:48.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018898 2024-05-08T19:35:48.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836538 1-42949673010 2-64424509479 3-85899345955 4-107374182423 5-128849018898' 2024-05-08T19:35:48.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:48.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836538 2024-05-08T19:35:48.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:48.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:35:48.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836538 2024-05-08T19:35:48.744 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:48.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836538 2024-05-08T19:35:48.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836538' 2024-05-08T19:35:48.746 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836538 2024-05-08T19:35:48.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:35:49.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 0 -lt 21474836538 2024-05-08T19:35:49.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:35:50.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:35:50.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:35:50.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836539 -lt 21474836538 2024-05-08T19:35:50.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:50.721 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:50.722 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673010 2024-05-08T19:35:50.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:35:50.724 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:50.724 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673010 2024-05-08T19:35:50.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673010 2024-05-08T19:35:50.725 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673010 2024-05-08T19:35:50.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673010' 2024-05-08T19:35:50.725 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:35:51.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673010 -lt 42949673010 2024-05-08T19:35:51.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:51.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509479 2024-05-08T19:35:51.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:51.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:35:51.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509479 2024-05-08T19:35:51.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:51.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509479 2024-05-08T19:35:51.209 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509479 2024-05-08T19:35:51.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509479' 2024-05-08T19:35:51.209 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:35:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509479 -lt 64424509479 2024-05-08T19:35:51.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:51.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345955 2024-05-08T19:35:51.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:51.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:35:51.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345955 2024-05-08T19:35:51.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:51.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345955 2024-05-08T19:35:51.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345955' 2024-05-08T19:35:51.794 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345955 2024-05-08T19:35:51.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:35:52.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345956 -lt 85899345955 2024-05-08T19:35:52.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:52.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182423 2024-05-08T19:35:52.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:52.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:35:52.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182423 2024-05-08T19:35:52.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:52.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182423 2024-05-08T19:35:52.371 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182423 2024-05-08T19:35:52.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182423' 2024-05-08T19:35:52.371 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:35:52.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182424 -lt 107374182423 2024-05-08T19:35:52.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:35:52.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018898 2024-05-08T19:35:52.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:35:52.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:35:52.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:35:52.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018898 2024-05-08T19:35:52.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018898 2024-05-08T19:35:52.964 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018898 2024-05-08T19:35:52.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018898' 2024-05-08T19:35:52.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:35:53.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018898 -lt 128849018898 2024-05-08T19:35:53.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:35:53.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:35:53.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:35:54.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:35:54.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:35:54.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:35:54.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:35:54.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:35:54.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:35:54.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:35:54.164 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:35:54.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:35:54.574 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:35:54.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:35:54.575 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:35:55.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:35:55.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:35:55.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:35:55.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:35:55.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:35:55.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:35:55.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:35:55.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:35:55.260 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:35:55.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:35:55.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:35:55.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:35:55.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:35:55.261 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:35:55.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:35:55.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:35:55.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:35:55.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:35:56.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:35:56.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:35:56.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:35:56.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:35:56.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:35:56.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:35:56.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:35:56.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:35:56.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:35:56.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T19:35:56.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T19:35:56.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:35:56.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:35:56.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:35:56.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:35:56.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:35:56.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:35:56.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:35:56.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:35:56.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:35:56.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:35:56.995 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:35:57.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:35:57.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:35:57.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:35:57.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:35:57.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:35:57.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:35:57.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:35:57.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:35:57.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:35:57.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:35:57.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:35:57.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:35:57.969 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:35:58.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:35:58.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:35:58.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:35:58.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:35:58.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:35:58.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:35:58.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:35:58.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:35:58.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:35:58.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:35:58.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:35:58.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:35:58.705 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:35:59.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:35:59.141 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:35:59.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:35:59.142 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:35:59.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:35:59.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:35:59.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:35:59.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:35:59.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:35:59.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:35:59.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:35:59.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:35:59.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:00.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:36:00.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:36:00.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:00.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:00.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:00.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:00.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:00.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:00.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:00.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:00.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:00.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:00.538 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:00.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:00.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:00.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:00.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:01.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:01.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:01.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:01.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:01.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:01.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:01.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:01.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:01.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:02.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:36:02.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:36:02.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:02.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:02.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:02.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:02.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:02.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:02.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:02.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:02.275 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:02.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:02.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:02.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:02.698 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:02.698 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:02.698 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:03.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:03.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:03.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:03.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:03.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:03.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:03.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:03.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:03.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:04.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:36:04.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:36:04.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:04.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:04.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:04.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:04.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:04.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:04.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:04.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:04.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:04.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:04.258 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:04.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:04.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:04.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:04.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:05.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:05.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:05.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:05.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:05.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:05.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:05.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:05.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:05.227 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:05.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=9 2024-05-08T19:36:05.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 9 '!=' null 2024-05-08T19:36:05.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:05.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:05.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:05.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:05.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:05.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:05.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:05.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:05.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:05.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:05.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:06.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:06.422 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:06.422 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:06.422 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:06.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:06.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:06.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:06.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:06.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:06.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:06.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:06.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:06.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:07.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=7 2024-05-08T19:36:07.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 7 '!=' null 2024-05-08T19:36:07.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:07.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:07.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:07.772 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:07.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:07.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:07.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:07.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:07.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:07.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:07.774 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:08.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:08.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:08.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:08.185 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:08.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:08.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:08.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:08.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:08.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:08.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:08.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:08.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:08.743 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:09.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=11 2024-05-08T19:36:09.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 11 '!=' null 2024-05-08T19:36:09.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:09.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:09.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:09.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:09.558 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:09.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:09.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:09.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:09.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:09.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:09.560 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:09.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:09.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:09.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:09.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:10.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:10.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:10.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:11.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=7 2024-05-08T19:36:11.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 7 '!=' null 2024-05-08T19:36:11.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:11.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:11.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:11.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:11.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:11.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:11.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:11.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:11.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:11.146 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:11.147 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:11.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:11.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:11.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:11.639 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:12.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:12.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:12.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:12.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:12.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:12.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:12.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:12.425 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:12.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:13.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=9 2024-05-08T19:36:13.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 9 '!=' null 2024-05-08T19:36:13.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:13.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:13.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:13.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:13.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:13.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:13.269 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:13.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:13.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:13.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:13.270 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:13.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:13.671 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:13.671 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:13.671 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:14.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:14.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:14.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:14.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:14.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:14.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:14.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:14.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:14.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:14.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=10 2024-05-08T19:36:14.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 10 '!=' null 2024-05-08T19:36:14.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:14.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:14.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:14.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:14.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:14.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:14.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:14.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:14.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:14.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:14.825 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:15.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:15.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:15.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:15.226 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:15.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:15.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:15.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:15.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:15.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:15.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:15.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:15.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:15.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:36:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:36:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:16.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:16.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:16.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:16.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:16.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:16.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:16.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:16.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:16.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:36:16.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:16.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:16.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:17.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:36:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:36:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:36:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:36:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:36:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:36:17.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:36:17.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:36:17.434 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:36:17.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:36:17.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:36:17.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:36:17.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:36:17.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:36:18.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:36:18.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:36:18.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:36:18.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:36:18.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:36:18.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:36:18.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:36:18.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:36:18.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:36:18.453 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:36:18.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:36:18.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:36:18.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:36:18.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:36:18.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:36:18.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:263: TEST_backfill_out: check td/osd-backfill-stats 1.0 1 replicated 0 0 200 0 2024-05-08T19:36:18.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:36:18.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:36:18.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=0 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=200 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:36:18.993 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-05-08T19:36:19.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:19.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:19.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:36:19.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:36:19.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:36:19.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-05-08T19:36:19.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:36:19.005 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:36:19.005 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:19.005 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:36:19.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[1,2]/[1,0]' 2024-05-08T19:36:19.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[1,2]/[1,0]' ']' 2024-05-08T19:36:19.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:36:19.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:36:19.020 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:19.020 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [1,2]/[1,0] ' 2024-05-08T19:36:19.020 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:36:19.020 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:36:19.020 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:36:19.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=0 2024-05-08T19:36:19.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2024-05-08T19:36:19.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 0 0 2024-05-08T19:36:19.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-05-08T19:36:19.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:36:19.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-05-08T19:36:19.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:36:19.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:36:19.027 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:19.027 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:36:19.027 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=0 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 0 0 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:36:19.038 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:36:19.039 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:19.039 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [1,2]/[1,0] ' 2024-05-08T19:36:19.039 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:36:19.039 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:36:19.039 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:36:19.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=200 2024-05-08T19:36:19.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2024-05-08T19:36:19.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 200 200 2024-05-08T19:36:19.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-05-08T19:36:19.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:36:19.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-05-08T19:36:19.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:36:19.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:36:19.045 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:36:19.045 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:36:19.045 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:36:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=1 2024-05-08T19:36:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2024-05-08T19:36:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 1 0 2024-05-08T19:36:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-05-08T19:36:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:36:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:36:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:36:19.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:36:19.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:265: TEST_backfill_out: delete_pool test 2024-05-08T19:36:19.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:36:19.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:36:19.570 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:36:19.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:266: TEST_backfill_out: kill_daemons td/osd-backfill-stats 2024-05-08T19:36:19.587 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:36:19.587 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:36:19.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:36:19.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:36:19.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:36:24.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:36:24.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:36:24.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:36:24.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:36:24.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:36:24.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:36:24.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:36:24.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:36:24.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:36:24.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:36:24.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:36:24.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:36:24.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:36:24.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:36:24.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:36:24.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:36:24.920 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:36:24.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:36:24.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:36:24.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:36:24.921 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:36:24.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:36:24.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:36:24.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:36:24.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:36:24.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:36:24.965 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:36:24.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:36:24.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:36:24.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:36:24.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:36:24.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:36:24.970 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:36:24.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:36:24.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:36:24.971 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:36:24.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:36:24.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:36:24.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:36:24.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:36:24.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:36:24.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:36:24.972 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:36:24.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:36:24.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:36:24.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:36:24.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:36:24.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:36:24.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:36:24.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:36:24.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:36:24.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:36:24.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:36:24.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:36:24.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:36:24.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:36:24.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:36:24.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:36:24.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:36:24.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:36:24.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:36:24.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_out2 td/osd-backfill-stats 2024-05-08T19:36:24.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:329: TEST_backfill_out2: local dir=td/osd-backfill-stats 2024-05-08T19:36:24.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:331: TEST_backfill_out2: run_mon td/osd-backfill-stats a 2024-05-08T19:36:24.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:36:24.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:36:24.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:36:24.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:36:24.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:36:24.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:36:25.412 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:36:25.412 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:36:25.412 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:36:25.413 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:36:25.413 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:36:25.413 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:36:25.413 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:36:25.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:36:25.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:36:25.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:36:25.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:36:25.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:36:25.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:36:25.632 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:36:25.632 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:36:25.632 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:36:25.632 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:36:25.633 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:36:25.633 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:36:25.633 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:36:25.633 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:36:25.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:36:25.633 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:36:25.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:36:25.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:36:25.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:36:25.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:36:25.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:36:25.752 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:36:25.752 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:36:25.752 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:36:25.752 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:36:25.753 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:36:25.753 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:36:25.753 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:36:25.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:36:25.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:36:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:332: TEST_backfill_out2: run_mgr td/osd-backfill-stats x 2024-05-08T19:36:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:36:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:36:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:36:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:36:25.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:36:25.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:36:26.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:36:26.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:36:26.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:36:26.803 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:36:26.804 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:36:26.804 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:36:26.804 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:36:26.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:36:26.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:333: TEST_backfill_out2: run_osd td/osd-backfill-stats 0 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:36:26.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:36:26.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:36:26.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:36:26.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b897c5e1-1017-43a6-afbc-1fd92e1fd5e0 2024-05-08T19:36:26.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 b897c5e1-1017-43a6-afbc-1fd92e1fd5e0' 2024-05-08T19:36:26.848 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 b897c5e1-1017-43a6-afbc-1fd92e1fd5e0 2024-05-08T19:36:26.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:36:26.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA61DtmFMQrNBAApdxTBNfZuOnRns9p87N/Rw== 2024-05-08T19:36:26.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA61DtmFMQrNBAApdxTBNfZuOnRns9p87N/Rw=="}' 2024-05-08T19:36:26.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b897c5e1-1017-43a6-afbc-1fd92e1fd5e0 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:36:27.193 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:36:27.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:36:27.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA61DtmFMQrNBAApdxTBNfZuOnRns9p87N/Rw== --osd-uuid b897c5e1-1017-43a6-afbc-1fd92e1fd5e0 2024-05-08T19:36:27.242 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:27.246+0000 7f3d26e7d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:36:27.270 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:27.274+0000 7f3d26e7d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:36:27.272 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:27.278+0000 7f3d26e7d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:36:27.272 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:27.278+0000 7f3d26e7d7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:36:27.272 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:27.278+0000 7f3d26e7d7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:36:27.272 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:27.278+0000 7f3d26e7d7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:36:27.310 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:27.314+0000 7f3d26e7d7c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:36:33.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:36:33.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:36:33.663 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:36:33.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:36:33.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:36:34.218 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:36:34.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:36:34.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:36:34.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:36:34.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:36:34.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:36:34.252 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:34.258+0000 7f99deb2f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:36:34.254 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:34.258+0000 7f99deb2f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:36:34.255 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:34.258+0000 7f99deb2f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:36:34.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:36:34.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:36:34.609 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:36:34.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:36:34.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:36:34.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:36:34.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:34.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:36:34.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:34.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:34.790 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:34.794+0000 7f99deb2f7c0 -1 Falling back to public interface 2024-05-08T19:36:34.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:36.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:36.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:36.001 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:36:36.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:36:36.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:36.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:36.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:37.288 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:36:37.294+0000 7f99deb2f7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:36:37.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:37.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:37.417 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:36:37.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:36:37.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:37.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:38.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:39.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:39.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:39.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:36:39.069 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:36:39.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:39.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:39.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:40.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:40.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:40.550 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:36:40.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:36:40.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:40.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:40.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:41.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:41.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:41.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:36:41.974 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:36:41.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:41.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:42.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:43.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:43.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:43.500 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:36:43.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:36:43.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:43.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:44.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:45.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:45.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:45.018 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:36:45.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:36:45.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:45.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:45.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:46.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:46.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:46.504 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:36:46.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:36:46.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:46.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:46.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:47.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:47.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:47.924 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:36:47.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:36:47.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:47.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:48.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:49.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:49.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:49.507 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:36:49.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:36:49.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:49.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:49.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:50.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:50.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:50.976 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:36:50.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:36:50.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:50.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:51.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:52.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:52.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:52.517 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:36:52.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:36:52.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:52.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:53.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:54.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:55.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:56.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:56.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:56.199 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:36:56.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:36:56.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:56.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:57.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:36:58.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:36:58.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:36:58.127 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:36:58.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:36:58.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:36:58.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:36:59.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:00.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:00.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:00.003 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:37:00.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:37:00.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:00.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:37:00.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:01.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:01.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:01.873 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:37:01.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:37:01.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:01.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:37:02.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:03.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:03.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:03.780 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:37:03.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:37:03.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:03.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:37:04.200 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4183196081,v1:127.0.0.1:6803/4183196081] [v2:127.0.0.1:6804/4183196081,v1:127.0.0.1:6805/4183196081] exists,up b897c5e1-1017-43a6-afbc-1fd92e1fd5e0 2024-05-08T19:37:04.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:37:04.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:37:04.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:37:04.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:334: TEST_backfill_out2: run_osd td/osd-backfill-stats 1 2024-05-08T19:37:04.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:37:04.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:37:04.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:37:04.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:37:04.204 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:37:04.205 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:37:04.205 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:37:04.205 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:37:04.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:37:04.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:37:04.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:37:04.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:37:04.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=23dc532e-944b-4006-9423-2c707299abf4 2024-05-08T19:37:04.207 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 23dc532e-944b-4006-9423-2c707299abf4 2024-05-08T19:37:04.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 23dc532e-944b-4006-9423-2c707299abf4' 2024-05-08T19:37:04.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:37:04.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBg1Dtm7sVSDhAAFfAG6tNGx9R5omoTPdaqPA== 2024-05-08T19:37:04.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBg1Dtm7sVSDhAAFfAG6tNGx9R5omoTPdaqPA=="}' 2024-05-08T19:37:04.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 23dc532e-944b-4006-9423-2c707299abf4 -i td/osd-backfill-stats/1/new.json 2024-05-08T19:37:04.708 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:37:04.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:37:04.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBg1Dtm7sVSDhAAFfAG6tNGx9R5omoTPdaqPA== --osd-uuid 23dc532e-944b-4006-9423-2c707299abf4 2024-05-08T19:37:04.753 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:04.762+0000 7f658999d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:04.777 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:04.786+0000 7f658999d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:04.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:04.786+0000 7f658999d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:04.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:04.786+0000 7f658999d7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:37:04.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:04.786+0000 7f658999d7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:37:04.779 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:04.786+0000 7f658999d7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:37:04.809 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:04.818+0000 7f658999d7c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:37:11.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:37:11.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:37:11.818 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:37:11.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:37:11.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:37:12.396 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:37:12.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:37:12.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:37:12.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:37:12.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:37:12.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:37:12.429 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:12.438+0000 7fb380b257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:12.456 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:12.466+0000 7fb380b257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:12.457 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:12.466+0000 7fb380b257c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:12.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:37:12.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:37:12.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:37:12.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:37:12.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:37:12.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:12.814 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:37:12.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:37:12.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:12.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:13.041 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:13.050+0000 7fb380b257c0 -1 Falling back to public interface 2024-05-08T19:37:13.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:14.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:14.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:14.262 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:37:14.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:37:14.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:14.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:14.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:15.524 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:15.534+0000 7fb380b257c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:37:15.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:15.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:15.671 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:37:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:37:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:17.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:17.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:17.296 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:37:17.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:37:17.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:17.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:17.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:18.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:18.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:18.847 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:37:18.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:37:18.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:18.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:19.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:20.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:20.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:20.480 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:37:20.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:37:20.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:20.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:20.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:21.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:21.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:21.977 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:37:21.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:37:21.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:21.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:22.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:23.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:23.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:23.591 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:37:23.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:37:23.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:23.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:24.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:25.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:25.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:25.009 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:37:25.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:37:25.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:25.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:25.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:26.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:26.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:26.574 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:37:26.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:37:26.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:26.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:27.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:28.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:28.028 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:28.029 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:37:28.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:37:28.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:28.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:28.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:29.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:29.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:29.571 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:37:29.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:37:29.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:29.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:31.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:31.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:31.209 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:37:31.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:37:31.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:31.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:31.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:32.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:32.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:32.809 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:37:32.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:37:32.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:32.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:33.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:34.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:34.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:34.531 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:37:34.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:37:34.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:34.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:35.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:36.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:36.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:36.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:37:36.184 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:37:36.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:36.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:37.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:38.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:38.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:38.294 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:37:38.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:37:38.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:38.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:39.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:40.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:40.226 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:37:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:37:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:40.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:41.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:42.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:42.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:42.302 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:37:42.302 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:37:42.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:42.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:37:42.746 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3327322095,v1:127.0.0.1:6811/3327322095] [v2:127.0.0.1:6812/3327322095,v1:127.0.0.1:6813/3327322095] exists,up 23dc532e-944b-4006-9423-2c707299abf4 2024-05-08T19:37:42.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:335: TEST_backfill_out2: run_osd td/osd-backfill-stats 2 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:37:42.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:37:42.750 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:37:42.751 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:37:42.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:37:42.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:37:42.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:37:42.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:37:42.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:37:42.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:37:42.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7997c9b3-85f7-403c-824d-48518972745a 2024-05-08T19:37:42.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 7997c9b3-85f7-403c-824d-48518972745a' 2024-05-08T19:37:42.753 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 7997c9b3-85f7-403c-824d-48518972745a 2024-05-08T19:37:42.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:37:42.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCG1DtmRASNLhAAy61a+Mivdrn7kN0KtJ8Xgw== 2024-05-08T19:37:42.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCG1DtmRASNLhAAy61a+Mivdrn7kN0KtJ8Xgw=="}' 2024-05-08T19:37:42.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7997c9b3-85f7-403c-824d-48518972745a -i td/osd-backfill-stats/2/new.json 2024-05-08T19:37:43.251 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:37:43.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:37:43.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCG1DtmRASNLhAAy61a+Mivdrn7kN0KtJ8Xgw== --osd-uuid 7997c9b3-85f7-403c-824d-48518972745a 2024-05-08T19:37:43.304 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:43.313+0000 7fbbd121d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:43.337 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:43.345+0000 7fbbd121d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:43.338 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:43.345+0000 7fbbd121d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:43.339 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:43.345+0000 7fbbd121d7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:37:43.339 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:43.345+0000 7fbbd121d7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:37:43.339 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:43.345+0000 7fbbd121d7c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:37:43.376 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:43.385+0000 7fbbd121d7c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:37:50.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:37:50.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:37:50.428 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:37:50.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:37:50.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:37:50.986 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:37:50.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:37:50.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:37:50.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:37:50.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:37:50.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:37:51.019 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:51.025+0000 7f2d66ade7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:51.021 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:51.029+0000 7f2d66ade7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:51.022 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:51.029+0000 7f2d66ade7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:37:51.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:37:51.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:37:51.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:37:51.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:37:51.440 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:37:51.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:37:51.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:51.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:37:51.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:51.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:37:51.577 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:51.585+0000 7f2d66ade7c0 -1 Falling back to public interface 2024-05-08T19:37:51.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:52.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:52.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:52.879 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:37:52.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:37:52.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:52.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:37:53.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:54.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:54.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:54.308 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:37:54.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:37:54.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:54.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:37:54.367 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:37:54.373+0000 7f2d66ade7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:37:54.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:55.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:55.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:55.924 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:37:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:37:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:55.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:37:56.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:57.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:57.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:57.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:37:57.433 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:37:57.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:57.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:37:57.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:37:58.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:37:58.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:37:58.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:37:58.892 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:37:58.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:37:58.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:37:59.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:00.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:00.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:00.421 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:38:00.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:38:00.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:00.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:00.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:01.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:01.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:01.862 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:38:01.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:38:01.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:01.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:02.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:03.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:03.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:03.327 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:38:03.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:38:03.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:03.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:03.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:04.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:04.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:04.828 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:38:04.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:38:04.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:04.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:05.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:06.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:06.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:06.359 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:38:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:38:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:06.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:06.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:07.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:07.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:07.814 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:38:07.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:38:07.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:07.815 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:08.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:09.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:09.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:09.535 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:38:09.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:38:09.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:09.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:10.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:11.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:11.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:11.511 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:38:11.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:38:11.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:11.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:12.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:13.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:13.027 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:38:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:38:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:13.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:13.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:14.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:14.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:14.782 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:38:14.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:38:14.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:14.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:15.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:16.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:16.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:16.644 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:38:16.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:38:16.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:16.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:17.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:18.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:18.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:18.968 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:38:18.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:38:18.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:18.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:19.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:20.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:20.899 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:20.899 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:38:20.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:38:20.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:20.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:38:21.302 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/832739369,v1:127.0.0.1:6819/832739369] [v2:127.0.0.1:6820/832739369,v1:127.0.0.1:6821/832739369] exists,up 7997c9b3-85f7-403c-824d-48518972745a 2024-05-08T19:38:21.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:38:21.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:38:21.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:38:21.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:336: TEST_backfill_out2: run_osd td/osd-backfill-stats 3 2024-05-08T19:38:21.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:38:21.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:38:21.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:38:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:38:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:38:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:38:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:38:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:38:21.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:38:21.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b61925b6-9533-4baf-a475-e393081d1c8d 2024-05-08T19:38:21.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 b61925b6-9533-4baf-a475-e393081d1c8d' 2024-05-08T19:38:21.310 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 b61925b6-9533-4baf-a475-e393081d1c8d 2024-05-08T19:38:21.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:38:21.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCt1Dtm3G8QFBAAXMbeEC/DYg3hXldudzD8rA== 2024-05-08T19:38:21.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCt1Dtm3G8QFBAAXMbeEC/DYg3hXldudzD8rA=="}' 2024-05-08T19:38:21.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b61925b6-9533-4baf-a475-e393081d1c8d -i td/osd-backfill-stats/3/new.json 2024-05-08T19:38:21.824 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:38:21.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:38:21.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCt1Dtm3G8QFBAAXMbeEC/DYg3hXldudzD8rA== --osd-uuid b61925b6-9533-4baf-a475-e393081d1c8d 2024-05-08T19:38:21.876 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:21.884+0000 7f3af273c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:21.903 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:21.912+0000 7f3af273c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:21.904 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:21.912+0000 7f3af273c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:21.905 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:21.912+0000 7f3af273c7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:38:21.905 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:21.912+0000 7f3af273c7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:38:21.905 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:21.912+0000 7f3af273c7c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:38:21.942 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:21.948+0000 7f3af273c7c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:38:28.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:38:28.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:38:28.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:38:28.751 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:38:28.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:38:29.299 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:38:29.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:38:29.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:38:29.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:38:29.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:38:29.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:38:29.332 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:29.340+0000 7faabee0c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:29.335 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:29.340+0000 7faabee0c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:29.336 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:29.344+0000 7faabee0c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:29.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:38:29.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:38:29.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:38:29.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:38:29.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:38:29.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:29.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:38:29.799 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:38:29.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:29.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:29.905 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:29.912+0000 7faabee0c7c0 -1 Falling back to public interface 2024-05-08T19:38:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:31.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:31.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:31.209 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:38:31.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:38:31.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:31.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:31.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:32.525 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:32.532+0000 7faabee0c7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:38:32.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:32.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:32.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:38:32.645 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:38:32.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:32.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:33.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:34.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:34.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:34.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:38:34.310 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:38:34.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:34.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:34.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:35.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:35.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:35.877 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:38:35.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:38:35.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:35.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:36.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:37.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:37.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:37.367 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:38:37.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:38:37.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:37.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:37.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:38.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:38.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:38.823 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:38:38.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:38:38.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:38.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:39.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:40.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:40.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:40.398 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:38:40.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:38:40.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:40.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:40.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:41.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:41.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:41.832 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:38:41.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:38:41.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:41.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:42.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:43.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:43.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:43.380 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:38:43.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:38:43.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:43.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:43.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:44.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:44.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:44.848 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:38:44.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:38:44.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:44.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:45.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:46.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:46.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:46.438 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:38:46.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:38:46.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:46.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:46.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:47.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:47.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:47.923 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:38:47.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:38:47.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:47.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:48.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:49.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:49.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:49.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:38:49.960 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:38:49.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:49.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:51.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:52.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:52.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:52.054 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:38:52.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:38:52.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:52.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:53.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:54.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:54.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:54.218 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:38:54.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:38:54.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:54.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:55.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:56.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:56.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:56.341 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:38:56.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:38:56.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:56.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:57.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:38:58.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:38:58.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:38:58.282 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:38:58.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:38:58.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:38:58.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:38:58.799 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1933566140,v1:127.0.0.1:6827/1933566140] [v2:127.0.0.1:6828/1933566140,v1:127.0.0.1:6829/1933566140] exists,up b61925b6-9533-4baf-a475-e393081d1c8d 2024-05-08T19:38:58.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:337: TEST_backfill_out2: run_osd td/osd-backfill-stats 4 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:38:58.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:38:58.803 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:38:58.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:38:58.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:38:58.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:38:58.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:38:58.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:38:58.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2a782e86-e22a-4ed1-aea7-83f06b0ffcaa 2024-05-08T19:38:58.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 2a782e86-e22a-4ed1-aea7-83f06b0ffcaa' 2024-05-08T19:38:58.806 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 2a782e86-e22a-4ed1-aea7-83f06b0ffcaa 2024-05-08T19:38:58.806 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:38:58.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDS1DtmDY78MRAAi5Vg9p3xwvSU3RrkY5Y3IA== 2024-05-08T19:38:58.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDS1DtmDY78MRAAi5Vg9p3xwvSU3RrkY5Y3IA=="}' 2024-05-08T19:38:58.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2a782e86-e22a-4ed1-aea7-83f06b0ffcaa -i td/osd-backfill-stats/4/new.json 2024-05-08T19:38:59.352 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:38:59.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:38:59.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDS1DtmDY78MRAAi5Vg9p3xwvSU3RrkY5Y3IA== --osd-uuid 2a782e86-e22a-4ed1-aea7-83f06b0ffcaa 2024-05-08T19:38:59.406 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:59.412+0000 7f6836af77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:59.469 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:59.476+0000 7f6836af77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:59.470 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:59.476+0000 7f6836af77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:38:59.471 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:59.476+0000 7f6836af77c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:38:59.471 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:59.476+0000 7f6836af77c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:38:59.471 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:59.480+0000 7f6836af77c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:38:59.560 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:38:59.568+0000 7f6836af77c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:39:06.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:39:06.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:39:06.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:39:06.594 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:39:06.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:39:07.153 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:39:07.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:39:07.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:39:07.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:39:07.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:39:07.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:39:07.186 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:07.191+0000 7f74467d37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:07.188 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:07.195+0000 7f74467d37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:07.190 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:07.195+0000 7f74467d37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:07.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:39:07.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:39:07.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:39:07.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:39:07.612 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:39:07.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:39:07.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:07.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:39:07.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:07.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:07.748 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:07.755+0000 7f74467d37c0 -1 Falling back to public interface 2024-05-08T19:39:08.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:09.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:09.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:09.035 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:39:09.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:39:09.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:09.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:09.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:10.448 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:10.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:10.449 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:39:10.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:39:10.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:10.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:10.539 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:10.543+0000 7f74467d37c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:39:10.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:11.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:11.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:11.939 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:39:11.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:39:11.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:11.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:12.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:13.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:13.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:13.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:39:13.362 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:39:13.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:13.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:13.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:14.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:14.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:14.805 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:39:14.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:39:14.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:14.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:15.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:16.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:16.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:16.257 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:39:16.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:39:16.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:16.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:16.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:17.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:17.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:17.781 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:39:17.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:39:17.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:17.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:18.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:19.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:19.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:19.351 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:39:19.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:39:19.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:19.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:19.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:20.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:20.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:20.796 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:39:20.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:39:20.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:20.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:21.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:22.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:22.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:22.300 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:39:22.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:39:22.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:22.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:22.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:23.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:23.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:23.793 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:39:23.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:39:23.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:23.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:24.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:25.335 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:25.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:25.336 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:39:25.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:39:25.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:25.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:25.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:26.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:26.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:26.895 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:39:26.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:39:26.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:26.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:27.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:28.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:28.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:28.569 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:39:28.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:39:28.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:28.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:29.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:30.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:30.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:30.671 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:39:30.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:39:30.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:30.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:31.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:32.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:32.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:32.535 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:39:32.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:39:32.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:32.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:33.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:34.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:34.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:34.353 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:39:34.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:39:34.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:34.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:35.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:36.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:36.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:36.014 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:39:36.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:39:36.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:36.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:36.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:37.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:37.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:37.744 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:39:37.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:39:37.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:37.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:38.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:39.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:39.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:39.434 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:39:39.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:39:39.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:39.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:39:39.864 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2293168422,v1:127.0.0.1:6835/2293168422] [v2:127.0.0.1:6836/2293168422,v1:127.0.0.1:6837/2293168422] exists,up 2a782e86-e22a-4ed1-aea7-83f06b0ffcaa 2024-05-08T19:39:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:39:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:39:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:39:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:338: TEST_backfill_out2: run_osd td/osd-backfill-stats 5 2024-05-08T19:39:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:39:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:39:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/5 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:39:39.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:39:39.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:39:39.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:39:39.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:39:39.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:39:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:39:39.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:39:39.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:39:39.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:39:39.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/5 2024-05-08T19:39:39.870 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:39:39.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ed7a8b9c-657a-4b62-b2ae-f00f95be9bb2 2024-05-08T19:39:39.870 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 ed7a8b9c-657a-4b62-b2ae-f00f95be9bb2 2024-05-08T19:39:39.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 ed7a8b9c-657a-4b62-b2ae-f00f95be9bb2' 2024-05-08T19:39:39.871 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:39:39.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD71DtmlaKYNRAA2uh8qKKrdozdIcTqXtqyXg== 2024-05-08T19:39:39.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD71DtmlaKYNRAA2uh8qKKrdozdIcTqXtqyXg=="}' 2024-05-08T19:39:39.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ed7a8b9c-657a-4b62-b2ae-f00f95be9bb2 -i td/osd-backfill-stats/5/new.json 2024-05-08T19:39:40.588 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:39:40.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/5/new.json 2024-05-08T19:39:40.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD71DtmlaKYNRAA2uh8qKKrdozdIcTqXtqyXg== --osd-uuid ed7a8b9c-657a-4b62-b2ae-f00f95be9bb2 2024-05-08T19:39:40.645 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:40.651+0000 7f0e3244f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:40.647 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:40.655+0000 7f0e3244f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:40.649 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:40.655+0000 7f0e3244f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:40.649 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:40.655+0000 7f0e3244f7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:39:40.650 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:40.655+0000 7f0e3244f7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:39:40.650 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:40.655+0000 7f0e3244f7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:39:40.752 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:40.759+0000 7f0e3244f7c0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-05-08T19:39:47.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-05-08T19:39:47.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:39:47.683 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T19:39:47.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T19:39:47.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:39:48.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T19:39:48.247 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T19:39:48.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:39:48.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:39:48.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:39:48.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:39:48.280 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:48.287+0000 7fcdf46827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:48.294 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:48.299+0000 7fcdf46827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:48.296 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:48.303+0000 7fcdf46827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:39:48.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T19:39:48.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:39:48.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T19:39:48.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:39:48.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:39:48.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:48.692 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:39:48.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:39:48.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:39:48.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:48.875+0000 7fcdf46827c0 -1 Falling back to public interface 2024-05-08T19:39:49.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:50.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:50.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:50.152 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:39:50.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:39:50.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:50.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:39:50.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:51.545 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:39:51.551+0000 7fcdf46827c0 -1 osd.5 0 log_to_monitors true 2024-05-08T19:39:51.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:51.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:51.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:39:51.572 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:39:51.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:51.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:39:52.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:53.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:53.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:53.085 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:39:53.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:39:53.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:53.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:39:53.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:54.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:54.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:54.522 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:39:54.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:39:54.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:54.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:39:55.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:56.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:56.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:56.121 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:39:56.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:39:56.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:56.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:39:56.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:57.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:57.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:57.685 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:39:57.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:39:57.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:57.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:39:58.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:39:59.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:39:59.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:39:59.273 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:39:59.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:39:59.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:39:59.274 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:39:59.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:00.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:00.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:00.699 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:40:00.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:40:00.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:00.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:01.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:02.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:02.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:02.136 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:40:02.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:40:02.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:02.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:02.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:03.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:03.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:03.572 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:40:03.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:40:03.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:03.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:04.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:05.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:05.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:05.073 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:40:05.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:40:05.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:05.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:05.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:06.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:06.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:06.520 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:40:06.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:40:06.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:06.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:07.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:08.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:08.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:08.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:40:08.425 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:40:08.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:08.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:09.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:10.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:10.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:10.201 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:40:10.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:40:10.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:10.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:11.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:12.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:12.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:12.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:40:12.159 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:40:12.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:12.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:13.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:14.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:14.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:14.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:40:14.140 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:40:14.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:14.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:14.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:15.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:15.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:15.560 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:40:15.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:40:15.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:15.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:16.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:17.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:17.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:17.183 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:40:17.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:40:17.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:17.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:17.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:40:18.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:40:18.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:40:18.708 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:40:18.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:40:18.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:40:18.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:40:19.130 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/908202902,v1:127.0.0.1:6843/908202902] [v2:127.0.0.1:6844/908202902,v1:127.0.0.1:6845/908202902] exists,up ed7a8b9c-657a-4b62-b2ae-f00f95be9bb2 2024-05-08T19:40:19.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:40:19.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:40:19.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:40:19.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:340: TEST_backfill_out2: create_pool test 1 1 2024-05-08T19:40:19.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T19:40:19.695 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:40:19.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:40:20.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:341: TEST_backfill_out2: ceph osd pool set test size 2 2024-05-08T19:40:22.079 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T19:40:22.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:342: TEST_backfill_out2: sleep 5 2024-05-08T19:40:27.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:344: TEST_backfill_out2: wait_for_clean 2024-05-08T19:40:27.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:40:27.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:40:27.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:40:27.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:40:27.102 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:40:27.102 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:40:27.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:40:27.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:40:27.103 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:40:27.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:40:27.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:40:27.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:40:27.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:40:27.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:40:27.228 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:40:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:40:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:40:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:40:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:40:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:40:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:40:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:40:27.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:40:27.678 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:40:27.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836527 2024-05-08T19:40:27.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836527 2024-05-08T19:40:27.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836527' 2024-05-08T19:40:27.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:40:27.875 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:40:28.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672999 2024-05-08T19:40:28.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672999 2024-05-08T19:40:28.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836527 1-42949672999' 2024-05-08T19:40:28.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:40:28.031 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:40:28.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509474 2024-05-08T19:40:28.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509474 2024-05-08T19:40:28.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836527 1-42949672999 2-64424509474' 2024-05-08T19:40:28.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:40:28.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:40:28.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345946 2024-05-08T19:40:28.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345946 2024-05-08T19:40:28.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836527 1-42949672999 2-64424509474 3-85899345946' 2024-05-08T19:40:28.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:40:28.324 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:40:28.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182416 2024-05-08T19:40:28.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182416 2024-05-08T19:40:28.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836527 1-42949672999 2-64424509474 3-85899345946 4-107374182416' 2024-05-08T19:40:28.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:40:28.471 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:40:28.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018896 2024-05-08T19:40:28.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018896 2024-05-08T19:40:28.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836527 1-42949672999 2-64424509474 3-85899345946 4-107374182416 5-128849018896' 2024-05-08T19:40:28.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:40:28.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836527 2024-05-08T19:40:28.616 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:40:28.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:40:28.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836527 2024-05-08T19:40:28.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:40:28.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836527 2024-05-08T19:40:28.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836527' 2024-05-08T19:40:28.619 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836527 2024-05-08T19:40:28.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:40:29.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836525 -lt 21474836527 2024-05-08T19:40:29.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:40:30.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:40:30.014 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:40:30.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836528 -lt 21474836527 2024-05-08T19:40:30.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:40:30.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672999 2024-05-08T19:40:30.428 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:40:30.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:40:30.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672999 2024-05-08T19:40:30.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:40:30.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672999 2024-05-08T19:40:30.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672999' 2024-05-08T19:40:30.433 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672999 2024-05-08T19:40:30.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:40:30.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672999 -lt 42949672999 2024-05-08T19:40:30.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:40:30.894 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509474 2024-05-08T19:40:30.894 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:40:30.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:40:30.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509474 2024-05-08T19:40:30.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:40:30.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509474 2024-05-08T19:40:30.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509474' 2024-05-08T19:40:30.898 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509474 2024-05-08T19:40:30.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:40:31.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509474 -lt 64424509474 2024-05-08T19:40:31.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:40:31.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345946 2024-05-08T19:40:31.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:40:31.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:40:31.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345946 2024-05-08T19:40:31.343 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:40:31.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345946 2024-05-08T19:40:31.344 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345946 2024-05-08T19:40:31.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345946' 2024-05-08T19:40:31.344 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:40:31.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345947 -lt 85899345946 2024-05-08T19:40:31.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:40:31.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182416 2024-05-08T19:40:31.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:40:31.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:40:31.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:40:31.794 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182416 2024-05-08T19:40:31.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182416 2024-05-08T19:40:31.795 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182416 2024-05-08T19:40:31.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182416' 2024-05-08T19:40:31.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:40:32.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182417 -lt 107374182416 2024-05-08T19:40:32.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:40:32.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018896 2024-05-08T19:40:32.243 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:40:32.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:40:32.245 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018896 2024-05-08T19:40:32.245 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:40:32.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018896 2024-05-08T19:40:32.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018896' 2024-05-08T19:40:32.246 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018896 2024-05-08T19:40:32.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:40:32.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018897 -lt 128849018896 2024-05-08T19:40:32.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:40:32.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:40:32.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:40:33.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:40:33.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:40:33.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:40:33.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:40:33.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:40:33.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:40:33.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:40:33.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:40:33.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:40:33.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:40:33.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:40:33.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:40:34.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:40:34.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:40:34.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:40:34.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: seq 1 200 2024-05-08T19:40:34.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:34.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj1 /dev/null 2024-05-08T19:40:34.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:34.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj2 /dev/null 2024-05-08T19:40:34.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:34.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj3 /dev/null 2024-05-08T19:40:34.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:34.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj4 /dev/null 2024-05-08T19:40:34.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:34.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj5 /dev/null 2024-05-08T19:40:34.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:34.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj6 /dev/null 2024-05-08T19:40:35.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:35.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj7 /dev/null 2024-05-08T19:40:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:35.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj8 /dev/null 2024-05-08T19:40:35.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:35.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj9 /dev/null 2024-05-08T19:40:35.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:35.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj10 /dev/null 2024-05-08T19:40:35.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:35.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj11 /dev/null 2024-05-08T19:40:35.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:35.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj12 /dev/null 2024-05-08T19:40:35.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:35.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj13 /dev/null 2024-05-08T19:40:36.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:36.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj14 /dev/null 2024-05-08T19:40:36.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:36.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj15 /dev/null 2024-05-08T19:40:36.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:36.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj16 /dev/null 2024-05-08T19:40:36.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:36.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj17 /dev/null 2024-05-08T19:40:36.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:36.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj18 /dev/null 2024-05-08T19:40:36.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:36.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj19 /dev/null 2024-05-08T19:40:36.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:36.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj20 /dev/null 2024-05-08T19:40:36.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:36.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj21 /dev/null 2024-05-08T19:40:37.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:37.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj22 /dev/null 2024-05-08T19:40:37.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:37.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj23 /dev/null 2024-05-08T19:40:37.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:37.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj24 /dev/null 2024-05-08T19:40:37.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:37.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj25 /dev/null 2024-05-08T19:40:37.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:37.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj26 /dev/null 2024-05-08T19:40:37.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:37.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj27 /dev/null 2024-05-08T19:40:37.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:37.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj28 /dev/null 2024-05-08T19:40:38.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:38.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj29 /dev/null 2024-05-08T19:40:38.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:38.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj30 /dev/null 2024-05-08T19:40:38.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:38.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj31 /dev/null 2024-05-08T19:40:38.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:38.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj32 /dev/null 2024-05-08T19:40:38.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:38.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj33 /dev/null 2024-05-08T19:40:38.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:38.736 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj34 /dev/null 2024-05-08T19:40:38.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:38.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj35 /dev/null 2024-05-08T19:40:38.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:38.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj36 /dev/null 2024-05-08T19:40:39.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:39.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj37 /dev/null 2024-05-08T19:40:39.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:39.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj38 /dev/null 2024-05-08T19:40:39.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:39.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj39 /dev/null 2024-05-08T19:40:39.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:39.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj40 /dev/null 2024-05-08T19:40:39.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:39.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj41 /dev/null 2024-05-08T19:40:39.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:39.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj42 /dev/null 2024-05-08T19:40:39.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:39.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj43 /dev/null 2024-05-08T19:40:40.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:40.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj44 /dev/null 2024-05-08T19:40:40.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:40.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj45 /dev/null 2024-05-08T19:40:40.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:40.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj46 /dev/null 2024-05-08T19:40:40.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:40.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj47 /dev/null 2024-05-08T19:40:40.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:40.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj48 /dev/null 2024-05-08T19:40:40.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:40.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj49 /dev/null 2024-05-08T19:40:40.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:40.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj50 /dev/null 2024-05-08T19:40:41.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:41.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj51 /dev/null 2024-05-08T19:40:41.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:41.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj52 /dev/null 2024-05-08T19:40:41.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:41.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj53 /dev/null 2024-05-08T19:40:41.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:41.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj54 /dev/null 2024-05-08T19:40:41.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:41.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj55 /dev/null 2024-05-08T19:40:41.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:41.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj56 /dev/null 2024-05-08T19:40:41.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:41.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj57 /dev/null 2024-05-08T19:40:41.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:41.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj58 /dev/null 2024-05-08T19:40:42.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:42.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj59 /dev/null 2024-05-08T19:40:42.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:42.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj60 /dev/null 2024-05-08T19:40:42.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:42.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj61 /dev/null 2024-05-08T19:40:42.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:42.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj62 /dev/null 2024-05-08T19:40:42.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:42.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj63 /dev/null 2024-05-08T19:40:42.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:42.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj64 /dev/null 2024-05-08T19:40:42.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:42.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj65 /dev/null 2024-05-08T19:40:43.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:43.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj66 /dev/null 2024-05-08T19:40:43.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:43.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj67 /dev/null 2024-05-08T19:40:43.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:43.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj68 /dev/null 2024-05-08T19:40:43.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:43.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj69 /dev/null 2024-05-08T19:40:43.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:43.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj70 /dev/null 2024-05-08T19:40:43.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:43.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj71 /dev/null 2024-05-08T19:40:43.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:43.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj72 /dev/null 2024-05-08T19:40:44.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:44.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj73 /dev/null 2024-05-08T19:40:44.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:44.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj74 /dev/null 2024-05-08T19:40:44.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:44.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj75 /dev/null 2024-05-08T19:40:44.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:44.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj76 /dev/null 2024-05-08T19:40:44.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:44.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj77 /dev/null 2024-05-08T19:40:44.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:44.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj78 /dev/null 2024-05-08T19:40:44.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:44.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj79 /dev/null 2024-05-08T19:40:44.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:44.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj80 /dev/null 2024-05-08T19:40:45.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:45.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj81 /dev/null 2024-05-08T19:40:45.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:45.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj82 /dev/null 2024-05-08T19:40:45.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:45.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj83 /dev/null 2024-05-08T19:40:45.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:45.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj84 /dev/null 2024-05-08T19:40:45.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:45.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj85 /dev/null 2024-05-08T19:40:45.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:45.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj86 /dev/null 2024-05-08T19:40:45.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:45.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj87 /dev/null 2024-05-08T19:40:45.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:45.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj88 /dev/null 2024-05-08T19:40:46.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:46.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj89 /dev/null 2024-05-08T19:40:46.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:46.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj90 /dev/null 2024-05-08T19:40:46.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:46.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj91 /dev/null 2024-05-08T19:40:46.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:46.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj92 /dev/null 2024-05-08T19:40:46.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:46.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj93 /dev/null 2024-05-08T19:40:46.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:46.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj94 /dev/null 2024-05-08T19:40:46.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:46.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj95 /dev/null 2024-05-08T19:40:47.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:47.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj96 /dev/null 2024-05-08T19:40:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:47.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj97 /dev/null 2024-05-08T19:40:47.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:47.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj98 /dev/null 2024-05-08T19:40:47.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:47.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj99 /dev/null 2024-05-08T19:40:47.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:47.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj100 /dev/null 2024-05-08T19:40:47.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:47.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj101 /dev/null 2024-05-08T19:40:47.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:47.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj102 /dev/null 2024-05-08T19:40:48.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:48.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj103 /dev/null 2024-05-08T19:40:48.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:48.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj104 /dev/null 2024-05-08T19:40:48.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:48.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj105 /dev/null 2024-05-08T19:40:48.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:48.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj106 /dev/null 2024-05-08T19:40:48.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:48.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj107 /dev/null 2024-05-08T19:40:48.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:48.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj108 /dev/null 2024-05-08T19:40:48.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:48.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj109 /dev/null 2024-05-08T19:40:48.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:48.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj110 /dev/null 2024-05-08T19:40:49.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:49.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj111 /dev/null 2024-05-08T19:40:49.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:49.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj112 /dev/null 2024-05-08T19:40:49.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:49.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj113 /dev/null 2024-05-08T19:40:49.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:49.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj114 /dev/null 2024-05-08T19:40:49.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:49.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj115 /dev/null 2024-05-08T19:40:49.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:49.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj116 /dev/null 2024-05-08T19:40:49.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:49.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj117 /dev/null 2024-05-08T19:40:50.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:50.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj118 /dev/null 2024-05-08T19:40:50.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:50.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj119 /dev/null 2024-05-08T19:40:50.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:50.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj120 /dev/null 2024-05-08T19:40:50.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:50.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj121 /dev/null 2024-05-08T19:40:50.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:50.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj122 /dev/null 2024-05-08T19:40:50.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:50.840 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj123 /dev/null 2024-05-08T19:40:50.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:50.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj124 /dev/null 2024-05-08T19:40:51.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:51.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj125 /dev/null 2024-05-08T19:40:51.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:51.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj126 /dev/null 2024-05-08T19:40:51.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:51.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj127 /dev/null 2024-05-08T19:40:51.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:51.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj128 /dev/null 2024-05-08T19:40:51.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:51.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj129 /dev/null 2024-05-08T19:40:51.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:51.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj130 /dev/null 2024-05-08T19:40:51.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:51.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj131 /dev/null 2024-05-08T19:40:52.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:52.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj132 /dev/null 2024-05-08T19:40:52.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:52.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj133 /dev/null 2024-05-08T19:40:52.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:52.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj134 /dev/null 2024-05-08T19:40:52.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:52.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj135 /dev/null 2024-05-08T19:40:52.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:52.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj136 /dev/null 2024-05-08T19:40:52.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:52.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj137 /dev/null 2024-05-08T19:40:52.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:52.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj138 /dev/null 2024-05-08T19:40:52.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:52.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj139 /dev/null 2024-05-08T19:40:53.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:53.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj140 /dev/null 2024-05-08T19:40:53.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:53.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj141 /dev/null 2024-05-08T19:40:53.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:53.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj142 /dev/null 2024-05-08T19:40:53.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:53.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj143 /dev/null 2024-05-08T19:40:53.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:53.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj144 /dev/null 2024-05-08T19:40:54.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:54.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj145 /dev/null 2024-05-08T19:40:54.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:54.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj146 /dev/null 2024-05-08T19:40:54.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:54.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj147 /dev/null 2024-05-08T19:40:54.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:54.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj148 /dev/null 2024-05-08T19:40:54.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:54.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj149 /dev/null 2024-05-08T19:40:54.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:54.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj150 /dev/null 2024-05-08T19:40:54.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:54.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj151 /dev/null 2024-05-08T19:40:55.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:55.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj152 /dev/null 2024-05-08T19:40:55.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:55.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj153 /dev/null 2024-05-08T19:40:55.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:55.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj154 /dev/null 2024-05-08T19:40:55.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:55.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj155 /dev/null 2024-05-08T19:40:55.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:55.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj156 /dev/null 2024-05-08T19:40:55.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:55.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj157 /dev/null 2024-05-08T19:40:55.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:55.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj158 /dev/null 2024-05-08T19:40:56.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:56.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj159 /dev/null 2024-05-08T19:40:56.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:56.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj160 /dev/null 2024-05-08T19:40:56.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:56.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj161 /dev/null 2024-05-08T19:40:56.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:56.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj162 /dev/null 2024-05-08T19:40:56.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:56.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj163 /dev/null 2024-05-08T19:40:56.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:56.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj164 /dev/null 2024-05-08T19:40:56.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:56.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj165 /dev/null 2024-05-08T19:40:56.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:56.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj166 /dev/null 2024-05-08T19:40:57.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:57.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj167 /dev/null 2024-05-08T19:40:57.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:57.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj168 /dev/null 2024-05-08T19:40:57.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:57.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj169 /dev/null 2024-05-08T19:40:57.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:57.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj170 /dev/null 2024-05-08T19:40:57.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:57.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj171 /dev/null 2024-05-08T19:40:57.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:57.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj172 /dev/null 2024-05-08T19:40:57.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:57.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj173 /dev/null 2024-05-08T19:40:58.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:58.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj174 /dev/null 2024-05-08T19:40:58.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:58.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj175 /dev/null 2024-05-08T19:40:58.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:58.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj176 /dev/null 2024-05-08T19:40:58.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:58.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj177 /dev/null 2024-05-08T19:40:58.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:58.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj178 /dev/null 2024-05-08T19:40:58.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:58.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj179 /dev/null 2024-05-08T19:40:58.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:58.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj180 /dev/null 2024-05-08T19:40:59.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:59.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj181 /dev/null 2024-05-08T19:40:59.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:59.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj182 /dev/null 2024-05-08T19:40:59.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:59.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj183 /dev/null 2024-05-08T19:40:59.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:59.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj184 /dev/null 2024-05-08T19:40:59.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:59.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj185 /dev/null 2024-05-08T19:40:59.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:59.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj186 /dev/null 2024-05-08T19:40:59.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:40:59.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj187 /dev/null 2024-05-08T19:41:00.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:00.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj188 /dev/null 2024-05-08T19:41:00.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:00.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj189 /dev/null 2024-05-08T19:41:00.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:00.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj190 /dev/null 2024-05-08T19:41:00.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:00.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj191 /dev/null 2024-05-08T19:41:00.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:00.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj192 /dev/null 2024-05-08T19:41:00.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:00.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj193 /dev/null 2024-05-08T19:41:00.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:00.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj194 /dev/null 2024-05-08T19:41:00.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:00.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj195 /dev/null 2024-05-08T19:41:01.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:01.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj196 /dev/null 2024-05-08T19:41:01.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:01.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj197 /dev/null 2024-05-08T19:41:01.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:01.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj198 /dev/null 2024-05-08T19:41:01.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:01.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj199 /dev/null 2024-05-08T19:41:01.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-05-08T19:41:01.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj200 /dev/null 2024-05-08T19:41:01.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:351: TEST_backfill_out2: get_pg test obj1 2024-05-08T19:41:01.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:41:01.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:41:01.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:41:01.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:41:02.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:351: TEST_backfill_out2: local PG=1.0 2024-05-08T19:41:02.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:353: TEST_backfill_out2: get_primary test obj1 2024-05-08T19:41:02.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:41:02.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:41:02.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:41:02.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:41:02.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:353: TEST_backfill_out2: local primary=1 2024-05-08T19:41:02.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:354: TEST_backfill_out2: get_not_primary test obj1 2024-05-08T19:41:02.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T19:41:02.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T19:41:02.590 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T19:41:02.590 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:41:02.590 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:41:02.591 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:41:02.591 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:41:03.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T19:41:03.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T19:41:03.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T19:41:03.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:354: TEST_backfill_out2: local otherosd=0 2024-05-08T19:41:03.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:356: TEST_backfill_out2: ceph osd set nobackfill 2024-05-08T19:41:04.221 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:41:04.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:357: TEST_backfill_out2: ceph osd pool set test size 3 2024-05-08T19:41:04.965 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 3 2024-05-08T19:41:04.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:358: TEST_backfill_out2: ceph osd out osd.0 2024-05-08T19:41:05.871 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T19:41:05.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:359: TEST_backfill_out2: ceph osd out osd.1 2024-05-08T19:41:07.265 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T19:41:07.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:361: TEST_backfill_out2: sleep 2 2024-05-08T19:41:09.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:362: TEST_backfill_out2: get_primary test obj1 2024-05-08T19:41:09.291 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:41:09.292 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:41:09.292 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:41:09.292 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:41:09.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:362: TEST_backfill_out2: primary=1 2024-05-08T19:41:09.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:363: TEST_backfill_out2: ceph osd unset nobackfill 2024-05-08T19:41:10.566 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:41:10.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:364: TEST_backfill_out2: ceph tell osd.1 get_latest_osdmap 2024-05-08T19:41:10.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:365: TEST_backfill_out2: ceph tell osd.1 debug kick_recovery_wq 0 2024-05-08T19:41:10.941 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T19:41:10.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:366: TEST_backfill_out2: sleep 2 2024-05-08T19:41:12.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:368: TEST_backfill_out2: wait_for_clean 2024-05-08T19:41:12.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:41:12.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:41:12.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:41:12.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:41:12.959 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:41:12.959 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:41:12.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:41:12.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:41:12.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:41:13.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:41:13.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:41:13.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:41:13.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:41:13.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:41:13.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:41:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:41:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:41:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:41:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:41:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:41:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:41:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:41:13.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:41:13.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:41:13.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836539 2024-05-08T19:41:13.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836539 2024-05-08T19:41:13.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836539' 2024-05-08T19:41:13.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:41:13.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:41:14.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673010 2024-05-08T19:41:14.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673010 2024-05-08T19:41:14.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836539 1-42949673010' 2024-05-08T19:41:14.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:41:14.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:41:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509485 2024-05-08T19:41:14.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509485 2024-05-08T19:41:14.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836539 1-42949673010 2-64424509485' 2024-05-08T19:41:14.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:41:14.324 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:41:14.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345958 2024-05-08T19:41:14.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345958 2024-05-08T19:41:14.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836539 1-42949673010 2-64424509485 3-85899345958' 2024-05-08T19:41:14.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:41:14.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:41:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182428 2024-05-08T19:41:14.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182428 2024-05-08T19:41:14.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836539 1-42949673010 2-64424509485 3-85899345958 4-107374182428' 2024-05-08T19:41:14.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:41:14.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:41:14.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018908 2024-05-08T19:41:14.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018908 2024-05-08T19:41:14.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836539 1-42949673010 2-64424509485 3-85899345958 4-107374182428 5-128849018908' 2024-05-08T19:41:14.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:41:14.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836539 2024-05-08T19:41:14.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:41:14.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:41:14.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836539 2024-05-08T19:41:14.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:41:14.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836539 2024-05-08T19:41:14.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836539' 2024-05-08T19:41:14.983 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836539 2024-05-08T19:41:14.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:41:15.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836536 -lt 21474836539 2024-05-08T19:41:15.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:41:16.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:41:16.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:41:16.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836539 -lt 21474836539 2024-05-08T19:41:16.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:41:16.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673010 2024-05-08T19:41:16.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:41:16.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:41:16.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673010 2024-05-08T19:41:16.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:41:16.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673010 2024-05-08T19:41:16.855 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673010 2024-05-08T19:41:16.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673010' 2024-05-08T19:41:16.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:41:17.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673010 -lt 42949673010 2024-05-08T19:41:17.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:41:17.495 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509485 2024-05-08T19:41:17.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:41:17.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:41:17.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509485 2024-05-08T19:41:17.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:41:17.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509485 2024-05-08T19:41:17.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509485' 2024-05-08T19:41:17.499 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509485 2024-05-08T19:41:17.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:41:18.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509486 -lt 64424509485 2024-05-08T19:41:18.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:41:18.110 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345958 2024-05-08T19:41:18.110 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:41:18.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:41:18.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345958 2024-05-08T19:41:18.112 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:41:18.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345958 2024-05-08T19:41:18.113 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345958 2024-05-08T19:41:18.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345958' 2024-05-08T19:41:18.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:41:18.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345958 -lt 85899345958 2024-05-08T19:41:18.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:41:18.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182428 2024-05-08T19:41:18.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:41:18.551 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:41:18.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182428 2024-05-08T19:41:18.552 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:41:18.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182428 2024-05-08T19:41:18.553 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182428' 2024-05-08T19:41:18.554 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182428 2024-05-08T19:41:18.554 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:41:19.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182428 -lt 107374182428 2024-05-08T19:41:19.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:41:19.156 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018908 2024-05-08T19:41:19.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:41:19.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:41:19.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018908 2024-05-08T19:41:19.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:41:19.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018908 2024-05-08T19:41:19.161 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018908 2024-05-08T19:41:19.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018908' 2024-05-08T19:41:19.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:41:19.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018908 -lt 128849018908 2024-05-08T19:41:19.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:41:19.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:19.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:20.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:41:20.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:20.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:20.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:20.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:20.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:20.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:20.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:20.737 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:20.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:20.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:20.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:21.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:21.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:41:21.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:41:21.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:41:21.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:21.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:21.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:21.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:21.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:21.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:21.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:21.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:21.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:21.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:21.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:21.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:21.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:21.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:22.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:22.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:22.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:22.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:22.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:22.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:22.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:22.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:22.466 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:23.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T19:41:23.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T19:41:23.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:23.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:23.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:23.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:23.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:23.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:23.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:23.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:23.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:23.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:23.296 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:23.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:23.730 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:23.730 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:23.731 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:24.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:24.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:24.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:24.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:24.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:24.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:24.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:24.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:24.401 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:25.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:25.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:25.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:25.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:25.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:25.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:25.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:25.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:25.419 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:25.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:25.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:25.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:25.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:26.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:26.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:26.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:26.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:26.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:26.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:26.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:26.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:26.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:27.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:27.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:27.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:27.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:27.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:27.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:27.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:27.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:27.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:27.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:27.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:27.264 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:27.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:27.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:27.656 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:27.656 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:27.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:28.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:28.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:28.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:28.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:28.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:28.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:28.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:28.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:28.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:28.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:41:28.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:41:28.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:28.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:28.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:29.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:29.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:29.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:29.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:29.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:29.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:29.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:29.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:29.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:29.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:29.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:29.452 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:29.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:29.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:29.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:29.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:29.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:29.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:29.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:29.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:29.968 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:30.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:30.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:30.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:30.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:30.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:30.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:30.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:30.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:30.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:30.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:30.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:30.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:30.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:31.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:31.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:31.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:31.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:31.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:32.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:32.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:32.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:32.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:32.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:32.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:32.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:32.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:32.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:32.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:32.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:32.386 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:32.386 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:32.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:32.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:32.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:32.927 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:33.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:33.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:33.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:33.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:33.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:33.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:33.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:33.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:33.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:34.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:41:34.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:41:34.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:34.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:34.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:34.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:34.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:34.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:34.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:34.395 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:34.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:34.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:34.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:34.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:34.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:34.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:34.797 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:35.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:35.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:35.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:35.409 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:36.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:36.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:36.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:36.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:36.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:36.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:36.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:36.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:36.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:36.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:36.384 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:36.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:36.385 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:36.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:36.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:36.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:36.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:37.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:37.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:37.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:37.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:37.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:37.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:37.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:37.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:37.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:38.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:41:38.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:41:38.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:38.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:38.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:38.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:38.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:38.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:38.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:38.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:38.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:38.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:38.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:38.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:38.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:38.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:38.728 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:39.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:39.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:39.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:39.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:39.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:39.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:39.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:39.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:39.259 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:39.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:39.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:39.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:39.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:39.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:39.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:39.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:39.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:39.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:39.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:39.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:39.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:39.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:40.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:40.410 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:40.411 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:40.411 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:40.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:40.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:40.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:40.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:40.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:40.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:40.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:40.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:40.933 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:41.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:41.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:41.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:41.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:41.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:41.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:41.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:41.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:41.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:41.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:41.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:41.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:41.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:42.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:42.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:42.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:42.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:42.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:42.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:42.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:42.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:42.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:42.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:42.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:42.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:42.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:43.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:43.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:43.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:43.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:43.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:43.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:43.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:43.455 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:43.455 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:43.455 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:43.455 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:43.455 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:43.455 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:43.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:43.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:43.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:43.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:44.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:44.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:44.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:44.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:44.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:44.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:44.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:44.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:44.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:45.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:41:45.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:41:45.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:45.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:45.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:45.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:45.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:45.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:45.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:45.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:45.746 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:45.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:45.747 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:46.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:46.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:46.181 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:46.182 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:46.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:46.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:46.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:46.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:46.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:46.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:46.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:46.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:46.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:47.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:47.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:47.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:47.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:47.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:47.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:47.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:47.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:47.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:47.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:47.668 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:47.668 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:47.668 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:48.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:48.082 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:48.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:48.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:48.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:48.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:48.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:48.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:48.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:48.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:48.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:48.708 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:48.709 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:49.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:41:49.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:41:49.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:49.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:49.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:49.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:49.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:49.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:49.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:49.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:49.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:49.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:49.496 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:49.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:49.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:49.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:49.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:50.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:50.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:50.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:50.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:50.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:50.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:50.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:50.709 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:50.709 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:51.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:41:51.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:41:51.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:41:51.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:51.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:41:51.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:51.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:51.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:51.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:51.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:51.426 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:51.427 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:51.427 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:51.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:51.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:51.945 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:51.946 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:52.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:52.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:52.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:52.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:52.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:52.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:52.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:52.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:52.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:53.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T19:41:53.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T19:41:53.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 1 >= 13 )) 2024-05-08T19:41:53.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:53.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.2 2024-05-08T19:41:53.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:53.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:53.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:53.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:53.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:53.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:53.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:53.242 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:53.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:53.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:53.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:53.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:54.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:54.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:54.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:54.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:54.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:54.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:54.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:54.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:54.195 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:54.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T19:41:54.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T19:41:54.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 2 >= 13 )) 2024-05-08T19:41:54.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:54.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.4 2024-05-08T19:41:55.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:55.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:55.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:55.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:55.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:55.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:55.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:55.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:55.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:41:55.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:55.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:55.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:56.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:41:56.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:41:56.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:41:56.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:41:56.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:41:56.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:41:56.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:41:56.101 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:41:56.102 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:41:56.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2024-05-08T19:41:56.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2024-05-08T19:41:56.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: (( 3 >= 13 )) 2024-05-08T19:41:56.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:41:56.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.8 2024-05-08T19:41:57.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:41:57.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:41:57.463 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:41:57.463 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:41:57.463 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:41:57.463 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:41:57.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:41:57.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:41:57.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:41:57.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:41:57.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:41:57.884 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:41:58.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:41:58.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:41:58.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:41:58.427 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:370: TEST_backfill_out2: expr 200 '*' 2 2024-05-08T19:41:58.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:370: TEST_backfill_out2: local misplaced=400 2024-05-08T19:41:58.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:372: TEST_backfill_out2: check td/osd-backfill-stats 1.0 1 replicated 200 0 400 0 2024-05-08T19:41:58.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:41:58.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:41:58.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T19:41:58.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-05-08T19:41:58.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=200 2024-05-08T19:41:58.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:41:58.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=400 2024-05-08T19:41:58.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-05-08T19:41:58.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:41:58.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:41:58.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:41:58.430 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:41:58.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-05-08T19:41:58.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.454 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:41:58.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:41:58.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:41:58.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-05-08T19:41:58.456 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:41:58.456 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.456 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:41:58.456 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:41:58.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[2,4,3]/[1,0]' 2024-05-08T19:41:58.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[2,4,3]/[1,0]' ']' 2024-05-08T19:41:58.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:41:58.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:41:58.481 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.482 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [2,4,3]/[1,0] ' 2024-05-08T19:41:58.482 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:41:58.482 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:41:58.482 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:41:58.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=200 2024-05-08T19:41:58.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2024-05-08T19:41:58.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 200 200 2024-05-08T19:41:58.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-05-08T19:41:58.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:41:58.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-05-08T19:41:58.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:41:58.488 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:41:58.489 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.489 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:41:58.489 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=1 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 1 0 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:41:58.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:41:58.501 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.501 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [2,4,3]/[1,0] ' 2024-05-08T19:41:58.501 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:41:58.501 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:41:58.502 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=400 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 400 400 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:41:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:41:58.508 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:41:58.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=2 2024-05-08T19:41:58.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 2 ']' 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 2 0 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:374: TEST_backfill_out2: delete_pool test 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:41:58.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:41:59.033 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:41:59.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:375: TEST_backfill_out2: kill_daemons td/osd-backfill-stats 2024-05-08T19:41:59.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:41:59.050 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:41:59.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:41:59.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:41:59.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:42:04.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:42:04.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:42:04.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:42:04.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:42:04.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:42:04.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:42:04.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:42:04.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:42:04.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:42:04.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:42:04.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:42:04.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:42:04.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:42:04.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:42:04.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:42:04.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:42:04.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:42:04.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:04.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:42:04.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:42:04.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:04.384 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:42:04.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:42:04.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:42:04.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:42:04.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:04.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:04.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:42:04.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:42:04.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:42:04.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:42:04.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:42:04.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:42:04.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:42:04.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:42:04.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:42:04.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:42:04.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:04.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:42:04.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:42:04.438 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:04.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:42:04.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:42:04.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:42:04.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:42:04.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:04.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:04.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:42:04.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:42:04.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:42:04.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:42:04.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:42:04.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:04.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:04.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:42:04.445 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:42:04.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_remapped td/osd-backfill-stats 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:442: TEST_backfill_remapped: local dir=td/osd-backfill-stats 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:444: TEST_backfill_remapped: run_mon td/osd-backfill-stats a 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:42:04.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:42:04.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:42:04.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:42:04.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:42:04.843 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:42:04.844 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:04.844 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:04.844 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:42:04.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:42:05.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:42:05.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:42:05.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:42:05.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:42:05.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:42:05.095 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:42:05.095 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:42:05.095 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:42:05.095 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:42:05.096 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:42:05.096 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:05.096 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:05.096 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:42:05.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:42:05.097 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:42:05.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:42:05.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:42:05.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:42:05.216 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:42:05.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:42:05.217 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:42:05.217 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:42:05.218 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:42:05.218 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:42:05.218 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:05.218 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:05.218 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:42:05.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:42:05.218 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:42:05.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:445: TEST_backfill_remapped: run_mgr td/osd-backfill-stats x 2024-05-08T19:42:05.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:42:05.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:42:05.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:42:05.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:42:05.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:42:05.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:42:06.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:42:06.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:42:06.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:42:06.271 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:42:06.271 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:06.271 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:06.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:42:06.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:42:06.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:446: TEST_backfill_remapped: run_osd td/osd-backfill-stats 0 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:42:06.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:06.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:42:06.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:42:06.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:42:06.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:42:06.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:42:06.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:42:06.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:42:06.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=471edab6-c3ca-48fd-9923-a5357a66e255 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 471edab6-c3ca-48fd-9923-a5357a66e255' 2024-05-08T19:42:06.357 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 471edab6-c3ca-48fd-9923-a5357a66e255 2024-05-08T19:42:06.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:42:06.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCO1TtmtnscFxAAQpHLKSsFaLDNyhuiDLq0jA== 2024-05-08T19:42:06.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCO1TtmtnscFxAAQpHLKSsFaLDNyhuiDLq0jA=="}' 2024-05-08T19:42:06.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 471edab6-c3ca-48fd-9923-a5357a66e255 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:42:06.724 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:42:06.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:42:06.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCO1TtmtnscFxAAQpHLKSsFaLDNyhuiDLq0jA== --osd-uuid 471edab6-c3ca-48fd-9923-a5357a66e255 2024-05-08T19:42:06.774 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:06.780+0000 7f4aff38a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:06.810 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:06.816+0000 7f4aff38a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:06.812 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:06.820+0000 7f4aff38a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:06.812 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:06.820+0000 7f4aff38a7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:42:06.812 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:06.820+0000 7f4aff38a7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:42:06.812 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:06.820+0000 7f4aff38a7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:42:06.841 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:06.848+0000 7f4aff38a7c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:42:14.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:42:14.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:42:14.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:42:14.687 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:42:14.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:42:15.257 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:42:15.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:42:15.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:42:15.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:42:15.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:42:15.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:42:15.290 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:15.296+0000 7fdae9ea57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:15.292 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:15.300+0000 7fdae9ea57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:15.294 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:15.300+0000 7fdae9ea57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:15.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:42:15.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:42:15.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:42:15.670 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:42:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:42:15.671 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:42:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:42:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:15.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:15.840 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:15.848+0000 7fdae9ea57c0 -1 Falling back to public interface 2024-05-08T19:42:16.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:17.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:17.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:17.130 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:42:17.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:42:17.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:17.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:17.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:18.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:18.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:18.560 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:42:18.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:42:18.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:18.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:18.690 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:18.696+0000 7fdae9ea57c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:42:19.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:20.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:20.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:20.064 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:42:20.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:42:20.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:20.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:20.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:21.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:21.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:21.523 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:42:21.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:42:21.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:21.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:22.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:23.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:23.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:23.145 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:42:23.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:42:23.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:23.146 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:23.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:24.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:24.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:24.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:42:24.764 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:42:24.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:24.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:25.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:26.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:26.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:26.251 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:42:26.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:42:26.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:26.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:26.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:27.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:27.928 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:27.929 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:42:27.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:42:27.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:27.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:28.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:29.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:29.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:29.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:42:29.358 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:42:29.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:29.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:29.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:30.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:30.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:30.935 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:42:30.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:42:30.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:30.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:31.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:32.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:32.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:32.622 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:42:32.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:42:32.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:32.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:33.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:34.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:34.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:34.232 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:42:34.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:42:34.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:34.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:34.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:35.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:35.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:35.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:42:35.763 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:42:35.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:35.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:36.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:37.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:37.257 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:37.257 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:42:37.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:42:37.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:37.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:38.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:39.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:39.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:39.184 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:42:39.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:42:39.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:39.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:40.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:41.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:41.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:41.188 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:42:41.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:42:41.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:41.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:42.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:43.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:43.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:43.073 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:42:43.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:42:43.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:43.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:44.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:45.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:45.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:45.543 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:42:45.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:42:45.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:45.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:46.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:47.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:47.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:47.637 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:42:47.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:42:47.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:47.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:49.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:42:50.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:42:50.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:42:50.009 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:42:50.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:42:50.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:42:50.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:42:50.516 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/801960249,v1:127.0.0.1:6803/801960249] [v2:127.0.0.1:6804/801960249,v1:127.0.0.1:6805/801960249] exists,up 471edab6-c3ca-48fd-9923-a5357a66e255 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:447: TEST_backfill_remapped: run_osd td/osd-backfill-stats 1 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:42:50.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:42:50.522 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:42:50.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:42:50.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:42:50.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:42:50.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:42:50.524 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:42:50.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2bfce650-f339-4ebc-8e74-6dfefa602e67 2024-05-08T19:42:50.525 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 2bfce650-f339-4ebc-8e74-6dfefa602e67 2024-05-08T19:42:50.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 2bfce650-f339-4ebc-8e74-6dfefa602e67' 2024-05-08T19:42:50.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:42:50.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC61Ttm2QHQIBAAs5S3tzon8HfDEWM8TWymjQ== 2024-05-08T19:42:50.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC61Ttm2QHQIBAAs5S3tzon8HfDEWM8TWymjQ=="}' 2024-05-08T19:42:50.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2bfce650-f339-4ebc-8e74-6dfefa602e67 -i td/osd-backfill-stats/1/new.json 2024-05-08T19:42:51.202 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:42:51.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:42:51.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC61Ttm2QHQIBAAs5S3tzon8HfDEWM8TWymjQ== --osd-uuid 2bfce650-f339-4ebc-8e74-6dfefa602e67 2024-05-08T19:42:51.247 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:51.255+0000 7f2c678fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:51.249 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:51.255+0000 7f2c678fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:51.250 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:51.255+0000 7f2c678fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:51.251 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:51.259+0000 7f2c678fa7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:42:51.251 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:51.259+0000 7f2c678fa7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:42:51.251 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:51.259+0000 7f2c678fa7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:42:51.336 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:51.343+0000 7f2c678fa7c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:42:59.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:42:59.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:42:59.285 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:42:59.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:42:59.286 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:42:59.893 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:42:59.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:42:59.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:42:59.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:42:59.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:42:59.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:42:59.926 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:59.931+0000 7fb46f3c47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:59.928 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:59.935+0000 7fb46f3c47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:42:59.929 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:42:59.935+0000 7fb46f3c47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:43:00.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:43:00.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:43:00.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:43:00.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:43:00.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:43:00.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:00.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:43:00.307 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:43:00.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:00.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:00.468 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:00.475+0000 7fb46f3c47c0 -1 Falling back to public interface 2024-05-08T19:43:00.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:01.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:01.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:01.712 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:43:01.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:43:01.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:01.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:02.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:03.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:03.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:03.126 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:43:03.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:43:03.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:03.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:03.355 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:03.363+0000 7fb46f3c47c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:43:03.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:04.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:04.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:04.628 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:43:04.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:43:04.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:04.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:05.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:06.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:06.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:06.098 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:43:06.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:43:06.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:06.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:06.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:07.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:07.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:07.568 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:43:07.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:43:07.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:07.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:08.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:09.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:09.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:09.195 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:43:09.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:43:09.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:09.196 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:10.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:11.004 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:43:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:43:11.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:11.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:11.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:12.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:12.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:12.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:43:12.594 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:43:12.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:12.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:13.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:14.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:14.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:14.095 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:43:14.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:43:14.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:14.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:14.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:15.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:15.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:15.775 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:43:15.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:43:15.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:15.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:16.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:17.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:17.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:17.473 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:43:17.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:43:17.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:17.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:18.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:19.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:19.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:19.012 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:43:19.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:43:19.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:19.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:19.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:20.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:20.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:20.660 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:43:20.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:43:20.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:20.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:21.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:22.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:22.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:22.080 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:43:22.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:43:22.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:22.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:23.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:24.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:24.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:24.225 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:43:24.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:43:24.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:24.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:25.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:26.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:26.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:26.298 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:43:26.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:43:26.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:26.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:27.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:28.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:28.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:28.119 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:43:28.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:43:28.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:28.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:29.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:30.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:30.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:30.248 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:43:30.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:43:30.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:30.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:31.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:32.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:32.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:32.118 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:43:32.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:43:32.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:32.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:33.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:34.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:34.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:34.187 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:43:34.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:43:34.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:34.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:35.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:36.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:36.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:36.116 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:43:36.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:43:36.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:36.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:43:36.623 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1072157221,v1:127.0.0.1:6811/1072157221] [v2:127.0.0.1:6812/1072157221,v1:127.0.0.1:6813/1072157221] exists,up 2bfce650-f339-4ebc-8e74-6dfefa602e67 2024-05-08T19:43:36.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:43:36.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:43:36.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:43:36.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:448: TEST_backfill_remapped: run_osd td/osd-backfill-stats 2 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:43:36.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:43:36.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:43:36.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:43:36.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:43:36.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:43:36.628 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:43:36.628 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:43:36.628 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:43:36.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:43:36.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:43:36.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:43:36.629 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:43:36.630 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:43:36.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=a2e84715-d67d-4ac9-91a3-12d3f74bbc34 2024-05-08T19:43:36.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 a2e84715-d67d-4ac9-91a3-12d3f74bbc34' 2024-05-08T19:43:36.630 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 a2e84715-d67d-4ac9-91a3-12d3f74bbc34 2024-05-08T19:43:36.631 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:43:36.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDo1TtmKNC6JxAAGSaIf/67N4g4/d24jN0ZhQ== 2024-05-08T19:43:36.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDo1TtmKNC6JxAAGSaIf/67N4g4/d24jN0ZhQ=="}' 2024-05-08T19:43:36.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new a2e84715-d67d-4ac9-91a3-12d3f74bbc34 -i td/osd-backfill-stats/2/new.json 2024-05-08T19:43:37.330 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:43:37.346 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:43:37.348 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDo1TtmKNC6JxAAGSaIf/67N4g4/d24jN0ZhQ== --osd-uuid a2e84715-d67d-4ac9-91a3-12d3f74bbc34 2024-05-08T19:43:37.376 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:37.386+0000 7ff8516e37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:43:37.378 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:37.386+0000 7ff8516e37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:43:37.379 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:37.390+0000 7ff8516e37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:43:37.380 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:37.390+0000 7ff8516e37c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:43:37.380 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:37.390+0000 7ff8516e37c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:43:37.380 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:37.390+0000 7ff8516e37c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:43:37.447 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:37.458+0000 7ff8516e37c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:43:45.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:43:45.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:43:45.309 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:43:45.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:43:45.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:43:45.905 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:43:45.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:43:45.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:43:45.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:43:45.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:43:45.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:43:45.939 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:45.950+0000 7f81316fd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:43:45.941 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:45.950+0000 7f81316fd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:43:45.942 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:45.950+0000 7f81316fd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:43:46.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:43:46.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:43:46.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:43:46.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:43:46.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:43:46.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:46.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:43:46.327 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:43:46.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:46.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:46.492 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:46.502+0000 7f81316fd7c0 -1 Falling back to public interface 2024-05-08T19:43:46.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:47.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:47.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:47.785 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:43:47.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:43:47.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:47.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:48.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:49.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:49.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:49.188 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:43:49.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:43:49.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:49.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:49.382 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:43:49.390+0000 7f81316fd7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:43:49.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:50.638 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:50.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:50.639 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:43:50.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:43:50.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:50.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:51.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:52.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:52.094 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:43:52.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:43:52.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:52.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:52.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:53.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:53.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:53.696 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:43:53.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:43:53.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:53.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:54.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:55.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:55.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:55.410 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:43:55.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:43:55.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:55.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:56.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:57.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:57.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:57.185 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:43:57.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:43:57.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:57.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:57.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:43:58.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:43:58.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:43:58.699 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:43:58.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:43:58.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:43:58.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:43:59.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:00.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:00.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:00.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:44:00.280 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:44:00.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:00.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:00.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:01.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:01.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:01.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:44:01.811 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:44:01.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:01.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:02.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:03.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:03.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:03.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:44:03.489 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:44:03.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:03.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:04.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:05.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:05.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:05.214 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:44:05.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:44:05.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:05.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:05.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:06.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:06.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:06.855 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:44:06.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:44:06.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:06.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:07.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:08.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:08.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:08.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:44:08.393 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:44:08.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:08.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:09.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:10.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:10.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:10.034 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:44:10.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:44:10.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:10.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:10.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:11.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:11.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:11.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:44:11.949 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:44:11.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:11.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:12.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:13.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:13.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:13.774 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:44:13.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:44:13.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:13.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:14.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:15.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:15.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:15.944 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:44:15.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:44:15.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:15.944 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:16.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:17.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:17.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:17.436 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:44:17.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:44:17.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:17.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:18.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:19.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:19.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:19.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:44:19.705 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:44:19.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:19.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:20.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:21.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:21.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:21.851 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:44:21.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:44:21.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:21.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:22.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:23.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:23.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:23.363 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:44:23.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:44:23.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:23.363 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:44:23.849 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/992679437,v1:127.0.0.1:6819/992679437] [v2:127.0.0.1:6820/992679437,v1:127.0.0.1:6821/992679437] exists,up a2e84715-d67d-4ac9-91a3-12d3f74bbc34 2024-05-08T19:44:23.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:449: TEST_backfill_remapped: run_osd td/osd-backfill-stats 3 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:44:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:44:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:44:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:44:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:44:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:44:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:44:23.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:44:23.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:44:23.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:44:23.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:44:23.855 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:44:23.855 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:44:23.855 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:44:23.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:44:23.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:44:23.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:44:23.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:44:23.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:44:23.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:44:23.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:44:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:44:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:44:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:44:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:44:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:44:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:44:23.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:44:23.858 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:44:23.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=a50d85f1-2b2f-44ce-bf92-47d1353df5ed 2024-05-08T19:44:23.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 a50d85f1-2b2f-44ce-bf92-47d1353df5ed' 2024-05-08T19:44:23.858 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 a50d85f1-2b2f-44ce-bf92-47d1353df5ed 2024-05-08T19:44:23.858 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:44:23.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAX1jtmkLQENRAAAmG7HETcAje7m+XnL2wo6g== 2024-05-08T19:44:23.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAX1jtmkLQENRAAAmG7HETcAje7m+XnL2wo6g=="}' 2024-05-08T19:44:23.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new a50d85f1-2b2f-44ce-bf92-47d1353df5ed -i td/osd-backfill-stats/3/new.json 2024-05-08T19:44:24.580 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:44:24.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:44:24.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAX1jtmkLQENRAAAmG7HETcAje7m+XnL2wo6g== --osd-uuid a50d85f1-2b2f-44ce-bf92-47d1353df5ed 2024-05-08T19:44:24.636 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:24.645+0000 7f1b64d507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:44:24.713 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:24.721+0000 7f1b64d507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:44:24.715 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:24.725+0000 7f1b64d507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:44:24.716 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:24.725+0000 7f1b64d507c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:44:24.716 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:24.725+0000 7f1b64d507c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:44:24.716 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:24.725+0000 7f1b64d507c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:44:24.826 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:24.837+0000 7f1b64d507c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:44:32.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:44:32.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:44:32.851 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:44:32.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:44:32.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:44:33.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:44:33.436 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:44:33.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:44:33.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:44:33.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:44:33.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:44:33.470 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:33.477+0000 7f9e5b5907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:44:33.501 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:33.509+0000 7f9e5b5907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:44:33.502 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:33.509+0000 7f9e5b5907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:44:33.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:44:33.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:44:33.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:44:33.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:44:33.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:44:33.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:33.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:44:33.876 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:44:33.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:33.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:34.060 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:34.069+0000 7f9e5b5907c0 -1 Falling back to public interface 2024-05-08T19:44:34.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:35.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:35.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:35.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:44:35.269 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:44:35.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:35.270 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:35.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:36.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:36.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:36.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:44:36.673 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:44:36.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:36.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:36.873 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:44:36.881+0000 7f9e5b5907c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:44:37.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:38.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:38.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:38.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:44:38.180 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:44:38.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:38.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:38.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:39.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:39.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:39.682 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:44:39.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:44:39.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:39.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:40.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:41.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:41.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:41.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:44:41.414 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:44:41.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:41.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:42.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:43.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:43.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:43.086 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:44:43.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:44:43.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:43.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:43.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:44.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:44.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:44.810 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:44:44.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:44:44.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:44.811 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:45.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:46.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:46.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:46.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:44:46.368 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:44:46.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:46.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:47.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:48.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:48.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:48.130 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:44:48.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:44:48.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:48.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:48.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:49.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:49.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:49.585 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:44:49.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:44:49.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:49.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:50.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:51.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:51.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:51.157 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:44:51.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:44:51.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:51.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:51.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:52.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:52.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:52.833 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:44:52.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:44:52.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:52.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:53.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:54.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:54.368 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:44:54.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:54.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:44:54.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:54.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:55.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:56.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:56.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:56.024 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:44:56.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:44:56.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:56.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:56.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:57.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:57.603 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:44:57.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:44:57.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:57.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:44:58.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:44:59.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:44:59.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:44:59.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:44:59.607 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:44:59.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:44:59.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:45:00.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:45:01.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:45:01.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:45:01.709 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:45:01.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:45:01.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:45:01.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:45:02.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:45:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:45:03.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:45:03.927 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:45:03.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:45:03.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:45:03.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:45:04.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:45:05.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:45:05.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:45:05.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:45:05.809 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:45:05.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:45:05.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:45:06.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:45:07.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:45:07.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:45:07.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:45:07.783 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:45:07.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:45:07.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:45:08.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:45:09.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:45:09.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:45:09.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:45:09.542 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:45:09.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:45:09.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:45:10.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:45:11.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:45:11.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:45:11.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:45:11.433 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:45:11.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:45:11.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:45:12.005 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1847623676,v1:127.0.0.1:6827/1847623676] [v2:127.0.0.1:6828/1847623676,v1:127.0.0.1:6829/1847623676] exists,up a50d85f1-2b2f-44ce-bf92-47d1353df5ed 2024-05-08T19:45:12.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:45:12.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:45:12.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:45:12.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:451: TEST_backfill_remapped: create_pool test 1 1 2024-05-08T19:45:12.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T19:45:12.796 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:45:12.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:45:13.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:452: TEST_backfill_remapped: ceph osd pool set test size 3 2024-05-08T19:45:15.096 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 3 2024-05-08T19:45:15.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:453: TEST_backfill_remapped: sleep 5 2024-05-08T19:45:20.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:455: TEST_backfill_remapped: wait_for_clean 2024-05-08T19:45:20.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:45:20.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:45:20.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:45:20.123 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:45:20.123 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:45:20.123 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:45:20.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:45:20.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:45:20.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:45:20.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:45:20.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:45:20.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:45:20.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:45:20.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:45:20.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:45:20.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:45:20.684 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:45:20.684 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:45:20.685 INFO:tasks.workunit.client.0.smithi117.stderr:3' 2024-05-08T19:45:20.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:45:20.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:45:20.685 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:45:20.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836521 2024-05-08T19:45:20.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836521 2024-05-08T19:45:20.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836521' 2024-05-08T19:45:20.898 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:45:20.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:45:21.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672987 2024-05-08T19:45:21.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672987 2024-05-08T19:45:21.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836521 1-42949672987' 2024-05-08T19:45:21.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:45:21.284 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:45:21.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509461 2024-05-08T19:45:21.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509461 2024-05-08T19:45:21.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836521 1-42949672987 2-64424509461' 2024-05-08T19:45:21.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:45:21.439 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:45:21.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345934 2024-05-08T19:45:21.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345934 2024-05-08T19:45:21.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836521 1-42949672987 2-64424509461 3-85899345934' 2024-05-08T19:45:21.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:45:21.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836521 2024-05-08T19:45:21.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:45:21.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:45:21.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836521 2024-05-08T19:45:21.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:45:21.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836521 2024-05-08T19:45:21.601 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836521 2024-05-08T19:45:21.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836521' 2024-05-08T19:45:21.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:45:22.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836521 -lt 21474836521 2024-05-08T19:45:22.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:45:22.005 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:45:22.005 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672987 2024-05-08T19:45:22.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:45:22.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672987 2024-05-08T19:45:22.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:45:22.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672987 2024-05-08T19:45:22.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672987' 2024-05-08T19:45:22.009 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672987 2024-05-08T19:45:22.009 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:45:22.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672984 -lt 42949672987 2024-05-08T19:45:22.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:45:23.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:45:23.415 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:45:23.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672987 -lt 42949672987 2024-05-08T19:45:23.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:45:23.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509461 2024-05-08T19:45:23.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:45:23.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:45:23.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509461 2024-05-08T19:45:23.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:45:23.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509461 2024-05-08T19:45:23.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509461' 2024-05-08T19:45:23.853 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509461 2024-05-08T19:45:23.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:45:24.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509461 -lt 64424509461 2024-05-08T19:45:24.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:45:24.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:45:24.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345934 2024-05-08T19:45:24.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:45:24.303 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345934 2024-05-08T19:45:24.304 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:45:24.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345934 2024-05-08T19:45:24.305 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345934 2024-05-08T19:45:24.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345934' 2024-05-08T19:45:24.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:45:24.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345935 -lt 85899345934 2024-05-08T19:45:24.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:45:24.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:45:24.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:45:25.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:45:25.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:45:25.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:45:25.379 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:45:25.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:45:25.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:45:25.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:45:25.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:45:25.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:45:25.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:45:25.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:45:25.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:45:26.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:45:26.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:45:26.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:45:26.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: seq 1 200 2024-05-08T19:45:26.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:26.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj1 /dev/null 2024-05-08T19:45:26.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:26.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj2 /dev/null 2024-05-08T19:45:26.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:26.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj3 /dev/null 2024-05-08T19:45:26.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:26.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj4 /dev/null 2024-05-08T19:45:27.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:27.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj5 /dev/null 2024-05-08T19:45:27.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:27.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj6 /dev/null 2024-05-08T19:45:27.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:27.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj7 /dev/null 2024-05-08T19:45:27.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:27.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj8 /dev/null 2024-05-08T19:45:27.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:27.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj9 /dev/null 2024-05-08T19:45:27.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:27.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj10 /dev/null 2024-05-08T19:45:28.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:28.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj11 /dev/null 2024-05-08T19:45:28.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:28.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj12 /dev/null 2024-05-08T19:45:28.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:28.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj13 /dev/null 2024-05-08T19:45:28.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:28.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj14 /dev/null 2024-05-08T19:45:28.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:28.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj15 /dev/null 2024-05-08T19:45:28.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:28.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj16 /dev/null 2024-05-08T19:45:29.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:29.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj17 /dev/null 2024-05-08T19:45:29.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:29.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj18 /dev/null 2024-05-08T19:45:29.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:29.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj19 /dev/null 2024-05-08T19:45:29.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:29.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj20 /dev/null 2024-05-08T19:45:29.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:29.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj21 /dev/null 2024-05-08T19:45:30.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:30.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj22 /dev/null 2024-05-08T19:45:30.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:30.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj23 /dev/null 2024-05-08T19:45:30.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:30.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj24 /dev/null 2024-05-08T19:45:30.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:30.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj25 /dev/null 2024-05-08T19:45:30.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:30.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj26 /dev/null 2024-05-08T19:45:30.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:30.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj27 /dev/null 2024-05-08T19:45:31.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:31.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj28 /dev/null 2024-05-08T19:45:31.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:31.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj29 /dev/null 2024-05-08T19:45:31.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:31.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj30 /dev/null 2024-05-08T19:45:31.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:31.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj31 /dev/null 2024-05-08T19:45:31.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:31.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj32 /dev/null 2024-05-08T19:45:32.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:32.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj33 /dev/null 2024-05-08T19:45:32.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:32.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj34 /dev/null 2024-05-08T19:45:32.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:32.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj35 /dev/null 2024-05-08T19:45:32.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:32.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj36 /dev/null 2024-05-08T19:45:32.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:32.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj37 /dev/null 2024-05-08T19:45:32.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:32.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj38 /dev/null 2024-05-08T19:45:33.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:33.108 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj39 /dev/null 2024-05-08T19:45:33.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:33.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj40 /dev/null 2024-05-08T19:45:33.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:33.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj41 /dev/null 2024-05-08T19:45:33.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:33.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj42 /dev/null 2024-05-08T19:45:33.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:33.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj43 /dev/null 2024-05-08T19:45:33.953 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:33.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj44 /dev/null 2024-05-08T19:45:34.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:34.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj45 /dev/null 2024-05-08T19:45:34.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:34.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj46 /dev/null 2024-05-08T19:45:34.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:34.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj47 /dev/null 2024-05-08T19:45:34.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:34.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj48 /dev/null 2024-05-08T19:45:34.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:34.764 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj49 /dev/null 2024-05-08T19:45:34.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:34.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj50 /dev/null 2024-05-08T19:45:35.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:35.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj51 /dev/null 2024-05-08T19:45:35.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:35.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj52 /dev/null 2024-05-08T19:45:35.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:35.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj53 /dev/null 2024-05-08T19:45:35.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:35.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj54 /dev/null 2024-05-08T19:45:35.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:35.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj55 /dev/null 2024-05-08T19:45:35.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:35.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj56 /dev/null 2024-05-08T19:45:36.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:36.160 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj57 /dev/null 2024-05-08T19:45:36.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:36.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj58 /dev/null 2024-05-08T19:45:36.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:36.470 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj59 /dev/null 2024-05-08T19:45:36.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:36.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj60 /dev/null 2024-05-08T19:45:36.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:36.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj61 /dev/null 2024-05-08T19:45:36.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:36.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj62 /dev/null 2024-05-08T19:45:37.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:37.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj63 /dev/null 2024-05-08T19:45:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:37.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj64 /dev/null 2024-05-08T19:45:37.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:37.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj65 /dev/null 2024-05-08T19:45:37.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:37.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj66 /dev/null 2024-05-08T19:45:37.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:37.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj67 /dev/null 2024-05-08T19:45:38.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:38.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj68 /dev/null 2024-05-08T19:45:38.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:38.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj69 /dev/null 2024-05-08T19:45:38.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:38.402 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj70 /dev/null 2024-05-08T19:45:38.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:38.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj71 /dev/null 2024-05-08T19:45:38.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:38.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj72 /dev/null 2024-05-08T19:45:38.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:38.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj73 /dev/null 2024-05-08T19:45:39.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:39.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj74 /dev/null 2024-05-08T19:45:39.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:39.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj75 /dev/null 2024-05-08T19:45:39.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:39.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj76 /dev/null 2024-05-08T19:45:39.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:39.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj77 /dev/null 2024-05-08T19:45:39.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:39.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj78 /dev/null 2024-05-08T19:45:39.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:39.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj79 /dev/null 2024-05-08T19:45:40.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:40.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj80 /dev/null 2024-05-08T19:45:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:40.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj81 /dev/null 2024-05-08T19:45:40.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:40.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj82 /dev/null 2024-05-08T19:45:40.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:40.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj83 /dev/null 2024-05-08T19:45:40.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:40.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj84 /dev/null 2024-05-08T19:45:40.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:40.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj85 /dev/null 2024-05-08T19:45:41.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:41.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj86 /dev/null 2024-05-08T19:45:41.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:41.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj87 /dev/null 2024-05-08T19:45:41.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:41.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj88 /dev/null 2024-05-08T19:45:41.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:41.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj89 /dev/null 2024-05-08T19:45:42.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:42.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj90 /dev/null 2024-05-08T19:45:42.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:42.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj91 /dev/null 2024-05-08T19:45:42.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:42.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj92 /dev/null 2024-05-08T19:45:42.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:42.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj93 /dev/null 2024-05-08T19:45:42.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:42.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj94 /dev/null 2024-05-08T19:45:42.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:42.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj95 /dev/null 2024-05-08T19:45:43.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:43.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj96 /dev/null 2024-05-08T19:45:43.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:43.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj97 /dev/null 2024-05-08T19:45:43.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:43.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj98 /dev/null 2024-05-08T19:45:43.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:43.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj99 /dev/null 2024-05-08T19:45:43.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:43.797 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj100 /dev/null 2024-05-08T19:45:43.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:43.938 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj101 /dev/null 2024-05-08T19:45:44.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:44.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj102 /dev/null 2024-05-08T19:45:44.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:44.273 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj103 /dev/null 2024-05-08T19:45:44.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:44.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj104 /dev/null 2024-05-08T19:45:44.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:44.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj105 /dev/null 2024-05-08T19:45:44.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:44.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj106 /dev/null 2024-05-08T19:45:44.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:44.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj107 /dev/null 2024-05-08T19:45:45.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:45.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj108 /dev/null 2024-05-08T19:45:45.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:45.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj109 /dev/null 2024-05-08T19:45:45.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:45.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj110 /dev/null 2024-05-08T19:45:45.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:45.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj111 /dev/null 2024-05-08T19:45:45.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:45.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj112 /dev/null 2024-05-08T19:45:46.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:46.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj113 /dev/null 2024-05-08T19:45:46.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:46.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj114 /dev/null 2024-05-08T19:45:46.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:46.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj115 /dev/null 2024-05-08T19:45:46.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:46.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj116 /dev/null 2024-05-08T19:45:46.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:46.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj117 /dev/null 2024-05-08T19:45:47.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:47.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj118 /dev/null 2024-05-08T19:45:47.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:47.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj119 /dev/null 2024-05-08T19:45:47.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:47.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj120 /dev/null 2024-05-08T19:45:47.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:47.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj121 /dev/null 2024-05-08T19:45:47.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:47.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj122 /dev/null 2024-05-08T19:45:48.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:48.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj123 /dev/null 2024-05-08T19:45:48.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:48.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj124 /dev/null 2024-05-08T19:45:48.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:48.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj125 /dev/null 2024-05-08T19:45:48.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:48.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj126 /dev/null 2024-05-08T19:45:48.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:48.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj127 /dev/null 2024-05-08T19:45:48.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:48.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj128 /dev/null 2024-05-08T19:45:49.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:49.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj129 /dev/null 2024-05-08T19:45:49.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:49.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj130 /dev/null 2024-05-08T19:45:49.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:49.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj131 /dev/null 2024-05-08T19:45:49.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:49.667 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj132 /dev/null 2024-05-08T19:45:49.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:49.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj133 /dev/null 2024-05-08T19:45:49.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:49.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj134 /dev/null 2024-05-08T19:45:50.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:50.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj135 /dev/null 2024-05-08T19:45:50.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:50.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj136 /dev/null 2024-05-08T19:45:50.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:50.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj137 /dev/null 2024-05-08T19:45:50.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:50.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj138 /dev/null 2024-05-08T19:45:50.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:50.729 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj139 /dev/null 2024-05-08T19:45:50.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:50.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj140 /dev/null 2024-05-08T19:45:51.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:51.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj141 /dev/null 2024-05-08T19:45:51.288 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:51.289 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj142 /dev/null 2024-05-08T19:45:51.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:51.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj143 /dev/null 2024-05-08T19:45:51.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:51.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj144 /dev/null 2024-05-08T19:45:51.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:51.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj145 /dev/null 2024-05-08T19:45:52.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:52.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj146 /dev/null 2024-05-08T19:45:52.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:52.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj147 /dev/null 2024-05-08T19:45:52.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:52.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj148 /dev/null 2024-05-08T19:45:52.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:52.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj149 /dev/null 2024-05-08T19:45:52.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:52.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj150 /dev/null 2024-05-08T19:45:52.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:52.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj151 /dev/null 2024-05-08T19:45:53.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:53.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj152 /dev/null 2024-05-08T19:45:53.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:53.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj153 /dev/null 2024-05-08T19:45:53.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:53.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj154 /dev/null 2024-05-08T19:45:53.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:53.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj155 /dev/null 2024-05-08T19:45:53.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:53.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj156 /dev/null 2024-05-08T19:45:53.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:53.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj157 /dev/null 2024-05-08T19:45:54.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:54.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj158 /dev/null 2024-05-08T19:45:54.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:54.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj159 /dev/null 2024-05-08T19:45:54.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:54.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj160 /dev/null 2024-05-08T19:45:54.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:54.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj161 /dev/null 2024-05-08T19:45:54.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:54.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj162 /dev/null 2024-05-08T19:45:54.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:54.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj163 /dev/null 2024-05-08T19:45:55.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:55.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj164 /dev/null 2024-05-08T19:45:55.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:55.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj165 /dev/null 2024-05-08T19:45:55.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:55.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj166 /dev/null 2024-05-08T19:45:55.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:55.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj167 /dev/null 2024-05-08T19:45:55.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:55.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj168 /dev/null 2024-05-08T19:45:55.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:55.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj169 /dev/null 2024-05-08T19:45:56.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:56.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj170 /dev/null 2024-05-08T19:45:56.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:56.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj171 /dev/null 2024-05-08T19:45:56.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:56.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj172 /dev/null 2024-05-08T19:45:56.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:56.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj173 /dev/null 2024-05-08T19:45:56.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:56.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj174 /dev/null 2024-05-08T19:45:56.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:56.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj175 /dev/null 2024-05-08T19:45:57.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:57.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj176 /dev/null 2024-05-08T19:45:57.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:57.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj177 /dev/null 2024-05-08T19:45:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj178 /dev/null 2024-05-08T19:45:57.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:57.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj179 /dev/null 2024-05-08T19:45:57.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:57.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj180 /dev/null 2024-05-08T19:45:57.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:57.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj181 /dev/null 2024-05-08T19:45:58.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:58.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj182 /dev/null 2024-05-08T19:45:58.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:58.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj183 /dev/null 2024-05-08T19:45:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:58.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj184 /dev/null 2024-05-08T19:45:58.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:58.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj185 /dev/null 2024-05-08T19:45:58.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:58.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj186 /dev/null 2024-05-08T19:45:58.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:58.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj187 /dev/null 2024-05-08T19:45:59.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:59.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj188 /dev/null 2024-05-08T19:45:59.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:59.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj189 /dev/null 2024-05-08T19:45:59.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:59.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj190 /dev/null 2024-05-08T19:45:59.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:59.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj191 /dev/null 2024-05-08T19:45:59.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:45:59.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj192 /dev/null 2024-05-08T19:46:00.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:46:00.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj193 /dev/null 2024-05-08T19:46:00.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:46:00.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj194 /dev/null 2024-05-08T19:46:00.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:46:00.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj195 /dev/null 2024-05-08T19:46:00.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:46:00.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj196 /dev/null 2024-05-08T19:46:00.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:46:00.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj197 /dev/null 2024-05-08T19:46:00.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:46:00.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj198 /dev/null 2024-05-08T19:46:01.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:46:01.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj199 /dev/null 2024-05-08T19:46:01.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-05-08T19:46:01.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj200 /dev/null 2024-05-08T19:46:01.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:462: TEST_backfill_remapped: get_pg test obj1 2024-05-08T19:46:01.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:46:01.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:46:01.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:46:01.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:46:01.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:462: TEST_backfill_remapped: local PG=1.0 2024-05-08T19:46:01.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:464: TEST_backfill_remapped: get_primary test obj1 2024-05-08T19:46:01.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:46:01.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:46:01.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:46:01.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:46:02.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:464: TEST_backfill_remapped: local primary=1 2024-05-08T19:46:02.352 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:465: TEST_backfill_remapped: get_not_primary test obj1 2024-05-08T19:46:02.352 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T19:46:02.352 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T19:46:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T19:46:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:46:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:46:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:46:02.353 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:46:02.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T19:46:02.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T19:46:02.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T19:46:03.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:465: TEST_backfill_remapped: local otherosd=0 2024-05-08T19:46:03.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:467: TEST_backfill_remapped: ceph osd set nobackfill 2024-05-08T19:46:04.149 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:46:04.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:468: TEST_backfill_remapped: ceph osd out osd.0 2024-05-08T19:46:04.890 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T19:46:04.910 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:469: TEST_backfill_remapped: get_osds test obj1 2024-05-08T19:46:04.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=test 2024-05-08T19:46:04.911 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj1 2024-05-08T19:46:04.911 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2024-05-08T19:46:04.911 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map test obj1 2024-05-08T19:46:05.662 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=1 2024-05-08T19:46:05.662 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:46:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:3' 2024-05-08T19:46:05.663 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 1 2 3 2024-05-08T19:46:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:469: TEST_backfill_remapped: for i in $(get_osds $poolname obj1) 2024-05-08T19:46:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:471: TEST_backfill_remapped: '[' 1 = 1 -o 1 = 0 ']' 2024-05-08T19:46:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:473: TEST_backfill_remapped: continue 2024-05-08T19:46:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:469: TEST_backfill_remapped: for i in $(get_osds $poolname obj1) 2024-05-08T19:46:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:471: TEST_backfill_remapped: '[' 2 = 1 -o 2 = 0 ']' 2024-05-08T19:46:05.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:475: TEST_backfill_remapped: ceph osd out osd.2 2024-05-08T19:46:06.927 INFO:tasks.workunit.client.0.smithi117.stderr:osd.2 is already out. 2024-05-08T19:46:06.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:476: TEST_backfill_remapped: break 2024-05-08T19:46:06.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:478: TEST_backfill_remapped: ceph osd out osd.1 2024-05-08T19:46:08.338 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T19:46:08.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:479: TEST_backfill_remapped: ceph osd pool set test size 2 2024-05-08T19:46:10.094 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T19:46:10.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:480: TEST_backfill_remapped: sleep 2 2024-05-08T19:46:12.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:484: TEST_backfill_remapped: get_primary test obj1 2024-05-08T19:46:12.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:46:12.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:46:12.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:46:12.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:46:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:484: TEST_backfill_remapped: primary=0 2024-05-08T19:46:12.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:486: TEST_backfill_remapped: ceph osd unset nobackfill 2024-05-08T19:46:13.721 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:46:13.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:487: TEST_backfill_remapped: ceph tell osd.0 get_latest_osdmap 2024-05-08T19:46:13.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:488: TEST_backfill_remapped: ceph tell osd.0 debug kick_recovery_wq 0 2024-05-08T19:46:14.162 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T19:46:14.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:490: TEST_backfill_remapped: sleep 2 2024-05-08T19:46:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:492: TEST_backfill_remapped: wait_for_clean 2024-05-08T19:46:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:46:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:46:16.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:46:16.178 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:46:16.178 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:46:16.179 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:46:16.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:46:16.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:46:16.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:46:16.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:46:16.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:46:16.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:46:16.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:46:16.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:46:16.307 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:46:16.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:46:16.735 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:46:16.735 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:46:16.735 INFO:tasks.workunit.client.0.smithi117.stderr:3' 2024-05-08T19:46:16.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:46:16.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:46:16.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:46:16.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836534 2024-05-08T19:46:16.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836534 2024-05-08T19:46:16.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836534' 2024-05-08T19:46:16.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:46:16.951 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:46:17.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673000 2024-05-08T19:46:17.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673000 2024-05-08T19:46:17.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836534 1-42949673000' 2024-05-08T19:46:17.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:46:17.111 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:46:17.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509474 2024-05-08T19:46:17.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509474 2024-05-08T19:46:17.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836534 1-42949673000 2-64424509474' 2024-05-08T19:46:17.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:46:17.341 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:46:17.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345948 2024-05-08T19:46:17.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345948 2024-05-08T19:46:17.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836534 1-42949673000 2-64424509474 3-85899345948' 2024-05-08T19:46:17.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:46:17.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836534 2024-05-08T19:46:17.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:46:17.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:46:17.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836534 2024-05-08T19:46:17.515 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:46:17.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836534 2024-05-08T19:46:17.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836534' 2024-05-08T19:46:17.516 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836534 2024-05-08T19:46:17.516 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:46:18.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836534 -lt 21474836534 2024-05-08T19:46:18.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:46:18.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673000 2024-05-08T19:46:18.171 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:46:18.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:46:18.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673000 2024-05-08T19:46:18.173 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:46:18.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673000 2024-05-08T19:46:18.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673000' 2024-05-08T19:46:18.175 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673000 2024-05-08T19:46:18.175 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:46:18.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672998 -lt 42949673000 2024-05-08T19:46:18.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:46:19.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:46:19.707 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:46:20.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673000 -lt 42949673000 2024-05-08T19:46:20.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:46:20.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509474 2024-05-08T19:46:20.152 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:46:20.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:46:20.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509474 2024-05-08T19:46:20.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:46:20.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509474 2024-05-08T19:46:20.155 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509474 2024-05-08T19:46:20.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509474' 2024-05-08T19:46:20.156 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:46:20.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509475 -lt 64424509474 2024-05-08T19:46:20.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:46:20.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345948 2024-05-08T19:46:20.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:46:20.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:46:20.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345948 2024-05-08T19:46:20.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:46:20.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345948 2024-05-08T19:46:20.676 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345948 2024-05-08T19:46:20.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345948' 2024-05-08T19:46:20.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:46:21.115 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345948 -lt 85899345948 2024-05-08T19:46:21.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:46:21.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:21.116 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:21.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:46:21.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:21.777 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:21.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:21.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:21.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:21.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:21.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:22.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:22.189 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:22.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:22.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:22.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:22.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:46:22.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:46:22.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:46:22.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:22.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:22.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:22.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:22.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:22.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:22.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:22.839 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:22.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:22.840 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:23.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:23.331 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:23.331 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:23.331 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:23.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:23.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:23.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:23.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:23.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:23.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:23.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:23.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:23.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:24.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:46:24.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:46:24.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:24.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:24.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:24.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:24.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:24.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:24.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:24.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:24.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:24.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:24.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:25.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:25.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:25.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:25.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:25.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:25.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:25.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:25.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:25.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:25.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:25.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:25.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:25.562 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:26.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:46:26.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:46:26.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:26.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:26.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:26.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:26.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:26.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:26.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:26.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:26.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:26.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:26.310 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:26.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:26.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:26.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:26.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:27.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:27.277 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:27.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:27.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:27.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:46:27.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:46:27.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:27.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:27.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:28.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:28.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:28.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:28.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:28.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:28.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:28.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:28.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:28.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:28.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:28.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:28.531 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:29.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:29.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:29.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:29.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:29.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:29.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:29.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:29.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:29.081 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:46:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:46:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:29.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:29.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:29.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:29.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:29.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:29.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:29.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:29.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:29.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:30.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:30.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:30.381 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:30.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:30.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:30.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:30.916 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:30.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:31.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=7 2024-05-08T19:46:31.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 7 '!=' null 2024-05-08T19:46:31.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:31.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:31.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:31.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:31.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:31.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:31.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:31.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:31.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:31.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:31.784 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:32.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:32.193 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:32.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:32.194 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:32.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:32.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:32.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:32.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:32.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:32.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:32.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:32.748 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:32.748 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:33.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:46:33.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:46:33.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:33.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:33.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:33.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:33.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:33.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:33.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:33.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:33.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:33.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:33.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:33.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:33.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:33.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:33.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:34.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:34.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:34.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:34.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:34.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:34.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:34.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:34.488 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:34.488 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:35.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:46:35.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:46:35.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:35.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:35.105 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:35.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:35.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:35.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:35.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:35.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:35.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:35.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:35.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:35.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:35.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:35.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:35.608 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:36.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:36.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:36.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:36.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:36.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:36.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:36.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:36.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:36.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:36.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:46:36.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:46:36.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:36.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:36.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:36.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:36.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:36.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:36.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:36.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:36.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:36.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:36.948 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:37.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:37.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:37.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:37.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:38.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:38.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:38.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:38.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:38.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:38.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:38.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:38.114 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:38.115 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:38.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:46:38.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:46:38.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:38.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:38.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:38.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:38.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:38.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:38.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:38.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:38.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:38.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:38.759 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:39.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:39.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:39.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:39.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:39.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:39.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:39.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:39.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:39.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:39.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:39.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:39.775 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:39.775 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:40.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:46:40.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:46:40.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:40.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:40.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:40.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:40.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:40.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:40.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:40.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:40.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:40.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:40.544 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:41.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:41.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:41.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:41.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:41.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:41.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:41.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:41.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:41.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:41.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:41.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:41.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:41.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:42.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=8 2024-05-08T19:46:42.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 8 '!=' null 2024-05-08T19:46:42.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:42.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:42.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:42.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:42.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:42.281 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:42.281 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:42.281 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:42.281 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:42.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:42.282 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:42.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:42.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:42.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:42.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:43.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:43.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:43.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:43.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:43.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:43.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:43.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:43.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:43.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:44.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=6 2024-05-08T19:46:44.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 6 '!=' null 2024-05-08T19:46:44.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:44.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:44.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:44.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:44.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:44.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:44.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:44.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:44.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:44.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:44.257 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:44.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:44.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:44.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:44.740 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:45.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:45.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:45.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:45.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:45.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:45.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:45.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:45.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:45.283 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:45.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:46:45.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:46:45.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:45.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:45.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:46.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:46.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:46.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:46.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:46.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:46.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:46.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:46.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:46.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:46:46.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:46.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:46.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:46:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:46:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:46:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:46:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:46:47.082 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:46:47.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:46:47.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:46:47.083 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:46:47.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:46:47.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:46:47.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:46:47.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:46:47.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:46:47.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:46:47.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:46:47.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:46:47.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:46:47.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:46:47.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:46:47.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:46:47.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:46:48.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:46:48.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:46:48.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:46:48.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:46:48.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:46:48.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:46:48.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:46:48.841 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:494: TEST_backfill_remapped: expr 200 '*' 2 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:494: TEST_backfill_remapped: local misplaced=400 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:496: TEST_backfill_remapped: check td/osd-backfill-stats 1.0 0 replicated 0 0 400 200 '' '' false 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=0 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=0 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=400 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=200 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=false 2024-05-08T19:46:48.843 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log 2024-05-08T19:46:48.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.0.log 2024-05-08T19:46:48.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' false = true ']' 2024-05-08T19:46:48.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:46:48.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-05-08T19:46:48.849 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:46:48.849 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:46:48.849 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:46:48.849 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:46:48.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[3]/[0,1]' 2024-05-08T19:46:48.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[3]/[0,1]' ']' 2024-05-08T19:46:48.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:46:48.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:46:48.863 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:46:48.863 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [3]/[0,1] ' 2024-05-08T19:46:48.863 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:46:48.863 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:46:48.863 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:46:48.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=0 2024-05-08T19:46:48.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2024-05-08T19:46:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 0 0 2024-05-08T19:46:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-05-08T19:46:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:46:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-05-08T19:46:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:46:48.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:46:48.868 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:46:48.869 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:46:48.869 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=0 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 0 0 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:46:48.877 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:46:48.878 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:46:48.878 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [3]/[0,1] ' 2024-05-08T19:46:48.878 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:46:48.878 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:46:48.878 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:46:48.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=400 2024-05-08T19:46:48.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2024-05-08T19:46:48.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 400 400 2024-05-08T19:46:48.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-05-08T19:46:48.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:46:48.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-05-08T19:46:48.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:46:48.882 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:46:48.883 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:46:48.883 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:46:48.883 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:46:48.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=201 2024-05-08T19:46:48.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 201 ']' 2024-05-08T19:46:48.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 201 200 2024-05-08T19:46:48.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=201 2024-05-08T19:46:48.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:46:48.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=200 2024-05-08T19:46:48.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:46:48.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:46:48.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:498: TEST_backfill_remapped: delete_pool test 2024-05-08T19:46:48.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:46:48.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:46:49.661 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:46:49.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:499: TEST_backfill_remapped: kill_daemons td/osd-backfill-stats 2024-05-08T19:46:49.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:46:49.679 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:46:49.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:46:49.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:46:49.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:46:54.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:46:54.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:46:54.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:46:54.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:46:54.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:46:54.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:46:54.998 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:46:54.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:46:54.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:46:54.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:46:55.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:46:55.008 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:46:55.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:46:55.009 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:46:55.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:46:55.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:46:55.010 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:46:55.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:46:55.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:46:55.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:46:55.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:46:55.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:46:55.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:46:55.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:46:55.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:46:55.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:46:55.048 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:46:55.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:46:55.050 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:46:55.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:46:55.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:46:55.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:46:55.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:46:55.052 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:46:55.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:46:55.053 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:46:55.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:46:55.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:46:55.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:46:55.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:46:55.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:46:55.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:46:55.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:46:55.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:46:55.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:46:55.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:46:55.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:46:55.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:46:55.059 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:46:55.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:46:55.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:46:55.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:46:55.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:46:55.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:46:55.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:46:55.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:46:55.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:46:55.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:46:55.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:46:55.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup td/osd-backfill-stats 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:133: TEST_backfill_sizeup: local dir=td/osd-backfill-stats 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:135: TEST_backfill_sizeup: run_mon td/osd-backfill-stats a 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:46:55.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:46:55.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:46:55.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:46:55.498 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:46:55.499 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:46:55.499 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:46:55.499 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:46:55.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:46:55.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:46:55.735 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:46:55.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:46:55.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:46:55.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:46:55.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:46:55.737 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:46:55.737 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:46:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:46:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:46:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:46:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:46:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:46:55.738 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:46:55.738 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:46:55.741 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:46:55.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:46:55.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:46:55.854 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:46:55.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:46:55.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:46:55.855 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:46:55.855 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:46:55.856 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:46:55.856 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:46:55.856 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:46:55.857 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:46:55.857 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:46:55.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:46:55.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:46:55.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:136: TEST_backfill_sizeup: run_mgr td/osd-backfill-stats x 2024-05-08T19:46:55.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:46:55.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:46:55.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:46:55.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:46:55.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:46:55.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:46:56.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:46:56.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:46:56.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:46:56.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:46:56.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:46:56.924 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:46:56.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:46:56.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:46:56.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:46:56.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:137: TEST_backfill_sizeup: export CEPH_ARGS 2024-05-08T19:46:56.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:138: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 0 2024-05-08T19:46:56.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:46:56.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:46:56.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:46:56.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:46:56.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:46:56.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:46:56.963 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:46:56.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=d01a88ea-eb13-4ebd-8b28-0dafda6d6d42 2024-05-08T19:46:56.963 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 d01a88ea-eb13-4ebd-8b28-0dafda6d6d42 2024-05-08T19:46:56.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 d01a88ea-eb13-4ebd-8b28-0dafda6d6d42' 2024-05-08T19:46:56.964 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:46:56.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCw1jtmo6sDOxAA/4tigMuZWhaytQa02VUdKA== 2024-05-08T19:46:56.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCw1jtmo6sDOxAA/4tigMuZWhaytQa02VUdKA=="}' 2024-05-08T19:46:56.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new d01a88ea-eb13-4ebd-8b28-0dafda6d6d42 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:46:57.337 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:46:57.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:46:57.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCw1jtmo6sDOxAA/4tigMuZWhaytQa02VUdKA== --osd-uuid d01a88ea-eb13-4ebd-8b28-0dafda6d6d42 2024-05-08T19:46:57.386 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:46:57.390+0000 7f8ee218c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:46:57.414 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:46:57.418+0000 7f8ee218c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:46:57.415 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:46:57.422+0000 7f8ee218c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:46:57.416 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:46:57.422+0000 7f8ee218c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:46:57.416 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:46:57.422+0000 7f8ee218c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:46:57.416 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:46:57.422+0000 7f8ee218c7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:46:57.454 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:46:57.458+0000 7f8ee218c7c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:47:05.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:47:05.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:47:05.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:47:05.447 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:47:05.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:47:06.013 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:47:06.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:47:06.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:47:06.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:47:06.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:47:06.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:47:06.047 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:06.058+0000 7fe3047547c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:06.049 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:06.058+0000 7fe3047547c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:06.051 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:06.062+0000 7fe3047547c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:06.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:47:06.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:47:06.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:47:06.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:47:06.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:47:06.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:06.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:47:06.408 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:47:06.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:06.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:06.601 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:06.610+0000 7fe3047547c0 -1 Falling back to public interface 2024-05-08T19:47:06.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:07.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:07.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:07.801 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:47:07.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:47:07.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:07.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:08.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:09.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:09.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:09.215 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:47:09.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:47:09.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:09.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:09.415 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:09.426+0000 7fe3047547c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:47:09.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:10.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:10.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:10.671 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:47:10.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:47:10.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:10.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:11.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:12.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:12.106 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:12.107 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:47:12.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:47:12.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:12.107 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:12.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:13.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:13.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:13.601 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:47:13.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:47:13.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:13.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:14.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:15.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:15.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:15.103 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:47:15.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:47:15.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:15.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:15.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:16.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:16.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:16.589 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:47:16.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:47:16.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:16.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:17.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:18.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:18.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:18.008 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:47:18.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:47:18.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:18.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:18.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:19.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:19.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:19.695 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:47:19.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:47:19.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:19.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:20.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:21.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:21.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:21.200 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:47:21.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:47:21.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:21.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:21.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:22.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:22.841 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:47:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:47:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:22.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:23.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:24.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:24.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:24.520 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:47:24.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:47:24.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:24.520 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:24.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:25.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:25.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:25.992 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:47:25.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:47:25.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:25.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:26.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:27.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:27.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:27.533 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:47:27.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:47:27.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:27.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:28.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:29.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:29.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:29.360 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:47:29.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:47:29.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:29.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:30.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:31.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:31.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:31.221 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:47:31.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:47:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:31.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:32.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:33.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:33.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:33.153 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:47:33.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:47:33.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:33.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:34.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:35.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:35.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:35.140 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:47:35.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:47:35.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:35.140 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:36.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:37.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:37.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:37.173 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:47:37.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:47:37.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:37.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:38.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:39.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:39.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:39.610 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:47:39.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:47:39.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:39.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:40.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:41.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:41.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:41.991 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:47:41.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:47:41.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:41.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:47:42.410 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3971499366,v1:127.0.0.1:6803/3971499366] [v2:127.0.0.1:6804/3971499366,v1:127.0.0.1:6805/3971499366] exists,up d01a88ea-eb13-4ebd-8b28-0dafda6d6d42 2024-05-08T19:47:42.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:139: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 1 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:47:42.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:47:42.414 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:47:42.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:47:42.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:47:42.416 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:47:42.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=cc967b3b-06c0-4111-b4f1-7dc92cdcd4dd 2024-05-08T19:47:42.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 cc967b3b-06c0-4111-b4f1-7dc92cdcd4dd' 2024-05-08T19:47:42.417 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 cc967b3b-06c0-4111-b4f1-7dc92cdcd4dd 2024-05-08T19:47:42.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:47:42.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDe1jtmlyXKGhAAV93UpsVRgxdxNDLDzfPNOA== 2024-05-08T19:47:42.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDe1jtmlyXKGhAAV93UpsVRgxdxNDLDzfPNOA=="}' 2024-05-08T19:47:42.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new cc967b3b-06c0-4111-b4f1-7dc92cdcd4dd -i td/osd-backfill-stats/1/new.json 2024-05-08T19:47:42.993 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:47:43.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:47:43.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDe1jtmlyXKGhAAV93UpsVRgxdxNDLDzfPNOA== --osd-uuid cc967b3b-06c0-4111-b4f1-7dc92cdcd4dd 2024-05-08T19:47:43.049 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:43.058+0000 7ff84d16b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:43.054 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:43.062+0000 7ff84d16b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:43.054 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:43.062+0000 7ff84d16b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:43.054 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:43.062+0000 7ff84d16b7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:47:43.054 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:43.062+0000 7ff84d16b7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:47:43.054 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:43.062+0000 7ff84d16b7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:47:43.127 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:43.138+0000 7ff84d16b7c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:47:51.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:47:51.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:47:51.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:47:51.619 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:47:51.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:47:52.189 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:47:52.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:47:52.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:47:52.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:47:52.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:47:52.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:47:52.223 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:52.233+0000 7f6a597297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:52.284 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:52.293+0000 7f6a597297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:52.285 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:52.293+0000 7f6a597297c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:47:52.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:47:52.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:47:52.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:47:52.585 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:47:52.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:47:52.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:47:52.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:52.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:47:52.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:52.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:47:52.840 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:52.849+0000 7f6a597297c0 -1 Falling back to public interface 2024-05-08T19:47:52.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:54.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:54.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:54.002 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:47:54.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:47:54.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:54.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:47:54.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:55.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:55.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:55.459 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:47:55.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:47:55.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:55.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:47:55.721 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:47:55.729+0000 7f6a597297c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:47:55.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:56.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:56.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:56.994 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:47:56.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:47:56.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:56.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:47:57.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:58.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:58.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:58.464 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:47:58.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:47:58.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:58.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:47:58.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:47:59.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:47:59.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:47:59.945 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:47:59.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:47:59.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:47:59.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:00.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:01.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:01.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:01.716 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:48:01.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:48:01.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:01.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:02.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:03.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:03.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:03.252 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:48:03.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:48:03.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:03.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:03.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:04.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:04.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:04.762 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:48:04.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:48:04.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:04.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:05.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:06.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:06.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:06.439 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:48:06.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:48:06.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:06.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:07.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:08.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:08.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:08.102 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:48:08.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:48:08.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:08.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:08.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:09.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:09.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:09.609 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:48:09.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:48:09.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:09.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:10.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:11.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:11.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:11.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:48:11.208 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:48:11.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:11.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:11.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:12.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:12.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:12.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:48:12.665 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:48:12.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:12.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:13.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:14.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:14.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:14.396 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:48:14.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:48:14.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:14.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:14.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:15.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:15.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:15.915 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:48:15.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:48:15.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:15.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:17.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:18.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:18.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:18.236 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:48:18.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:48:18.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:18.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:19.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:20.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:20.770 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:20.771 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:48:20.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:48:20.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:20.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:21.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:22.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:22.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:22.685 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:48:22.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:48:22.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:22.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:23.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:24.630 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:24.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:24.631 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:48:24.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:48:24.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:24.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:25.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:26.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:26.575 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:26.575 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:48:26.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:48:26.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:26.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:27.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:28.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:28.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:28.543 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:48:28.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:48:28.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:28.544 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:28.969 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:29.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:29.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:29.972 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:48:29.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:48:29.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:29.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:48:30.437 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2602669969,v1:127.0.0.1:6811/2602669969] [v2:127.0.0.1:6812/2602669969,v1:127.0.0.1:6813/2602669969] exists,up cc967b3b-06c0-4111-b4f1-7dc92cdcd4dd 2024-05-08T19:48:30.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:48:30.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:140: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 2 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:48:30.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:48:30.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:48:30.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:48:30.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:48:30.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8ae0c155-4121-4fe9-a968-20b115bacb4c 2024-05-08T19:48:30.443 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 8ae0c155-4121-4fe9-a968-20b115bacb4c 2024-05-08T19:48:30.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 8ae0c155-4121-4fe9-a968-20b115bacb4c' 2024-05-08T19:48:30.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:48:30.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAO1ztm64hWHBAApcyK60dqe+Gbj4YGtrRobg== 2024-05-08T19:48:30.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAO1ztm64hWHBAApcyK60dqe+Gbj4YGtrRobg=="}' 2024-05-08T19:48:30.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8ae0c155-4121-4fe9-a968-20b115bacb4c -i td/osd-backfill-stats/2/new.json 2024-05-08T19:48:31.065 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:48:31.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:48:31.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAO1ztm64hWHBAApcyK60dqe+Gbj4YGtrRobg== --osd-uuid 8ae0c155-4121-4fe9-a968-20b115bacb4c 2024-05-08T19:48:31.120 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:31.129+0000 7fcdcea057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:48:31.123 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:31.133+0000 7fcdcea057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:48:31.124 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:31.133+0000 7fcdcea057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:48:31.125 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:31.133+0000 7fcdcea057c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:48:31.125 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:31.133+0000 7fcdcea057c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:48:31.125 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:31.133+0000 7fcdcea057c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:48:31.216 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:31.225+0000 7fcdcea057c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:48:39.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:48:39.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:48:39.419 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:48:39.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:48:39.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:48:39.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:48:39.992 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:48:39.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:48:39.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:48:39.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:48:39.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:48:40.026 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:40.032+0000 7f00186f17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:48:40.028 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:40.036+0000 7f00186f17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:48:40.029 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:40.036+0000 7f00186f17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:48:40.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:48:40.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:48:40.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:48:40.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:48:40.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:48:40.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:40.379 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:48:40.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:48:40.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:40.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:40.593 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:40.600+0000 7f00186f17c0 -1 Falling back to public interface 2024-05-08T19:48:40.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:41.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:41.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:41.784 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:48:41.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:48:41.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:41.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:42.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:43.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:43.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:43.187 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:48:43.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:48:43.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:43.188 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:43.408 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:48:43.416+0000 7f00186f17c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:48:43.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:44.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:44.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:44.743 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:48:44.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:48:44.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:44.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:45.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:46.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:46.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:46.221 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:48:46.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:48:46.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:46.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:46.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:47.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:47.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:47.713 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:48:47.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:48:47.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:47.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:48.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:49.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:49.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:49.366 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:48:49.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:48:49.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:49.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:49.947 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:50.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:50.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:50.949 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:48:50.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:48:50.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:50.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:51.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:52.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:52.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:52.375 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:48:52.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:48:52.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:52.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:52.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:53.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:53.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:53.893 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:48:53.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:48:53.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:53.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:54.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:55.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:55.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:55.400 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:48:55.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:48:55.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:55.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:55.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:56.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:56.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:56.988 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:48:56.988 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:48:56.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:56.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:57.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:58.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:58.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:58.401 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:48:58.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:48:58.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:58.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:48:58.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:48:59.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:48:59.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:48:59.961 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:48:59.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:48:59.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:48:59.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:00.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:01.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:01.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:01.572 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:49:01.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:49:01.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:01.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:02.052 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:03.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:03.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:03.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:49:03.054 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:49:03.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:03.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:03.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:04.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:04.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:04.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:49:04.686 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:49:04.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:04.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:05.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:06.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:06.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:06.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:49:06.596 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:49:06.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:06.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:07.798 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:08.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:08.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:08.800 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:49:08.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:49:08.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:08.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:09.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:10.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:10.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:10.502 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:49:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:49:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:10.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:11.269 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:12.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:12.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:12.271 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:49:12.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:49:12.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:12.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:12.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:13.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:13.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:13.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:49:13.992 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:49:13.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:13.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:15.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:16.359 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:49:16.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:49:16.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:16.360 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:49:16.885 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/583604700,v1:127.0.0.1:6819/583604700] [v2:127.0.0.1:6820/583604700,v1:127.0.0.1:6821/583604700] exists,up 8ae0c155-4121-4fe9-a968-20b115bacb4c 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:141: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 3 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:49:16.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:49:16.890 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:49:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:49:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:49:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:49:16.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:49:16.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:49:16.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:49:16.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:49:16.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:49:16.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:49:16.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:49:16.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=25105b80-6be5-4335-921e-715cc412f1b9 2024-05-08T19:49:16.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 25105b80-6be5-4335-921e-715cc412f1b9' 2024-05-08T19:49:16.897 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 25105b80-6be5-4335-921e-715cc412f1b9 2024-05-08T19:49:16.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:49:16.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA81ztmD8wZNxAADReWxbMfZuQxPVP5TrHQjA== 2024-05-08T19:49:16.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA81ztmD8wZNxAADReWxbMfZuQxPVP5TrHQjA=="}' 2024-05-08T19:49:16.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 25105b80-6be5-4335-921e-715cc412f1b9 -i td/osd-backfill-stats/3/new.json 2024-05-08T19:49:17.467 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:49:17.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:49:17.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA81ztmD8wZNxAADReWxbMfZuQxPVP5TrHQjA== --osd-uuid 25105b80-6be5-4335-921e-715cc412f1b9 2024-05-08T19:49:17.521 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:17.528+0000 7f31b5bc87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:49:17.563 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:17.572+0000 7f31b5bc87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:49:17.565 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:17.572+0000 7f31b5bc87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:49:17.565 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:17.572+0000 7f31b5bc87c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:49:17.566 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:17.572+0000 7f31b5bc87c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:49:17.566 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:17.572+0000 7f31b5bc87c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:49:17.659 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:17.668+0000 7f31b5bc87c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:49:25.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:49:25.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:49:25.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:49:25.979 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:49:25.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:49:26.546 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:49:26.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:49:26.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:49:26.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:49:26.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:49:26.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:49:26.581 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:26.588+0000 7f1b34e897c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:49:26.583 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:26.592+0000 7f1b34e897c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:49:26.584 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:26.592+0000 7f1b34e897c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:49:26.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:49:26.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:49:26.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:49:26.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:49:26.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:49:26.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:26.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:49:26.959 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:49:26.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:26.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:27.140 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:27.148+0000 7f1b34e897c0 -1 Falling back to public interface 2024-05-08T19:49:27.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:28.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:28.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:28.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:49:28.431 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:49:28.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:28.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:28.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:29.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:29.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:29.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:49:29.857 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:49:29.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:29.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:30.040 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:49:30.047+0000 7f1b34e897c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:49:30.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:31.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:31.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:31.294 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:49:31.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:49:31.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:31.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:31.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:32.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:32.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:32.829 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:49:32.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:49:32.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:32.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:33.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:34.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:34.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:34.497 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:49:34.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:49:34.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:34.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:35.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:36.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:36.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:36.087 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:49:36.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:49:36.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:36.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:36.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:37.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:37.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:37.702 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:49:37.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:49:37.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:37.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:38.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:39.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:39.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:39.130 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:49:39.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:49:39.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:39.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:39.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:40.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:40.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:40.665 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:49:40.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:49:40.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:40.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:41.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:42.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:42.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:42.093 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:49:42.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:49:42.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:42.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:42.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:43.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:43.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:43.933 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:49:43.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:49:43.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:43.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:44.492 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:45.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:45.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:45.494 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:49:45.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:49:45.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:45.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:46.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:47.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:47.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:47.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:49:47.016 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:49:47.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:47.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:47.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:48.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:48.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:48.536 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:49:48.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:49:48.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:48.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:49.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:50.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:50.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:50.061 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:49:50.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:49:50.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:50.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:50.510 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:51.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:51.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:51.512 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:49:51.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:49:51.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:51.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:52.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:53.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:53.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:53.050 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:49:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:49:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:53.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:53.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:54.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:54.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:54.713 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:49:54.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:49:54.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:54.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:55.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:56.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:56.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:56.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:49:56.410 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:49:56.410 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:56.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:57.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:49:58.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:49:58.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:49:58.264 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:49:58.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:49:58.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:49:58.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:49:59.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:00.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:00.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:00.244 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:50:00.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:50:00.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:00.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:50:01.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:02.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:02.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:02.119 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:50:02.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:50:02.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:02.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:50:03.218 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:04.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:04.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:04.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 23 2024-05-08T19:50:04.221 INFO:tasks.workunit.client.0.smithi117.stdout:23 2024-05-08T19:50:04.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:04.221 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:50:04.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:05.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:05.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:05.698 INFO:tasks.workunit.client.0.smithi117.stdout:24 2024-05-08T19:50:05.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 24 2024-05-08T19:50:05.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:05.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:50:06.123 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/358826435,v1:127.0.0.1:6827/358826435] [v2:127.0.0.1:6828/358826435,v1:127.0.0.1:6829/358826435] exists,up 25105b80-6be5-4335-921e-715cc412f1b9 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:142: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 4 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:50:06.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:50:06.128 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:50:06.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:50:06.130 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:50:06.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7351c380-f3be-450f-ad6a-d53ed13f58c1 2024-05-08T19:50:06.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 7351c380-f3be-450f-ad6a-d53ed13f58c1' 2024-05-08T19:50:06.131 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 7351c380-f3be-450f-ad6a-d53ed13f58c1 2024-05-08T19:50:06.131 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:50:06.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBu1ztm7LeyCRAAvP9Dw88O/0Ah571W58AI7g== 2024-05-08T19:50:06.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBu1ztm7LeyCRAAvP9Dw88O/0Ah571W58AI7g=="}' 2024-05-08T19:50:06.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7351c380-f3be-450f-ad6a-d53ed13f58c1 -i td/osd-backfill-stats/4/new.json 2024-05-08T19:50:06.688 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:50:06.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:50:06.707 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBu1ztm7LeyCRAAvP9Dw88O/0Ah571W58AI7g== --osd-uuid 7351c380-f3be-450f-ad6a-d53ed13f58c1 2024-05-08T19:50:06.744 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:06.751+0000 7f823ea047c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:06.746 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:06.751+0000 7f823ea047c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:06.747 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:06.755+0000 7f823ea047c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:06.747 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:06.755+0000 7f823ea047c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:50:06.747 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:06.755+0000 7f823ea047c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:50:06.748 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:06.755+0000 7f823ea047c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:50:06.831 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:06.839+0000 7f823ea047c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:50:15.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:50:15.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:50:15.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:50:15.129 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:50:15.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:50:15.747 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:50:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:50:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:50:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:50:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:50:15.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:50:15.782 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:15.791+0000 7f17a26817c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:15.814 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:15.823+0000 7f17a26817c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:15.816 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:15.823+0000 7f17a26817c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:16.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:50:16.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:50:16.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:50:16.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:50:16.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:50:16.202 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:50:16.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:16.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:50:16.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:16.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:16.383 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:16.391+0000 7f17a26817c0 -1 Falling back to public interface 2024-05-08T19:50:16.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:17.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:17.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:17.647 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:50:17.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:50:17.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:17.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:18.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:19.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:19.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:19.048 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:50:19.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:50:19.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:19.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:19.230 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:19.239+0000 7f17a26817c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:50:19.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:20.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:20.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:20.635 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:50:20.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:50:20.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:20.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:21.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:22.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:22.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:22.153 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:50:22.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:50:22.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:22.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:22.726 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:23.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:23.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:23.729 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:50:23.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:50:23.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:23.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:24.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:25.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:25.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:25.513 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:50:25.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:50:25.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:25.514 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:26.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:27.070 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:50:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:50:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:27.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:27.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:28.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:28.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:28.682 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:50:28.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:50:28.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:28.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:29.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:30.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:30.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:30.590 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:50:30.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:50:30.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:30.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:31.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:32.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:32.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:32.076 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:50:32.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:50:32.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:32.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:32.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:33.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:33.649 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:50:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:50:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:34.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:35.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:35.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:35.441 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:50:35.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:50:35.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:35.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:35.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:36.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:36.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:36.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:50:36.892 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:50:36.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:36.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:37.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:38.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:38.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:38.495 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:50:38.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:50:38.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:38.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:39.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:40.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:40.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:40.182 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:50:40.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:50:40.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:40.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:41.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:42.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:42.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:42.294 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:50:42.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:50:42.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:42.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:43.471 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:44.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:44.472 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:44.473 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:50:44.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:50:44.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:44.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:45.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:46.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:46.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:46.260 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:50:46.260 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:50:46.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:46.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:47.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:48.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:48.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:48.313 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:50:48.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:50:48.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:48.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:49.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:50.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:50.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:50.375 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:50:50.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:50:50.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:50.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:51.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:50:52.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:50:52.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:50:52.683 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:50:52.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:50:52.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:50:52.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:50:53.114 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3180365765,v1:127.0.0.1:6835/3180365765] [v2:127.0.0.1:6836/3180365765,v1:127.0.0.1:6837/3180365765] exists,up 7351c380-f3be-450f-ad6a-d53ed13f58c1 2024-05-08T19:50:53.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:50:53.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:50:53.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:50:53.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:143: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 5 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/5 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:50:53.117 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:50:53.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:50:53.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:50:53.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:50:53.118 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:50:53.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:50:53.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:50:53.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:50:53.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:50:53.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:50:53.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:50:53.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:50:53.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/5 2024-05-08T19:50:53.121 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:50:53.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=d117db88-7520-47fa-862b-36eb999bb82b 2024-05-08T19:50:53.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 d117db88-7520-47fa-862b-36eb999bb82b' 2024-05-08T19:50:53.122 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 d117db88-7520-47fa-862b-36eb999bb82b 2024-05-08T19:50:53.122 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:50:53.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCd1ztmG4BmCRAAstSlA2G0mcix6DDGdRjBHQ== 2024-05-08T19:50:53.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCd1ztmG4BmCRAAstSlA2G0mcix6DDGdRjBHQ=="}' 2024-05-08T19:50:53.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new d117db88-7520-47fa-862b-36eb999bb82b -i td/osd-backfill-stats/5/new.json 2024-05-08T19:50:53.743 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:50:53.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/5/new.json 2024-05-08T19:50:53.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCd1ztmG4BmCRAAstSlA2G0mcix6DDGdRjBHQ== --osd-uuid d117db88-7520-47fa-862b-36eb999bb82b 2024-05-08T19:50:53.797 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:53.806+0000 7f6e69ee47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:53.799 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:53.810+0000 7f6e69ee47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:53.801 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:53.810+0000 7f6e69ee47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:50:53.801 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:53.810+0000 7f6e69ee47c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:50:53.801 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:53.810+0000 7f6e69ee47c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:50:53.801 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:53.810+0000 7f6e69ee47c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T19:50:53.876 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:50:53.886+0000 7f6e69ee47c0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-05-08T19:51:01.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-05-08T19:51:01.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:51:01.825 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T19:51:01.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T19:51:01.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:51:02.406 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T19:51:02.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T19:51:02.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:51:02.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:51:02.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:51:02.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:51:02.441 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:51:02.450+0000 7f2a89d347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:51:02.443 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:51:02.454+0000 7f2a89d347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:51:02.444 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:51:02.454+0000 7f2a89d347c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:51:02.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T19:51:02.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:51:02.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T19:51:02.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:51:02.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:51:02.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:02.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:51:02.823 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:51:02.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:02.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:03.016 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:51:03.026+0000 7f2a89d347c0 -1 Falling back to public interface 2024-05-08T19:51:03.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:04.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:04.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:04.230 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:51:04.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:51:04.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:04.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:04.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:05.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:05.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:05.643 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:51:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:51:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:05.864 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:51:05.874+0000 7f2a89d347c0 -1 osd.5 0 log_to_monitors true 2024-05-08T19:51:06.182 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:07.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:07.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:07.184 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:51:07.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:51:07.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:07.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:07.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:08.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:08.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:08.611 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:51:08.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:51:08.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:08.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:09.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:10.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:10.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:10.246 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:51:10.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:51:10.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:10.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:10.801 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:11.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:11.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:11.803 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:51:11.804 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:51:11.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:11.805 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:12.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:13.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:13.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:13.344 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:51:13.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:51:13.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:13.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:13.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:14.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:14.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:14.913 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:51:14.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:51:14.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:14.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:15.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:16.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:16.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:16.485 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:51:16.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:51:16.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:16.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:16.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:17.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:17.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:17.978 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:51:17.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:51:17.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:17.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:18.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:19.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:19.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:19.587 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:51:19.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:51:19.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:19.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:20.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:21.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:21.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:21.210 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:51:21.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:51:21.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:21.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:21.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:22.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:22.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:22.680 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:51:22.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:51:22.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:22.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:23.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:24.129 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:24.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:24.130 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:51:24.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:51:24.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:24.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:24.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:25.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:25.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:25.694 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:51:25.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:51:25.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:25.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:26.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:27.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:27.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:27.731 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:51:27.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:51:27.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:27.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:29.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:30.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:30.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:30.090 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:51:30.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:51:30.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:30.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:30.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:31.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:31.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:31.679 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:51:31.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:51:31.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:31.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:33.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:34.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:34.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:34.035 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:51:34.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:51:34.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:34.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:34.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:35.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:35.532 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:51:35.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:51:35.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:35.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:36.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:37.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:37.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:37.176 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:51:37.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:51:37.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:37.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:38.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:51:39.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:51:39.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:51:39.249 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:51:39.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:51:39.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:51:39.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T19:51:39.787 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3661308102,v1:127.0.0.1:6843/3661308102] [v2:127.0.0.1:6844/3661308102,v1:127.0.0.1:6845/3661308102] exists,up d117db88-7520-47fa-862b-36eb999bb82b 2024-05-08T19:51:39.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:51:39.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:51:39.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:51:39.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:145: TEST_backfill_sizeup: create_pool test 1 1 2024-05-08T19:51:39.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T19:51:40.734 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:51:40.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:51:41.755 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:146: TEST_backfill_sizeup: ceph osd pool set test size 1 --yes-i-really-mean-it 2024-05-08T19:51:43.276 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T19:51:43.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:148: TEST_backfill_sizeup: wait_for_clean 2024-05-08T19:51:43.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:51:43.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:51:43.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:51:43.301 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:51:43.301 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:51:43.301 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:51:43.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:51:43.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:51:43.302 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:51:43.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:51:43.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:51:43.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:51:43.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:51:43.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:51:43.418 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:51:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:51:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:51:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:51:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:51:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:51:44.065 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:51:44.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:51:44.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:51:44.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:51:44.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836543 2024-05-08T19:51:44.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836543 2024-05-08T19:51:44.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543' 2024-05-08T19:51:44.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:51:44.222 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:51:44.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673003 2024-05-08T19:51:44.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673003 2024-05-08T19:51:44.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673003' 2024-05-08T19:51:44.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:51:44.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:51:44.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509478 2024-05-08T19:51:44.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509478 2024-05-08T19:51:44.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673003 2-64424509478' 2024-05-08T19:51:44.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:51:44.522 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:51:44.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345951 2024-05-08T19:51:44.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345951 2024-05-08T19:51:44.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673003 2-64424509478 3-85899345951' 2024-05-08T19:51:44.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:51:44.678 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:51:44.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182415 2024-05-08T19:51:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182415 2024-05-08T19:51:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673003 2-64424509478 3-85899345951 4-107374182415' 2024-05-08T19:51:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:51:44.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:51:44.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018890 2024-05-08T19:51:44.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018890 2024-05-08T19:51:44.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836543 1-42949673003 2-64424509478 3-85899345951 4-107374182415 5-128849018890' 2024-05-08T19:51:44.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:51:44.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:51:44.976 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836543 2024-05-08T19:51:44.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:51:44.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836543 2024-05-08T19:51:44.978 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:51:44.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836543 2024-05-08T19:51:44.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836543' 2024-05-08T19:51:44.979 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836543 2024-05-08T19:51:44.979 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:51:45.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836541 -lt 21474836543 2024-05-08T19:51:45.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:51:46.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:51:46.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:51:46.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836543 -lt 21474836543 2024-05-08T19:51:46.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:51:46.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673003 2024-05-08T19:51:46.812 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:51:46.814 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:51:46.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673003 2024-05-08T19:51:46.815 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:51:46.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673003 2024-05-08T19:51:46.817 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673003 2024-05-08T19:51:46.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673003' 2024-05-08T19:51:46.817 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:51:47.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673004 -lt 42949673003 2024-05-08T19:51:47.229 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:51:47.229 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509478 2024-05-08T19:51:47.230 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:51:47.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:51:47.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:51:47.231 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509478 2024-05-08T19:51:47.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509478 2024-05-08T19:51:47.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509478' 2024-05-08T19:51:47.232 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509478 2024-05-08T19:51:47.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:51:47.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509478 -lt 64424509478 2024-05-08T19:51:47.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:51:47.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:51:47.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345951 2024-05-08T19:51:47.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:51:47.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:51:47.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345951 2024-05-08T19:51:47.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345951 2024-05-08T19:51:47.646 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345951 2024-05-08T19:51:47.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345951' 2024-05-08T19:51:47.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:51:48.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345952 -lt 85899345951 2024-05-08T19:51:48.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:51:48.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182415 2024-05-08T19:51:48.046 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:51:48.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:51:48.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182415 2024-05-08T19:51:48.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:51:48.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182415 2024-05-08T19:51:48.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182415' 2024-05-08T19:51:48.048 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182415 2024-05-08T19:51:48.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:51:48.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182415 -lt 107374182415 2024-05-08T19:51:48.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:51:48.502 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018890 2024-05-08T19:51:48.502 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:51:48.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:51:48.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018890 2024-05-08T19:51:48.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:51:48.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018890 2024-05-08T19:51:48.506 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018890 2024-05-08T19:51:48.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018890' 2024-05-08T19:51:48.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:51:48.897 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018890 -lt 128849018890 2024-05-08T19:51:48.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:51:48.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:51:48.898 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:51:49.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:51:49.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:51:49.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:51:49.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:51:49.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:51:49.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:51:49.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:51:49.451 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:51:49.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:51:49.847 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:51:49.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:51:49.848 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:51:50.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:51:50.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:51:50.394 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:51:50.394 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: seq 1 200 2024-05-08T19:51:50.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:50.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj1 /dev/null 2024-05-08T19:51:50.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:50.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj2 /dev/null 2024-05-08T19:51:50.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:50.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj3 /dev/null 2024-05-08T19:51:50.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:50.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj4 /dev/null 2024-05-08T19:51:50.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:50.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj5 /dev/null 2024-05-08T19:51:50.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:50.945 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj6 /dev/null 2024-05-08T19:51:51.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj7 /dev/null 2024-05-08T19:51:51.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj8 /dev/null 2024-05-08T19:51:51.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj9 /dev/null 2024-05-08T19:51:51.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj10 /dev/null 2024-05-08T19:51:51.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj11 /dev/null 2024-05-08T19:51:51.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj12 /dev/null 2024-05-08T19:51:51.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj13 /dev/null 2024-05-08T19:51:51.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj14 /dev/null 2024-05-08T19:51:51.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:51.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj15 /dev/null 2024-05-08T19:51:52.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj16 /dev/null 2024-05-08T19:51:52.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj17 /dev/null 2024-05-08T19:51:52.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj18 /dev/null 2024-05-08T19:51:52.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj19 /dev/null 2024-05-08T19:51:52.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj20 /dev/null 2024-05-08T19:51:52.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj21 /dev/null 2024-05-08T19:51:52.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj22 /dev/null 2024-05-08T19:51:52.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.850 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj23 /dev/null 2024-05-08T19:51:52.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:52.943 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj24 /dev/null 2024-05-08T19:51:53.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj25 /dev/null 2024-05-08T19:51:53.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.145 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj26 /dev/null 2024-05-08T19:51:53.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj27 /dev/null 2024-05-08T19:51:53.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj28 /dev/null 2024-05-08T19:51:53.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj29 /dev/null 2024-05-08T19:51:53.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj30 /dev/null 2024-05-08T19:51:53.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj31 /dev/null 2024-05-08T19:51:53.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.796 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj32 /dev/null 2024-05-08T19:51:53.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj33 /dev/null 2024-05-08T19:51:53.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:53.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj34 /dev/null 2024-05-08T19:51:54.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj35 /dev/null 2024-05-08T19:51:54.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.239 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj36 /dev/null 2024-05-08T19:51:54.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj37 /dev/null 2024-05-08T19:51:54.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.412 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj38 /dev/null 2024-05-08T19:51:54.496 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj39 /dev/null 2024-05-08T19:51:54.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.581 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj40 /dev/null 2024-05-08T19:51:54.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj41 /dev/null 2024-05-08T19:51:54.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj42 /dev/null 2024-05-08T19:51:54.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj43 /dev/null 2024-05-08T19:51:54.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:54.948 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj44 /dev/null 2024-05-08T19:51:55.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj45 /dev/null 2024-05-08T19:51:55.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj46 /dev/null 2024-05-08T19:51:55.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj47 /dev/null 2024-05-08T19:51:55.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj48 /dev/null 2024-05-08T19:51:55.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj49 /dev/null 2024-05-08T19:51:55.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj50 /dev/null 2024-05-08T19:51:55.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj51 /dev/null 2024-05-08T19:51:55.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj52 /dev/null 2024-05-08T19:51:55.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj53 /dev/null 2024-05-08T19:51:55.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:55.968 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj54 /dev/null 2024-05-08T19:51:56.109 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj55 /dev/null 2024-05-08T19:51:56.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj56 /dev/null 2024-05-08T19:51:56.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj57 /dev/null 2024-05-08T19:51:56.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.411 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj58 /dev/null 2024-05-08T19:51:56.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj59 /dev/null 2024-05-08T19:51:56.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj60 /dev/null 2024-05-08T19:51:56.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj61 /dev/null 2024-05-08T19:51:56.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.854 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj62 /dev/null 2024-05-08T19:51:56.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:56.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj63 /dev/null 2024-05-08T19:51:57.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj64 /dev/null 2024-05-08T19:51:57.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj65 /dev/null 2024-05-08T19:51:57.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj66 /dev/null 2024-05-08T19:51:57.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.321 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj67 /dev/null 2024-05-08T19:51:57.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj68 /dev/null 2024-05-08T19:51:57.522 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj69 /dev/null 2024-05-08T19:51:57.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj70 /dev/null 2024-05-08T19:51:57.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.740 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj71 /dev/null 2024-05-08T19:51:57.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj72 /dev/null 2024-05-08T19:51:57.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:57.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj73 /dev/null 2024-05-08T19:51:58.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.049 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj74 /dev/null 2024-05-08T19:51:58.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj75 /dev/null 2024-05-08T19:51:58.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj76 /dev/null 2024-05-08T19:51:58.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj77 /dev/null 2024-05-08T19:51:58.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj78 /dev/null 2024-05-08T19:51:58.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj79 /dev/null 2024-05-08T19:51:58.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj80 /dev/null 2024-05-08T19:51:58.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj81 /dev/null 2024-05-08T19:51:58.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:58.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj82 /dev/null 2024-05-08T19:51:59.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj83 /dev/null 2024-05-08T19:51:59.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj84 /dev/null 2024-05-08T19:51:59.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj85 /dev/null 2024-05-08T19:51:59.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj86 /dev/null 2024-05-08T19:51:59.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj87 /dev/null 2024-05-08T19:51:59.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj88 /dev/null 2024-05-08T19:51:59.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj89 /dev/null 2024-05-08T19:51:59.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.745 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj90 /dev/null 2024-05-08T19:51:59.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj91 /dev/null 2024-05-08T19:51:59.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:51:59.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj92 /dev/null 2024-05-08T19:52:00.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj93 /dev/null 2024-05-08T19:52:00.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj94 /dev/null 2024-05-08T19:52:00.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj95 /dev/null 2024-05-08T19:52:00.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj96 /dev/null 2024-05-08T19:52:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj97 /dev/null 2024-05-08T19:52:00.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj98 /dev/null 2024-05-08T19:52:00.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj99 /dev/null 2024-05-08T19:52:00.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj100 /dev/null 2024-05-08T19:52:00.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj101 /dev/null 2024-05-08T19:52:00.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:00.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj102 /dev/null 2024-05-08T19:52:01.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj103 /dev/null 2024-05-08T19:52:01.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj104 /dev/null 2024-05-08T19:52:01.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj105 /dev/null 2024-05-08T19:52:01.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj106 /dev/null 2024-05-08T19:52:01.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj107 /dev/null 2024-05-08T19:52:01.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj108 /dev/null 2024-05-08T19:52:01.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj109 /dev/null 2024-05-08T19:52:01.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj110 /dev/null 2024-05-08T19:52:01.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:01.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj111 /dev/null 2024-05-08T19:52:02.059 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj112 /dev/null 2024-05-08T19:52:02.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj113 /dev/null 2024-05-08T19:52:02.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj114 /dev/null 2024-05-08T19:52:02.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj115 /dev/null 2024-05-08T19:52:02.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.511 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj116 /dev/null 2024-05-08T19:52:02.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj117 /dev/null 2024-05-08T19:52:02.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj118 /dev/null 2024-05-08T19:52:02.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj119 /dev/null 2024-05-08T19:52:02.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:02.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj120 /dev/null 2024-05-08T19:52:03.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj121 /dev/null 2024-05-08T19:52:03.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj122 /dev/null 2024-05-08T19:52:03.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj123 /dev/null 2024-05-08T19:52:03.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj124 /dev/null 2024-05-08T19:52:03.390 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.391 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj125 /dev/null 2024-05-08T19:52:03.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj126 /dev/null 2024-05-08T19:52:03.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.573 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj127 /dev/null 2024-05-08T19:52:03.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.748 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj128 /dev/null 2024-05-08T19:52:03.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj129 /dev/null 2024-05-08T19:52:03.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:03.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj130 /dev/null 2024-05-08T19:52:04.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj131 /dev/null 2024-05-08T19:52:04.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj132 /dev/null 2024-05-08T19:52:04.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj133 /dev/null 2024-05-08T19:52:04.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj134 /dev/null 2024-05-08T19:52:04.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj135 /dev/null 2024-05-08T19:52:04.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj136 /dev/null 2024-05-08T19:52:04.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj137 /dev/null 2024-05-08T19:52:04.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj138 /dev/null 2024-05-08T19:52:04.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:04.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj139 /dev/null 2024-05-08T19:52:05.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj140 /dev/null 2024-05-08T19:52:05.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj141 /dev/null 2024-05-08T19:52:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj142 /dev/null 2024-05-08T19:52:05.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj143 /dev/null 2024-05-08T19:52:05.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj144 /dev/null 2024-05-08T19:52:05.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj145 /dev/null 2024-05-08T19:52:05.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj146 /dev/null 2024-05-08T19:52:05.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj147 /dev/null 2024-05-08T19:52:05.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj148 /dev/null 2024-05-08T19:52:05.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:05.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj149 /dev/null 2024-05-08T19:52:06.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj150 /dev/null 2024-05-08T19:52:06.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj151 /dev/null 2024-05-08T19:52:06.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj152 /dev/null 2024-05-08T19:52:06.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj153 /dev/null 2024-05-08T19:52:06.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.506 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj154 /dev/null 2024-05-08T19:52:06.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj155 /dev/null 2024-05-08T19:52:06.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj156 /dev/null 2024-05-08T19:52:06.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.809 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj157 /dev/null 2024-05-08T19:52:06.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj158 /dev/null 2024-05-08T19:52:06.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:06.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj159 /dev/null 2024-05-08T19:52:07.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:07.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj160 /dev/null 2024-05-08T19:52:07.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:07.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj161 /dev/null 2024-05-08T19:52:07.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:07.560 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj162 /dev/null 2024-05-08T19:52:07.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:07.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj163 /dev/null 2024-05-08T19:52:07.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:07.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj164 /dev/null 2024-05-08T19:52:07.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:07.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj165 /dev/null 2024-05-08T19:52:07.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:07.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj166 /dev/null 2024-05-08T19:52:08.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj167 /dev/null 2024-05-08T19:52:08.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj168 /dev/null 2024-05-08T19:52:08.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj169 /dev/null 2024-05-08T19:52:08.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj170 /dev/null 2024-05-08T19:52:08.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj171 /dev/null 2024-05-08T19:52:08.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj172 /dev/null 2024-05-08T19:52:08.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj173 /dev/null 2024-05-08T19:52:08.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj174 /dev/null 2024-05-08T19:52:08.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:08.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj175 /dev/null 2024-05-08T19:52:09.038 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj176 /dev/null 2024-05-08T19:52:09.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.130 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj177 /dev/null 2024-05-08T19:52:09.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.222 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj178 /dev/null 2024-05-08T19:52:09.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj179 /dev/null 2024-05-08T19:52:09.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj180 /dev/null 2024-05-08T19:52:09.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj181 /dev/null 2024-05-08T19:52:09.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj182 /dev/null 2024-05-08T19:52:09.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj183 /dev/null 2024-05-08T19:52:09.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj184 /dev/null 2024-05-08T19:52:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:09.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj185 /dev/null 2024-05-08T19:52:10.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj186 /dev/null 2024-05-08T19:52:10.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.209 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj187 /dev/null 2024-05-08T19:52:10.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.300 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj188 /dev/null 2024-05-08T19:52:10.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj189 /dev/null 2024-05-08T19:52:10.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj190 /dev/null 2024-05-08T19:52:10.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj191 /dev/null 2024-05-08T19:52:10.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj192 /dev/null 2024-05-08T19:52:10.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj193 /dev/null 2024-05-08T19:52:10.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:10.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj194 /dev/null 2024-05-08T19:52:11.010 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:11.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj195 /dev/null 2024-05-08T19:52:11.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:11.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj196 /dev/null 2024-05-08T19:52:11.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:11.194 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj197 /dev/null 2024-05-08T19:52:11.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:11.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj198 /dev/null 2024-05-08T19:52:11.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:11.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj199 /dev/null 2024-05-08T19:52:11.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-05-08T19:52:11.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj200 /dev/null 2024-05-08T19:52:11.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:155: TEST_backfill_sizeup: ceph osd set nobackfill 2024-05-08T19:52:12.344 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:52:12.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:156: TEST_backfill_sizeup: ceph osd pool set test size 3 2024-05-08T19:52:13.415 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 3 2024-05-08T19:52:13.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:157: TEST_backfill_sizeup: sleep 2 2024-05-08T19:52:15.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:158: TEST_backfill_sizeup: ceph osd unset nobackfill 2024-05-08T19:52:16.420 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:52:16.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:160: TEST_backfill_sizeup: wait_for_clean 2024-05-08T19:52:16.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:52:16.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:52:16.442 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:52:16.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:52:16.443 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:52:16.443 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:52:16.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:52:16.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:52:16.443 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:52:16.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:52:16.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:52:16.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:52:16.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:52:16.563 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:52:16.563 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:52:17.252 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:52:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:52:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:52:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:52:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T19:52:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T19:52:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:52:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:52:17.253 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:52:17.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836551 2024-05-08T19:52:17.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836551 2024-05-08T19:52:17.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836551' 2024-05-08T19:52:17.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:52:17.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:52:17.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673012 2024-05-08T19:52:17.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673012 2024-05-08T19:52:17.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836551 1-42949673012' 2024-05-08T19:52:17.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:52:17.634 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:52:17.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509487 2024-05-08T19:52:17.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509487 2024-05-08T19:52:17.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836551 1-42949673012 2-64424509487' 2024-05-08T19:52:17.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:52:17.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:52:18.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345960 2024-05-08T19:52:18.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345960 2024-05-08T19:52:18.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836551 1-42949673012 2-64424509487 3-85899345960' 2024-05-08T19:52:18.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:52:18.045 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:52:18.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182424 2024-05-08T19:52:18.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182424 2024-05-08T19:52:18.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836551 1-42949673012 2-64424509487 3-85899345960 4-107374182424' 2024-05-08T19:52:18.201 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:52:18.202 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T19:52:18.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018898 2024-05-08T19:52:18.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018898 2024-05-08T19:52:18.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836551 1-42949673012 2-64424509487 3-85899345960 4-107374182424 5-128849018898' 2024-05-08T19:52:18.392 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:52:18.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836551 2024-05-08T19:52:18.393 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:52:18.393 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:52:18.394 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836551 2024-05-08T19:52:18.394 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:52:18.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836551 2024-05-08T19:52:18.395 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836551 2024-05-08T19:52:18.396 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836551' 2024-05-08T19:52:18.396 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:52:18.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836551 -lt 21474836551 2024-05-08T19:52:18.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:52:18.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673012 2024-05-08T19:52:18.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:52:18.852 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:52:18.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673012 2024-05-08T19:52:18.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:52:18.853 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673012 2024-05-08T19:52:18.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673012 2024-05-08T19:52:18.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673012' 2024-05-08T19:52:18.853 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:52:19.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673010 -lt 42949673012 2024-05-08T19:52:19.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:52:20.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:52:20.571 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:52:21.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673012 -lt 42949673012 2024-05-08T19:52:21.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:52:21.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509487 2024-05-08T19:52:21.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:52:21.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:52:21.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509487 2024-05-08T19:52:21.005 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:52:21.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509487 2024-05-08T19:52:21.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509487' 2024-05-08T19:52:21.007 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509487 2024-05-08T19:52:21.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:52:21.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509487 -lt 64424509487 2024-05-08T19:52:21.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:52:21.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345960 2024-05-08T19:52:21.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:52:21.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:52:21.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345960 2024-05-08T19:52:21.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:52:21.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345960 2024-05-08T19:52:21.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345960' 2024-05-08T19:52:21.594 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345960 2024-05-08T19:52:21.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:52:22.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345960 -lt 85899345960 2024-05-08T19:52:22.061 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:52:22.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182424 2024-05-08T19:52:22.062 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:52:22.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:52:22.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182424 2024-05-08T19:52:22.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:52:22.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182424 2024-05-08T19:52:22.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182424' 2024-05-08T19:52:22.065 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182424 2024-05-08T19:52:22.065 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:52:22.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182424 -lt 107374182424 2024-05-08T19:52:22.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:52:22.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018898 2024-05-08T19:52:22.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:52:22.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T19:52:22.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018898 2024-05-08T19:52:22.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:52:22.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018898 2024-05-08T19:52:22.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018898' 2024-05-08T19:52:22.659 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018898 2024-05-08T19:52:22.659 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T19:52:23.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018899 -lt 128849018898 2024-05-08T19:52:23.353 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:52:23.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:23.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:24.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:52:24.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:24.271 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:24.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:24.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:24.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:24.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:24.272 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:24.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:24.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:24.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:24.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:25.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:25.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:52:25.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:52:25.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:52:25.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:25.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:25.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:25.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:25.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:25.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:25.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:25.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:25.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:25.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:26.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:26.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:26.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:26.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:26.763 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:27.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:27.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:27.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:27.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:27.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:27.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:27.578 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:27.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:27.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:27.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:27.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:27.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:27.582 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:27.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:27.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:27.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:27.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:28.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:28.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:28.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:28.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:28.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:28.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:28.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:28.548 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:28.548 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:29.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:29.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:29.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:29.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:29.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:29.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:29.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:29.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:29.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:29.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:29.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:29.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:29.190 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:29.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:29.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:29.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:29.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:30.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:30.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:30.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:30.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:30.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:30.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:30.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:30.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:30.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:30.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:30.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:30.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:30.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:30.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:30.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:30.984 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:30.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:30.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:30.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:30.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:30.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:30.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:31.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:31.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:31.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:31.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:31.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:31.917 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:31.918 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:32.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:52:32.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:52:32.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:32.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:32.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:32.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:32.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:32.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:32.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:32.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:32.710 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:32.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:32.711 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:33.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:33.119 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:33.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:33.120 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:33.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:33.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:33.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:33.649 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:34.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:34.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:34.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:34.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:34.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:34.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:34.460 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:34.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:34.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:34.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:34.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:34.461 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:34.462 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:34.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:34.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:34.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:34.903 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:35.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:35.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:35.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:35.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:35.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:35.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:35.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:35.505 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:35.506 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:36.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:36.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:36.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:36.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:36.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:36.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:36.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:36.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:36.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:36.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:36.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:36.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:36.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:36.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:36.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:36.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:36.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:37.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:37.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:37.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:37.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:37.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:37.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:37.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:37.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:37.380 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:38.022 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:52:38.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:52:38.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:38.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:38.023 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:38.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:38.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:38.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:38.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:38.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:38.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:38.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:38.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:38.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:38.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:38.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:38.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:39.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:39.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:39.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:39.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:39.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:39.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:39.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:39.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:39.133 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:39.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:52:39.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:52:39.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:39.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:39.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:39.806 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:39.807 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:39.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:39.807 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:39.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:39.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:39.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:39.808 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:40.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:40.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:40.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:40.447 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:40.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:40.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:40.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:40.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:40.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:40.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:40.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:40.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:40.966 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:52:41.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:52:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:41.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:41.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:41.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:41.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:41.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:41.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:41.726 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:41.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:41.727 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:42.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:42.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:42.187 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:42.188 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:42.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:42.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:42.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:42.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:42.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:42.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:42.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:42.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:42.835 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:43.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:52:43.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:52:43.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:43.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:43.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:43.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:43.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:43.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:43.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:43.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:43.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:43.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:43.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:44.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:44.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:44.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:44.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:44.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:44.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:44.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:44.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:45.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:52:45.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:52:45.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:45.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:45.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:45.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:45.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:45.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:45.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:45.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:45.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:45.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:45.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:46.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:46.055 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:46.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:46.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:46.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:46.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:46.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:46.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:46.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:46.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:46.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:46.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:46.635 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:47.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:52:47.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:52:47.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:47.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:47.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:47.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:47.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:47.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:47.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:47.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:47.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:47.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:47.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:47.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:47.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:47.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:47.924 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:48.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:48.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:48.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:48.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:48.565 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:48.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:48.566 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:48.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:48.566 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:49.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:49.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:49.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:49.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:49.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:49.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:49.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:49.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:49.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:49.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:49.435 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:49.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:49.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:49.851 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:49.851 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:49.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:49.852 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:50.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:50.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:50.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:50.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:50.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:50.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:50.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:50.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:50.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:50.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:50.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:50.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:50.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:50.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:50.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:50.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:50.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:50.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:50.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:50.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:50.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:50.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:51.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:51.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:51.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:51.383 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:51.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:51.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:51.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:51.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:51.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:51.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:51.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:51.894 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:51.894 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:52.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:52:52.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:52:52.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:52.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:52.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:52.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:52.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:52.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:52.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:52.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:52.681 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:52.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:52.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:53.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:53.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:53.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:53.099 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:53.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:53.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:53.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:53.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:53.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:53.738 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:53.739 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:53.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:53.739 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:54.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:54.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:54.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:54.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:54.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:54.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:54.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:54.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:54.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:54.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:54.735 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:54.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:54.736 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:55.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:55.155 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:55.156 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:55.156 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:55.696 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:56.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:52:56.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:52:56.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:56.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:56.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:56.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:56.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:56.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:56.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:56.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:56.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:56.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:56.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:57.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:57.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:57.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:57.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:57.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:57.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:57.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:57.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:57.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:57.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:57.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:57.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:57.891 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:52:58.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:52:58.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:52:58.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:52:58.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:52:58.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:52:58.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:52:58.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:52:58.672 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:52:58.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:52:58.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:52:58.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:52:58.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:52:58.673 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:52:59.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:52:59.156 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:52:59.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:52:59.157 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:52:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:52:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:52:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:52:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:52:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:52:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:52:59.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:52:59.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:52:59.719 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:53:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:53:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:53:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:53:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:53:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:53:00.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:53:00.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:53:00.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:53:00.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:53:00.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:53:00.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:53:00.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:53:00.422 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:53:00.822 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:53:00.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:53:00.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:53:00.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:53:01.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:53:01.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:53:01.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:53:01.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:53:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:53:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:53:01.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:53:01.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:53:01.374 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:53:01.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:53:01.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:53:01.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:53:01.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:53:01.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:53:02.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:53:02.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:53:02.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:53:02.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:53:02.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:53:02.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:53:02.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:53:02.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:53:02.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:53:02.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:53:02.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:53:02.442 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:53:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:53:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:53:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:53:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:53:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:53:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:53:02.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:53:02.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:53:02.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:53:03.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:53:03.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:53:03.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:53:03.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:53:03.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:53:03.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:53:03.622 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:53:03.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:53:03.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:53:03.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:53:03.622 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:53:03.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:53:03.623 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:53:04.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:53:04.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:53:04.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:53:04.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:53:04.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:53:04.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:53:04.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:53:04.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:53:04.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:53:04.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:53:04.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:53:04.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:53:04.540 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:53:05.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T19:53:05.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T19:53:05.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:53:05.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:53:05.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:53:05.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:53:05.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:53:05.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:53:05.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:53:05.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:53:05.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:53:05.240 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:53:05.240 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:53:05.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:53:05.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:53:05.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:53:05.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:53:06.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:53:06.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:53:06.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:53:06.168 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:162: TEST_backfill_sizeup: get_primary test obj1 2024-05-08T19:53:06.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:53:06.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:53:06.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:53:06.169 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:53:06.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:162: TEST_backfill_sizeup: local primary=1 2024-05-08T19:53:06.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:163: TEST_backfill_sizeup: get_pg test obj1 2024-05-08T19:53:06.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:53:06.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:53:06.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:53:06.594 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:53:07.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:163: TEST_backfill_sizeup: local PG=1.0 2024-05-08T19:53:07.017 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:165: TEST_backfill_sizeup: expr 200 '*' 2 2024-05-08T19:53:07.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:165: TEST_backfill_sizeup: local degraded=400 2024-05-08T19:53:07.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:166: TEST_backfill_sizeup: check td/osd-backfill-stats 1.0 1 replicated 400 0 0 0 2024-05-08T19:53:07.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=400 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=0 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:53:07.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:53:07.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-05-08T19:53:07.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:53:07.041 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:53:07.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:53:07.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-05-08T19:53:07.043 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:53:07.043 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.043 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:53:07.044 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:53:07.062 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[1,0,2]/[1]' 2024-05-08T19:53:07.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[1,0,2]/[1]' ']' 2024-05-08T19:53:07.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:53:07.063 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:53:07.063 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.063 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [1,0,2]/[1] ' 2024-05-08T19:53:07.064 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:53:07.064 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:53:07.064 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:53:07.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=400 2024-05-08T19:53:07.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2024-05-08T19:53:07.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 400 400 2024-05-08T19:53:07.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-05-08T19:53:07.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:53:07.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-05-08T19:53:07.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:53:07.070 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:53:07.070 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.070 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:53:07.071 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:53:07.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=2 2024-05-08T19:53:07.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2024-05-08T19:53:07.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 2 0 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [1,0,2]/[1] ' 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:53:07.080 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:53:07.081 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:53:07.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=0 2024-05-08T19:53:07.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2024-05-08T19:53:07.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 0 0 2024-05-08T19:53:07.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-05-08T19:53:07.085 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:53:07.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-05-08T19:53:07.086 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:53:07.086 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:53:07.086 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T19:53:07.086 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:53:07.086 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=0 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 0 0 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:168: TEST_backfill_sizeup: delete_pool test 2024-05-08T19:53:07.095 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:53:07.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:53:07.671 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:53:07.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:169: TEST_backfill_sizeup: kill_daemons td/osd-backfill-stats 2024-05-08T19:53:07.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:53:07.688 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:53:07.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:53:07.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:53:07.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:53:09.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:53:09.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:53:09.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:53:09.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:53:09.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:53:09.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:53:09.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:53:09.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:53:09.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:53:09.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:53:09.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:53:09.015 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:53:09.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:53:09.016 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:53:09.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:53:09.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:53:09.018 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:53:09.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:53:09.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:53:09.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:53:09.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:53:09.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:53:09.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:53:09.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:53:09.065 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:53:09.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:09.066 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:09.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:53:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:53:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:53:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:53:09.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:53:09.068 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:53:09.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:53:09.069 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:53:09.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:53:09.070 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:53:09.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:53:09.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:53:09.072 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:53:09.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:53:09.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:53:09.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:53:09.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:53:09.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:53:09.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:53:09.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:53:09.076 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:53:09.076 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:09.076 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:09.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:53:09.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:53:09.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:53:09.077 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:53:09.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:53:09.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:09.078 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:09.078 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:53:09.080 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:53:09.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:53:09.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup4_allout td/osd-backfill-stats 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:389: TEST_backfill_sizeup4_allout: local dir=td/osd-backfill-stats 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:391: TEST_backfill_sizeup4_allout: run_mon td/osd-backfill-stats a 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:53:09.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:53:09.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:53:09.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:53:09.542 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:53:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:53:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:09.543 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:53:09.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:53:09.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:53:09.788 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:53:09.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:53:09.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:53:09.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:53:09.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:53:09.789 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:53:09.789 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:53:09.790 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:53:09.790 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:53:09.790 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:09.790 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:09.791 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:53:09.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:53:09.791 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:53:09.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:53:09.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:53:09.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:53:09.904 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:53:09.905 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:53:09.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:53:10.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:392: TEST_backfill_sizeup4_allout: run_mgr td/osd-backfill-stats x 2024-05-08T19:53:10.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:53:10.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:53:10.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:53:10.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:53:10.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:53:10.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:53:10.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:53:10.956 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:53:10.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:53:10.957 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:53:10.957 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:10.957 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:10.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:53:10.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:53:10.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:53:11.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:393: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 0 2024-05-08T19:53:11.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:53:11.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:53:11.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:53:11.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:53:11.000 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:53:11.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:53:11.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:53:11.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:53:11.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:53:11.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:53:11.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:53:11.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:53:11.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:53:11.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:53:11.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:53:11.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:53:11.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:53:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:53:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:11.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:53:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:53:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:53:11.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:53:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:53:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:53:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:53:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:53:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:53:11.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:53:11.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:53:11.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:53:11.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:53:11.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:53:11.005 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:53:11.005 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6bf74fe5-23ee-40e6-96b2-c016019dbbc7 2024-05-08T19:53:11.006 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 6bf74fe5-23ee-40e6-96b2-c016019dbbc7 2024-05-08T19:53:11.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 6bf74fe5-23ee-40e6-96b2-c016019dbbc7' 2024-05-08T19:53:11.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:53:11.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAn2DtmDj2lARAAC3kHUdNEXFB5YEY3Bsn01w== 2024-05-08T19:53:11.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAn2DtmDj2lARAAC3kHUdNEXFB5YEY3Bsn01w=="}' 2024-05-08T19:53:11.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6bf74fe5-23ee-40e6-96b2-c016019dbbc7 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:53:11.365 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:53:11.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:53:11.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAn2DtmDj2lARAAC3kHUdNEXFB5YEY3Bsn01w== --osd-uuid 6bf74fe5-23ee-40e6-96b2-c016019dbbc7 2024-05-08T19:53:11.414 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:11.423+0000 7f687eb3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:11.450 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:11.459+0000 7f687eb3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:11.452 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:11.459+0000 7f687eb3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:11.453 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:11.459+0000 7f687eb3a7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:53:11.453 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:11.459+0000 7f687eb3a7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:53:11.453 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:11.459+0000 7f687eb3a7c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:53:11.490 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:11.499+0000 7f687eb3a7c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:53:19.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:53:19.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:53:19.304 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:53:19.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:53:19.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:53:19.844 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:53:19.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:53:19.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:53:19.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:53:19.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:53:19.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:53:19.878 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:19.883+0000 7fc32a6617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:19.880 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:19.887+0000 7fc32a6617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:19.881 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:19.887+0000 7fc32a6617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:20.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:53:20.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:53:20.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:53:20.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:53:20.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:53:20.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:20.262 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:53:20.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:53:20.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:20.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:20.431 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:20.439+0000 7fc32a6617c0 -1 Falling back to public interface 2024-05-08T19:53:20.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:21.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:21.708 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:21.708 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:53:21.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:53:21.709 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:21.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:22.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:23.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:23.126 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:23.126 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:53:23.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:53:23.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:23.127 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:23.307 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:23.315+0000 7fc32a6617c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:53:23.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:24.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:24.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:24.590 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:53:24.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:53:24.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:24.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:25.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:26.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:26.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:26.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:53:26.170 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:53:26.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:26.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:26.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:27.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:27.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:27.699 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:53:27.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:53:27.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:27.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:28.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:29.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:29.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:29.149 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:53:29.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:53:29.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:29.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:29.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:30.773 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:30.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:30.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:53:30.774 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:53:30.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:30.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:31.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:32.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:32.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:32.423 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:53:32.424 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:53:32.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:32.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:32.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:33.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:33.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:33.914 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:53:33.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:53:33.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:33.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:34.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:35.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:35.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:35.466 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:53:35.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:53:35.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:35.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:36.099 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:37.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:37.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:37.101 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:53:37.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:53:37.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:37.102 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:37.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:38.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:38.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:38.877 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:53:38.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:53:38.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:38.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:39.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:40.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:40.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:40.439 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:53:40.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:53:40.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:40.439 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:40.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:41.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:41.925 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:41.925 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:53:41.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:53:41.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:41.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:42.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:43.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:43.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:43.486 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:53:43.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:53:43.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:43.487 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:44.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:45.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:45.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:45.072 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:53:45.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:53:45.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:45.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:45.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:46.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:46.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:46.997 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:53:46.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:53:46.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:46.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:48.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:49.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:49.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:49.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:53:49.014 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:53:49.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:49.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:50.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:51.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:51.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:51.041 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:53:51.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:53:51.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:51.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:51.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:52.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:52.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:52.896 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:53:52.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:53:52.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:52.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:53.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:54.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:54.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:54.593 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:53:54.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:53:54.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:54.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:55.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:53:56.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:53:56.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:53:56.183 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:53:56.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:53:56.184 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:53:56.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:53:56.596 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/254167509,v1:127.0.0.1:6803/254167509] [v2:127.0.0.1:6804/254167509,v1:127.0.0.1:6805/254167509] exists,up 6bf74fe5-23ee-40e6-96b2-c016019dbbc7 2024-05-08T19:53:56.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:53:56.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:394: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 1 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:53:56.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:53:56.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:53:56.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:53:56.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:53:56.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:53:56.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:53:56.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:53:56.602 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:53:56.602 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:53:56.603 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:53:56.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:53:56.604 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:53:56.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=a63265da-09f4-42e2-b2d2-d38e5f0afe9e 2024-05-08T19:53:56.604 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 a63265da-09f4-42e2-b2d2-d38e5f0afe9e' 2024-05-08T19:53:56.604 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 a63265da-09f4-42e2-b2d2-d38e5f0afe9e 2024-05-08T19:53:56.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:53:56.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBU2DtmTV6XJRAAjldlNC1tuKNLYC9sWHDg+Q== 2024-05-08T19:53:56.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBU2DtmTV6XJRAAjldlNC1tuKNLYC9sWHDg+Q=="}' 2024-05-08T19:53:56.619 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new a63265da-09f4-42e2-b2d2-d38e5f0afe9e -i td/osd-backfill-stats/1/new.json 2024-05-08T19:53:57.207 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:53:57.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:53:57.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBU2DtmTV6XJRAAjldlNC1tuKNLYC9sWHDg+Q== --osd-uuid a63265da-09f4-42e2-b2d2-d38e5f0afe9e 2024-05-08T19:53:57.260 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:57.266+0000 7fa45a83e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:57.262 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:57.270+0000 7fa45a83e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:57.263 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:57.270+0000 7fa45a83e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:53:57.264 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:57.270+0000 7fa45a83e7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:53:57.264 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:57.270+0000 7fa45a83e7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:53:57.264 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:57.270+0000 7fa45a83e7c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:53:57.324 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:53:57.330+0000 7fa45a83e7c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:54:05.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:54:05.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:54:05.369 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:54:05.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:54:05.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:54:05.928 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:54:05.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:54:05.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:54:05.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:54:05.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:54:05.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:54:05.962 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:05.970+0000 7f82f3fad7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:06.005 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:06.014+0000 7f82f3fad7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:06.006 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:06.018+0000 7f82f3fad7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:06.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:54:06.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:54:06.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:54:06.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:54:06.340 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:54:06.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:54:06.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:06.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:54:06.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:06.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:06.567 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:06.578+0000 7f82f3fad7c0 -1 Falling back to public interface 2024-05-08T19:54:06.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:07.765 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:07.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:07.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:54:07.766 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:54:07.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:07.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:08.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:09.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:09.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:09.214 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:54:09.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:54:09.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:09.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:09.377 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:09.386+0000 7f82f3fad7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:54:09.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:10.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:10.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:10.684 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:54:10.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:54:10.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:10.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:11.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:12.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:12.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:12.225 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:54:12.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:54:12.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:12.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:12.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:13.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:13.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:54:13.731 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:54:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:13.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:14.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:15.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:15.435 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:15.435 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:54:15.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:54:15.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:15.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:15.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:16.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:16.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:16.908 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:54:16.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:54:16.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:16.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:17.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:18.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:18.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:18.353 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:54:18.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:54:18.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:18.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:18.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:19.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:19.939 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:19.939 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:54:19.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:54:19.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:19.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:20.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:21.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:21.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:21.594 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:54:21.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:54:21.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:21.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:22.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:23.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:23.073 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:23.073 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:54:23.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:54:23.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:23.074 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:23.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:24.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:24.636 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:24.636 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:54:24.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:54:24.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:24.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:25.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:26.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:26.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:26.240 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:54:26.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:54:26.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:26.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:26.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:27.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:27.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:27.717 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:54:27.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:54:27.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:27.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:28.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:29.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:29.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:29.355 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:54:29.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:54:29.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:29.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:30.290 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:31.291 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:31.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:31.292 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:54:31.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:54:31.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:31.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:32.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:33.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:33.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:33.339 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:54:33.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:54:33.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:33.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:34.380 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:35.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:35.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:35.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:54:35.383 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:54:35.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:35.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:36.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:37.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:37.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:37.337 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:54:37.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:54:37.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:37.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:38.230 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:39.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:39.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:39.232 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:54:39.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:54:39.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:39.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:39.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:40.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:40.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:40.994 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:54:40.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:54:40.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:40.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:41.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:42.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:42.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:42.587 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:54:42.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:54:42.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:42.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:54:43.086 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1566066814,v1:127.0.0.1:6811/1566066814] [v2:127.0.0.1:6812/1566066814,v1:127.0.0.1:6813/1566066814] exists,up a63265da-09f4-42e2-b2d2-d38e5f0afe9e 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:395: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 2 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:54:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:54:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:54:43.092 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:54:43.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T19:54:43.093 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:54:43.093 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=915ead38-d6a0-45d3-8997-ad7205a468df 2024-05-08T19:54:43.093 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 915ead38-d6a0-45d3-8997-ad7205a468df 2024-05-08T19:54:43.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 915ead38-d6a0-45d3-8997-ad7205a468df' 2024-05-08T19:54:43.094 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:54:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCD2DtmQVNfBxAAlOXk2L5ySC03Z/X3to7ALw== 2024-05-08T19:54:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCD2DtmQVNfBxAAlOXk2L5ySC03Z/X3to7ALw=="}' 2024-05-08T19:54:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 915ead38-d6a0-45d3-8997-ad7205a468df -i td/osd-backfill-stats/2/new.json 2024-05-08T19:54:43.647 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:54:43.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T19:54:43.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCD2DtmQVNfBxAAlOXk2L5ySC03Z/X3to7ALw== --osd-uuid 915ead38-d6a0-45d3-8997-ad7205a468df 2024-05-08T19:54:43.700 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:43.709+0000 7fc35b7b67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:43.702 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:43.713+0000 7fc35b7b67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:43.704 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:43.713+0000 7fc35b7b67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:43.704 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:43.713+0000 7fc35b7b67c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:54:43.704 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:43.713+0000 7fc35b7b67c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:54:43.704 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:43.713+0000 7fc35b7b67c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T19:54:43.773 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:43.781+0000 7fc35b7b67c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T19:54:51.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T19:54:51.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:54:51.936 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T19:54:51.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T19:54:51.936 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:54:52.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T19:54:52.549 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T19:54:52.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:54:52.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:54:52.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:54:52.550 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:54:52.582 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:52.593+0000 7f302b2fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:52.584 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:52.593+0000 7f302b2fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:52.585 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:52.593+0000 7f302b2fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:54:52.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T19:54:52.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:54:52.963 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:54:52.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T19:54:52.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:54:52.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:54:52.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:52.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:54:52.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:54:52.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:53.135 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:53.145+0000 7f302b2fb7c0 -1 Falling back to public interface 2024-05-08T19:54:53.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:54.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:54.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:54.421 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:54:54.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:54:54.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:54.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:54:54.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:55.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:55.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:55.855 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:54:55.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:54:55.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:55.856 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:54:56.110 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:54:56.121+0000 7f302b2fb7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T19:54:56.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:57.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:57.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:57.384 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:54:57.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:54:57.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:57.385 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:54:58.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:54:59.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:54:59.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:54:59.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:54:59.141 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:54:59.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:54:59.142 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:54:59.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:00.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:00.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:00.703 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:55:00.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:55:00.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:00.703 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:01.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:02.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:02.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:02.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:55:02.225 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:55:02.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:02.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:02.921 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:03.922 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:03.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:03.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:55:03.923 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:55:03.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:03.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:04.453 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:05.454 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:05.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:05.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:55:05.455 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:55:05.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:05.455 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:05.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:06.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:06.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:06.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:55:06.966 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:55:06.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:06.967 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:07.478 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:08.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:08.480 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:08.480 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:55:08.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:55:08.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:08.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:09.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:10.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:10.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:10.113 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:55:10.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:55:10.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:10.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:10.552 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:11.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:11.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:11.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:55:11.554 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:55:11.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:11.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:12.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:13.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:13.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:13.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:55:13.048 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:55:13.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:13.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:13.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:14.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:14.599 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:14.600 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:55:14.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:55:14.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:14.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:15.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:16.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:16.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:16.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:55:16.155 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:55:16.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:16.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:17.012 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:18.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:18.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:18.014 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:55:18.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:55:18.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:18.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:18.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:19.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:19.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:19.571 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:55:19.572 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:55:19.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:19.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:20.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:21.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:21.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:21.650 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:55:21.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:55:21.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:21.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:22.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:23.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:23.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:23.264 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:55:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:55:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:24.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:25.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:25.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:25.333 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:55:25.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:55:25.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:25.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:26.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:27.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:27.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:27.483 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:55:27.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:55:27.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:27.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:28.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:29.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:29.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:29.684 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:55:29.685 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:55:29.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:29.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T19:55:30.202 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1815695963,v1:127.0.0.1:6819/1815695963] [v2:127.0.0.1:6820/1815695963,v1:127.0.0.1:6821/1815695963] exists,up 915ead38-d6a0-45d3-8997-ad7205a468df 2024-05-08T19:55:30.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:55:30.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:55:30.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:55:30.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:396: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 3 2024-05-08T19:55:30.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:55:30.205 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:55:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:55:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:55:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:55:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:55:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:55:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T19:55:30.207 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:55:30.208 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 393789b5-3e4a-40e4-a9b4-90ffd59f8ba2 2024-05-08T19:55:30.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=393789b5-3e4a-40e4-a9b4-90ffd59f8ba2 2024-05-08T19:55:30.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 393789b5-3e4a-40e4-a9b4-90ffd59f8ba2' 2024-05-08T19:55:30.208 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:55:30.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCy2Dtmb6l+DhAAUjOb3hjWkv+B/81+zQv9uw== 2024-05-08T19:55:30.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCy2Dtmb6l+DhAAUjOb3hjWkv+B/81+zQv9uw=="}' 2024-05-08T19:55:30.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 393789b5-3e4a-40e4-a9b4-90ffd59f8ba2 -i td/osd-backfill-stats/3/new.json 2024-05-08T19:55:30.821 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:55:30.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T19:55:30.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCy2Dtmb6l+DhAAUjOb3hjWkv+B/81+zQv9uw== --osd-uuid 393789b5-3e4a-40e4-a9b4-90ffd59f8ba2 2024-05-08T19:55:30.874 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:30.884+0000 7f7012b967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:55:30.876 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:30.884+0000 7f7012b967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:55:30.877 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:30.888+0000 7f7012b967c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:55:30.878 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:30.888+0000 7f7012b967c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:55:30.878 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:30.888+0000 7f7012b967c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:55:30.878 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:30.888+0000 7f7012b967c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T19:55:30.938 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:30.948+0000 7f7012b967c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T19:55:39.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T19:55:39.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:55:39.235 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T19:55:39.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T19:55:39.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:55:39.832 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T19:55:39.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T19:55:39.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:55:39.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:55:39.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:55:39.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:55:39.866 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:39.876+0000 7ff804ad37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:55:39.868 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:39.876+0000 7ff804ad37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:55:39.869 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:39.876+0000 7ff804ad37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:55:40.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T19:55:40.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:55:40.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T19:55:40.250 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:55:40.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:55:40.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:55:40.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:40.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:55:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:40.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:40.431 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:40.440+0000 7ff804ad37c0 -1 Falling back to public interface 2024-05-08T19:55:40.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:41.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:41.685 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:41.685 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:55:41.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:55:41.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:41.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:42.087 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:43.090 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:43.090 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:55:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:55:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:43.091 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:43.421 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:55:43.428+0000 7ff804ad37c0 -1 osd.3 0 log_to_monitors true 2024-05-08T19:55:43.528 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:44.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:44.530 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:44.530 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:55:44.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:55:44.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:44.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:45.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:46.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:46.152 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:46.152 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:55:46.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:55:46.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:46.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:46.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:47.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:47.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:47.633 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:55:47.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:55:47.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:47.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:48.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:49.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:49.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:49.114 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:55:49.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:55:49.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:49.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:49.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:50.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:50.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:50.643 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:55:50.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:55:50.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:50.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:51.120 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:52.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:52.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:52.123 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:55:52.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:55:52.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:52.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:52.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:53.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:53.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:53.653 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:55:53.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:55:53.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:53.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:54.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:55.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:55.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:55.199 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:55:55.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:55:55.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:55.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:55.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:56.791 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:55:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:55:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:57.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:58.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:58.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:58.325 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:55:58.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:55:58.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:58.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:55:58.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:55:59.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:55:59.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:55:59.958 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:55:59.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:55:59.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:55:59.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:00.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:01.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:01.590 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:01.591 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:56:01.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:56:01.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:01.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:02.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:03.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:03.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:03.058 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:56:03.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:56:03.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:03.058 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:03.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:04.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:04.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:04.760 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:56:04.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:56:04.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:04.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:05.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:06.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:06.561 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:06.562 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:56:06.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:56:06.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:06.562 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:07.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:08.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:08.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:08.614 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:56:08.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:56:08.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:08.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:09.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:10.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:10.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:10.422 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:56:10.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:56:10.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:10.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:11.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:12.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:12.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:12.181 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:56:12.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:56:12.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:12.181 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:13.495 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:14.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:14.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:14.498 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:56:14.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:56:14.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:14.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:15.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:16.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:16.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:16.467 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:56:16.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:56:16.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:16.467 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T19:56:17.223 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3616402928,v1:127.0.0.1:6827/3616402928] [v2:127.0.0.1:6828/3616402928,v1:127.0.0.1:6829/3616402928] exists,up 393789b5-3e4a-40e4-a9b4-90ffd59f8ba2 2024-05-08T19:56:17.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:56:17.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:56:17.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:56:17.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:397: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 4 2024-05-08T19:56:17.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:56:17.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:56:17.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T19:56:17.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:56:17.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T19:56:17.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:56:17.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:56:17.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:56:17.232 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:56:17.233 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:56:17.234 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:56:17.234 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:56:17.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:56:17.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:56:17.234 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:56:17.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:56:17.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:56:17.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:56:17.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:56:17.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:56:17.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:56:17.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:56:17.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:56:17.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:56:17.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T19:56:17.236 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:56:17.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7d2e96b0-ea09-463f-83e6-019a292f9268 2024-05-08T19:56:17.236 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 7d2e96b0-ea09-463f-83e6-019a292f9268' 2024-05-08T19:56:17.236 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 7d2e96b0-ea09-463f-83e6-019a292f9268 2024-05-08T19:56:17.237 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:56:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDh2DtmGB2/DxAAITpOTql9Qo/u05Kxmj4twA== 2024-05-08T19:56:17.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDh2DtmGB2/DxAAITpOTql9Qo/u05Kxmj4twA=="}' 2024-05-08T19:56:17.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7d2e96b0-ea09-463f-83e6-019a292f9268 -i td/osd-backfill-stats/4/new.json 2024-05-08T19:56:18.009 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:56:18.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T19:56:18.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDh2DtmGB2/DxAAITpOTql9Qo/u05Kxmj4twA== --osd-uuid 7d2e96b0-ea09-463f-83e6-019a292f9268 2024-05-08T19:56:18.061 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:18.068+0000 7f7944b057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:56:18.063 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:18.072+0000 7f7944b057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:56:18.064 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:18.072+0000 7f7944b057c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:56:18.065 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:18.072+0000 7f7944b057c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:56:18.065 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:18.072+0000 7f7944b057c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:56:18.065 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:18.072+0000 7f7944b057c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T19:56:18.125 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:18.132+0000 7f7944b057c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T19:56:26.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T19:56:26.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:56:26.371 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T19:56:26.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T19:56:26.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:56:26.928 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T19:56:26.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T19:56:26.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:56:26.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:56:26.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:56:26.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:56:26.962 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:26.971+0000 7f795a9e87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:56:26.964 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:26.971+0000 7f795a9e87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:56:26.965 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:26.971+0000 7f795a9e87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:56:27.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T19:56:27.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:56:27.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T19:56:27.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:56:27.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:56:27.344 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:27.345 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:56:27.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:56:27.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:27.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:27.535 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:27.543+0000 7f795a9e87c0 -1 Falling back to public interface 2024-05-08T19:56:27.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:28.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:28.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:28.790 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:56:28.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:56:28.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:28.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:29.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:30.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:30.207 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:56:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:56:30.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:30.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:30.539 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:56:30.547+0000 7f795a9e87c0 -1 osd.4 0 log_to_monitors true 2024-05-08T19:56:30.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:31.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:31.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:31.663 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:56:31.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:56:31.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:31.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:32.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:33.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:33.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:33.259 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:56:33.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:56:33.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:33.259 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:33.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:34.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:34.678 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:34.678 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:56:34.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:56:34.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:34.679 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:35.395 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:36.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:36.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:36.397 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:56:36.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:56:36.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:36.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:37.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:38.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:38.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:38.041 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:56:38.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:56:38.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:38.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:38.648 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:39.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:39.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:39.651 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:56:39.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:56:39.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:39.652 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:40.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:41.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:41.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:41.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:56:41.306 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:56:41.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:41.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:42.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:43.112 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:56:43.113 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:56:43.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:43.114 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:43.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:44.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:44.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:44.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:56:44.597 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:56:44.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:44.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:45.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:46.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:46.167 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:46.167 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:56:46.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:56:46.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:46.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:46.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:47.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:47.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:47.715 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:56:47.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:56:47.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:47.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:48.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:49.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:49.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:49.464 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:56:49.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:56:49.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:49.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:50.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:51.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:51.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:51.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:56:51.047 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:56:51.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:51.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:51.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:52.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:52.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:52.569 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:56:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:56:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:52.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:53.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:54.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:54.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:54.466 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:56:54.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:56:54.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:54.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:55.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:56.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:56.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:56.405 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:56:56.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:56:56.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:56.406 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:57.224 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:56:58.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:56:58.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:56:58.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:56:58.226 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:56:58.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:56:58.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:56:59.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:57:00.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:57:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:57:00.319 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:57:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:57:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:57:00.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:57:01.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:57:02.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:57:02.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:57:02.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:57:02.747 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:57:02.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:57:02.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:57:03.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:57:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:57:04.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:57:04.548 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:57:04.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:57:04.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:57:04.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T19:57:04.974 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1312548812,v1:127.0.0.1:6835/1312548812] [v2:127.0.0.1:6836/1312548812,v1:127.0.0.1:6837/1312548812] exists,up 7d2e96b0-ea09-463f-83e6-019a292f9268 2024-05-08T19:57:04.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:57:04.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:57:04.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:57:04.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:399: TEST_backfill_sizeup4_allout: create_pool test 1 1 2024-05-08T19:57:04.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T19:57:05.555 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T19:57:05.572 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T19:57:06.574 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:400: TEST_backfill_sizeup4_allout: ceph osd pool set test size 2 2024-05-08T19:57:07.333 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 2 2024-05-08T19:57:07.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:402: TEST_backfill_sizeup4_allout: wait_for_clean 2024-05-08T19:57:07.355 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:57:07.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:57:07.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:57:07.356 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:57:07.357 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:57:07.357 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:57:07.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:57:07.357 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:57:07.358 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:57:07.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:57:07.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:57:07.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:57:07.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:57:07.474 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:57:07.474 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:57:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:57:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:57:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:57:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:57:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T19:57:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:57:08.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:08.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:57:08.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836530 2024-05-08T19:57:08.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836530 2024-05-08T19:57:08.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836530' 2024-05-08T19:57:08.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:08.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:57:08.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949672997 2024-05-08T19:57:08.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949672997 2024-05-08T19:57:08.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836530 1-42949672997' 2024-05-08T19:57:08.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:08.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:57:08.845 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509467 2024-05-08T19:57:08.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509467 2024-05-08T19:57:08.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836530 1-42949672997 2-64424509467' 2024-05-08T19:57:08.846 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:08.846 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:57:09.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345937 2024-05-08T19:57:09.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345937 2024-05-08T19:57:09.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836530 1-42949672997 2-64424509467 3-85899345937' 2024-05-08T19:57:09.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:09.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:57:09.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182412 2024-05-08T19:57:09.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182412 2024-05-08T19:57:09.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836530 1-42949672997 2-64424509467 3-85899345937 4-107374182412' 2024-05-08T19:57:09.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:09.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836530 2024-05-08T19:57:09.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:09.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:57:09.312 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836530 2024-05-08T19:57:09.312 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:09.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836530 2024-05-08T19:57:09.313 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836530' 2024-05-08T19:57:09.314 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836530 2024-05-08T19:57:09.314 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:57:09.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836528 -lt 21474836530 2024-05-08T19:57:09.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:57:10.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:57:10.720 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:57:11.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836530 -lt 21474836530 2024-05-08T19:57:11.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:11.150 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949672997 2024-05-08T19:57:11.151 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:11.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:57:11.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949672997 2024-05-08T19:57:11.154 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:11.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949672997 2024-05-08T19:57:11.155 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949672997 2024-05-08T19:57:11.155 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949672997' 2024-05-08T19:57:11.155 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:57:11.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949672997 -lt 42949672997 2024-05-08T19:57:11.605 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:11.605 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:11.606 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509467 2024-05-08T19:57:11.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:57:11.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509467 2024-05-08T19:57:11.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:11.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509467 2024-05-08T19:57:11.609 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509467 2024-05-08T19:57:11.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509467' 2024-05-08T19:57:11.609 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:57:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509468 -lt 64424509467 2024-05-08T19:57:12.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:12.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345937 2024-05-08T19:57:12.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:12.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:57:12.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345937 2024-05-08T19:57:12.026 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:12.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345937 2024-05-08T19:57:12.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345937' 2024-05-08T19:57:12.027 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345937 2024-05-08T19:57:12.027 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:57:12.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345937 -lt 85899345937 2024-05-08T19:57:12.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:12.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182412 2024-05-08T19:57:12.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:12.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:57:12.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182412 2024-05-08T19:57:12.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:12.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182412 2024-05-08T19:57:12.483 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182412' 2024-05-08T19:57:12.484 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182412 2024-05-08T19:57:12.484 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:57:12.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182413 -lt 107374182412 2024-05-08T19:57:12.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:57:12.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:57:12.934 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:57:13.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:57:13.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:57:13.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:57:13.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:57:13.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:57:13.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:57:13.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:57:13.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:57:13.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:57:13.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:57:13.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:57:13.864 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:57:14.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:57:14.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:57:14.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:57:14.417 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: seq 1 200 2024-05-08T19:57:14.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:14.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj1 /dev/null 2024-05-08T19:57:14.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:14.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj2 /dev/null 2024-05-08T19:57:14.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:14.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj3 /dev/null 2024-05-08T19:57:14.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:14.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj4 /dev/null 2024-05-08T19:57:15.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:15.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj5 /dev/null 2024-05-08T19:57:15.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:15.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj6 /dev/null 2024-05-08T19:57:15.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:15.521 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj7 /dev/null 2024-05-08T19:57:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:15.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj8 /dev/null 2024-05-08T19:57:15.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:15.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj9 /dev/null 2024-05-08T19:57:15.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:15.964 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj10 /dev/null 2024-05-08T19:57:16.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:16.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj11 /dev/null 2024-05-08T19:57:16.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:16.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj12 /dev/null 2024-05-08T19:57:16.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:16.441 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj13 /dev/null 2024-05-08T19:57:16.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:16.608 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj14 /dev/null 2024-05-08T19:57:16.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:16.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj15 /dev/null 2024-05-08T19:57:16.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:16.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj16 /dev/null 2024-05-08T19:57:17.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:17.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj17 /dev/null 2024-05-08T19:57:17.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:17.118 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj18 /dev/null 2024-05-08T19:57:17.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:17.268 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj19 /dev/null 2024-05-08T19:57:17.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:17.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj20 /dev/null 2024-05-08T19:57:17.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:17.564 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj21 /dev/null 2024-05-08T19:57:17.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:17.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj22 /dev/null 2024-05-08T19:57:17.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:17.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj23 /dev/null 2024-05-08T19:57:17.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:17.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj24 /dev/null 2024-05-08T19:57:18.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:18.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj25 /dev/null 2024-05-08T19:57:18.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:18.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj26 /dev/null 2024-05-08T19:57:18.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:18.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj27 /dev/null 2024-05-08T19:57:18.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:18.531 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj28 /dev/null 2024-05-08T19:57:18.656 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:18.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj29 /dev/null 2024-05-08T19:57:18.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:18.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj30 /dev/null 2024-05-08T19:57:18.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:18.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj31 /dev/null 2024-05-08T19:57:19.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:19.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj32 /dev/null 2024-05-08T19:57:19.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:19.225 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj33 /dev/null 2024-05-08T19:57:19.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:19.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj34 /dev/null 2024-05-08T19:57:19.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:19.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj35 /dev/null 2024-05-08T19:57:19.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:19.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj36 /dev/null 2024-05-08T19:57:19.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:19.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj37 /dev/null 2024-05-08T19:57:19.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:19.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj38 /dev/null 2024-05-08T19:57:20.070 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:20.071 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj39 /dev/null 2024-05-08T19:57:20.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:20.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj40 /dev/null 2024-05-08T19:57:20.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:20.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj41 /dev/null 2024-05-08T19:57:20.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:20.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj42 /dev/null 2024-05-08T19:57:20.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:20.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj43 /dev/null 2024-05-08T19:57:20.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:20.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj44 /dev/null 2024-05-08T19:57:20.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:20.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj45 /dev/null 2024-05-08T19:57:21.098 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:21.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj46 /dev/null 2024-05-08T19:57:21.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:21.258 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj47 /dev/null 2024-05-08T19:57:21.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:21.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj48 /dev/null 2024-05-08T19:57:21.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:21.559 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj49 /dev/null 2024-05-08T19:57:21.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:21.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj50 /dev/null 2024-05-08T19:57:21.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:21.908 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj51 /dev/null 2024-05-08T19:57:22.026 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:22.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj52 /dev/null 2024-05-08T19:57:22.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:22.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj53 /dev/null 2024-05-08T19:57:22.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:22.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj54 /dev/null 2024-05-08T19:57:22.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:22.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj55 /dev/null 2024-05-08T19:57:22.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:22.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj56 /dev/null 2024-05-08T19:57:22.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:22.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj57 /dev/null 2024-05-08T19:57:22.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:22.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj58 /dev/null 2024-05-08T19:57:23.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:23.055 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj59 /dev/null 2024-05-08T19:57:23.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:23.180 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj60 /dev/null 2024-05-08T19:57:23.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:23.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj61 /dev/null 2024-05-08T19:57:23.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:23.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj62 /dev/null 2024-05-08T19:57:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:23.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj63 /dev/null 2024-05-08T19:57:23.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:23.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj64 /dev/null 2024-05-08T19:57:23.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:23.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj65 /dev/null 2024-05-08T19:57:24.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:24.075 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj66 /dev/null 2024-05-08T19:57:24.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:24.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj67 /dev/null 2024-05-08T19:57:24.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:24.444 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj68 /dev/null 2024-05-08T19:57:24.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:24.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj69 /dev/null 2024-05-08T19:57:24.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:24.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj70 /dev/null 2024-05-08T19:57:24.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:24.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj71 /dev/null 2024-05-08T19:57:25.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:25.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj72 /dev/null 2024-05-08T19:57:25.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:25.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj73 /dev/null 2024-05-08T19:57:25.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:25.271 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj74 /dev/null 2024-05-08T19:57:25.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:25.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj75 /dev/null 2024-05-08T19:57:25.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:25.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj76 /dev/null 2024-05-08T19:57:25.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:25.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj77 /dev/null 2024-05-08T19:57:25.847 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:25.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj78 /dev/null 2024-05-08T19:57:25.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:25.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj79 /dev/null 2024-05-08T19:57:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:26.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj80 /dev/null 2024-05-08T19:57:26.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:26.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj81 /dev/null 2024-05-08T19:57:26.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:26.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj82 /dev/null 2024-05-08T19:57:26.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:26.609 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj83 /dev/null 2024-05-08T19:57:26.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:26.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj84 /dev/null 2024-05-08T19:57:26.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:26.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj85 /dev/null 2024-05-08T19:57:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:27.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj86 /dev/null 2024-05-08T19:57:27.202 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:27.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj87 /dev/null 2024-05-08T19:57:27.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:27.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj88 /dev/null 2024-05-08T19:57:27.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:27.469 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj89 /dev/null 2024-05-08T19:57:27.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:27.586 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj90 /dev/null 2024-05-08T19:57:27.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:27.837 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj91 /dev/null 2024-05-08T19:57:27.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:27.963 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj92 /dev/null 2024-05-08T19:57:28.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:28.089 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj93 /dev/null 2024-05-08T19:57:28.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:28.272 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj94 /dev/null 2024-05-08T19:57:28.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:28.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj95 /dev/null 2024-05-08T19:57:28.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:28.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj96 /dev/null 2024-05-08T19:57:28.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:28.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj97 /dev/null 2024-05-08T19:57:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj98 /dev/null 2024-05-08T19:57:29.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:29.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj99 /dev/null 2024-05-08T19:57:29.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:29.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj100 /dev/null 2024-05-08T19:57:29.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:29.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj101 /dev/null 2024-05-08T19:57:29.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:29.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj102 /dev/null 2024-05-08T19:57:29.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:29.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj103 /dev/null 2024-05-08T19:57:29.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:29.716 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj104 /dev/null 2024-05-08T19:57:29.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:29.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj105 /dev/null 2024-05-08T19:57:29.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:29.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj106 /dev/null 2024-05-08T19:57:30.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:30.116 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj107 /dev/null 2024-05-08T19:57:30.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:30.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj108 /dev/null 2024-05-08T19:57:30.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:30.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj109 /dev/null 2024-05-08T19:57:30.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:30.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj110 /dev/null 2024-05-08T19:57:30.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:30.697 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj111 /dev/null 2024-05-08T19:57:30.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:30.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj112 /dev/null 2024-05-08T19:57:31.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:31.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj113 /dev/null 2024-05-08T19:57:31.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:31.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj114 /dev/null 2024-05-08T19:57:31.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:31.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj115 /dev/null 2024-05-08T19:57:31.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:31.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj116 /dev/null 2024-05-08T19:57:31.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:31.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj117 /dev/null 2024-05-08T19:57:31.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:31.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj118 /dev/null 2024-05-08T19:57:31.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:31.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj119 /dev/null 2024-05-08T19:57:32.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:32.044 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj120 /dev/null 2024-05-08T19:57:32.226 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:32.227 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj121 /dev/null 2024-05-08T19:57:32.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:32.371 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj122 /dev/null 2024-05-08T19:57:32.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:32.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj123 /dev/null 2024-05-08T19:57:32.645 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:32.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj124 /dev/null 2024-05-08T19:57:32.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:32.762 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj125 /dev/null 2024-05-08T19:57:32.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:32.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj126 /dev/null 2024-05-08T19:57:33.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:33.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj127 /dev/null 2024-05-08T19:57:33.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:33.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj128 /dev/null 2024-05-08T19:57:33.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:33.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj129 /dev/null 2024-05-08T19:57:33.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:33.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj130 /dev/null 2024-05-08T19:57:33.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:33.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj131 /dev/null 2024-05-08T19:57:33.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:33.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj132 /dev/null 2024-05-08T19:57:33.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:33.892 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj133 /dev/null 2024-05-08T19:57:34.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:34.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj134 /dev/null 2024-05-08T19:57:34.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:34.192 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj135 /dev/null 2024-05-08T19:57:34.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:34.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj136 /dev/null 2024-05-08T19:57:34.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:34.486 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj137 /dev/null 2024-05-08T19:57:34.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:34.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj138 /dev/null 2024-05-08T19:57:34.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:34.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj139 /dev/null 2024-05-08T19:57:34.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:34.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj140 /dev/null 2024-05-08T19:57:35.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:35.004 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj141 /dev/null 2024-05-08T19:57:35.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:35.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj142 /dev/null 2024-05-08T19:57:35.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:35.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj143 /dev/null 2024-05-08T19:57:35.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:35.397 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj144 /dev/null 2024-05-08T19:57:35.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:35.547 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj145 /dev/null 2024-05-08T19:57:35.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:35.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj146 /dev/null 2024-05-08T19:57:35.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:35.848 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj147 /dev/null 2024-05-08T19:57:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:36.045 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj148 /dev/null 2024-05-08T19:57:36.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:36.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj149 /dev/null 2024-05-08T19:57:36.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:36.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj150 /dev/null 2024-05-08T19:57:36.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:36.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj151 /dev/null 2024-05-08T19:57:36.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:36.651 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj152 /dev/null 2024-05-08T19:57:36.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:36.769 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj153 /dev/null 2024-05-08T19:57:36.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:36.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj154 /dev/null 2024-05-08T19:57:37.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:37.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj155 /dev/null 2024-05-08T19:57:37.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:37.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj156 /dev/null 2024-05-08T19:57:37.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:37.303 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj157 /dev/null 2024-05-08T19:57:37.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:37.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj158 /dev/null 2024-05-08T19:57:37.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:37.579 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj159 /dev/null 2024-05-08T19:57:37.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:37.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj160 /dev/null 2024-05-08T19:57:37.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:37.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj161 /dev/null 2024-05-08T19:57:38.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:38.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj162 /dev/null 2024-05-08T19:57:38.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:38.206 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj163 /dev/null 2024-05-08T19:57:38.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:38.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj164 /dev/null 2024-05-08T19:57:38.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:38.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj165 /dev/null 2024-05-08T19:57:38.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:38.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj166 /dev/null 2024-05-08T19:57:38.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:38.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj167 /dev/null 2024-05-08T19:57:38.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:38.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj168 /dev/null 2024-05-08T19:57:39.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:39.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj169 /dev/null 2024-05-08T19:57:39.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:39.210 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj170 /dev/null 2024-05-08T19:57:39.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:39.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj171 /dev/null 2024-05-08T19:57:39.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:39.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj172 /dev/null 2024-05-08T19:57:39.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:39.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj173 /dev/null 2024-05-08T19:57:39.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:39.821 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj174 /dev/null 2024-05-08T19:57:39.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:39.937 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj175 /dev/null 2024-05-08T19:57:40.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:40.054 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj176 /dev/null 2024-05-08T19:57:40.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:40.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj177 /dev/null 2024-05-08T19:57:40.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:40.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj178 /dev/null 2024-05-08T19:57:40.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:40.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj179 /dev/null 2024-05-08T19:57:40.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:40.640 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj180 /dev/null 2024-05-08T19:57:40.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:40.756 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj181 /dev/null 2024-05-08T19:57:40.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:40.907 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj182 /dev/null 2024-05-08T19:57:41.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:41.024 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj183 /dev/null 2024-05-08T19:57:41.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:41.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj184 /dev/null 2024-05-08T19:57:41.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:41.301 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj185 /dev/null 2024-05-08T19:57:41.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:41.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj186 /dev/null 2024-05-08T19:57:41.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:41.584 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj187 /dev/null 2024-05-08T19:57:41.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:41.768 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj188 /dev/null 2024-05-08T19:57:41.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:41.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj189 /dev/null 2024-05-08T19:57:42.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:42.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj190 /dev/null 2024-05-08T19:57:42.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:42.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj191 /dev/null 2024-05-08T19:57:42.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:42.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj192 /dev/null 2024-05-08T19:57:42.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:42.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj193 /dev/null 2024-05-08T19:57:42.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:42.597 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj194 /dev/null 2024-05-08T19:57:42.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:42.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj195 /dev/null 2024-05-08T19:57:42.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:42.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj196 /dev/null 2024-05-08T19:57:42.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:42.981 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj197 /dev/null 2024-05-08T19:57:43.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:43.131 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj198 /dev/null 2024-05-08T19:57:43.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:43.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj199 /dev/null 2024-05-08T19:57:43.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-05-08T19:57:43.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj200 /dev/null 2024-05-08T19:57:43.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:409: TEST_backfill_sizeup4_allout: get_pg test obj1 2024-05-08T19:57:43.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T19:57:43.525 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T19:57:43.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T19:57:43.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T19:57:44.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:409: TEST_backfill_sizeup4_allout: local PG=1.0 2024-05-08T19:57:44.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:411: TEST_backfill_sizeup4_allout: get_primary test obj1 2024-05-08T19:57:44.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:57:44.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:57:44.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:57:44.007 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:57:44.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:411: TEST_backfill_sizeup4_allout: local primary=1 2024-05-08T19:57:44.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:412: TEST_backfill_sizeup4_allout: get_not_primary test obj1 2024-05-08T19:57:44.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=test 2024-05-08T19:57:44.499 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=obj1 2024-05-08T19:57:44.500 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary test obj1 2024-05-08T19:57:44.500 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:57:44.500 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:57:44.500 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:57:44.500 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:57:44.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2024-05-08T19:57:44.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map test obj1 2024-05-08T19:57:44.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-05-08T19:57:45.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:412: TEST_backfill_sizeup4_allout: local otherosd=0 2024-05-08T19:57:45.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:414: TEST_backfill_sizeup4_allout: ceph osd set nobackfill 2024-05-08T19:57:46.973 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T19:57:46.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:415: TEST_backfill_sizeup4_allout: ceph osd out osd.0 2024-05-08T19:57:47.625 INFO:tasks.workunit.client.0.smithi117.stderr:osd.0 is already out. 2024-05-08T19:57:47.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:416: TEST_backfill_sizeup4_allout: ceph osd out osd.1 2024-05-08T19:57:48.479 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T19:57:48.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:417: TEST_backfill_sizeup4_allout: ceph osd pool set test size 4 2024-05-08T19:57:50.137 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 4 2024-05-08T19:57:50.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:419: TEST_backfill_sizeup4_allout: sleep 2 2024-05-08T19:57:52.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:420: TEST_backfill_sizeup4_allout: get_primary test obj1 2024-05-08T19:57:52.160 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T19:57:52.160 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T19:57:52.160 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T19:57:52.160 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T19:57:52.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:420: TEST_backfill_sizeup4_allout: primary=0 2024-05-08T19:57:52.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:421: TEST_backfill_sizeup4_allout: ceph osd unset nobackfill 2024-05-08T19:57:53.475 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T19:57:53.497 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:422: TEST_backfill_sizeup4_allout: ceph tell osd.0 get_latest_osdmap 2024-05-08T19:57:53.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:423: TEST_backfill_sizeup4_allout: ceph tell osd.0 debug kick_recovery_wq 0 2024-05-08T19:57:54.140 INFO:tasks.workunit.client.0.smithi117.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-05-08T19:57:54.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:424: TEST_backfill_sizeup4_allout: sleep 2 2024-05-08T19:57:56.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:426: TEST_backfill_sizeup4_allout: wait_for_clean 2024-05-08T19:57:56.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T19:57:56.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T19:57:56.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T19:57:56.159 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T19:57:56.160 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T19:57:56.160 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T19:57:56.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T19:57:56.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T19:57:56.161 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T19:57:56.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T19:57:56.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T19:57:56.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T19:57:56.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T19:57:56.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T19:57:56.279 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T19:57:56.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T19:57:56.844 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T19:57:56.844 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T19:57:56.844 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T19:57:56.844 INFO:tasks.workunit.client.0.smithi117.stderr:4' 2024-05-08T19:57:56.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T19:57:56.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:56.845 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T19:57:57.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836542 2024-05-08T19:57:57.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836542 2024-05-08T19:57:57.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542' 2024-05-08T19:57:57.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:57.100 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T19:57:57.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673009 2024-05-08T19:57:57.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673009 2024-05-08T19:57:57.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542 1-42949673009' 2024-05-08T19:57:57.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:57.248 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T19:57:57.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509479 2024-05-08T19:57:57.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509479 2024-05-08T19:57:57.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542 1-42949673009 2-64424509479' 2024-05-08T19:57:57.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:57.501 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T19:57:57.658 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345949 2024-05-08T19:57:57.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345949 2024-05-08T19:57:57.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542 1-42949673009 2-64424509479 3-85899345949' 2024-05-08T19:57:57.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T19:57:57.660 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T19:57:57.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182424 2024-05-08T19:57:57.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182424 2024-05-08T19:57:57.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836542 1-42949673009 2-64424509479 3-85899345949 4-107374182424' 2024-05-08T19:57:57.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:57.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836542 2024-05-08T19:57:57.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:57.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T19:57:57.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836542 2024-05-08T19:57:57.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:57.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836542 2024-05-08T19:57:57.824 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836542' 2024-05-08T19:57:57.824 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836542 2024-05-08T19:57:57.824 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T19:57:58.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836542 -lt 21474836542 2024-05-08T19:57:58.347 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:58.348 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673009 2024-05-08T19:57:58.348 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:58.350 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T19:57:58.351 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673009 2024-05-08T19:57:58.351 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:58.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673009 2024-05-08T19:57:58.354 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673009 2024-05-08T19:57:58.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673009' 2024-05-08T19:57:58.354 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T19:57:58.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673009 -lt 42949673009 2024-05-08T19:57:58.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:58.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509479 2024-05-08T19:57:58.907 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:58.909 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T19:57:58.909 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509479 2024-05-08T19:57:58.910 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:58.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509479 2024-05-08T19:57:58.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509479' 2024-05-08T19:57:58.912 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509479 2024-05-08T19:57:58.912 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T19:57:59.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509479 -lt 64424509479 2024-05-08T19:57:59.479 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:57:59.479 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345949 2024-05-08T19:57:59.480 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:57:59.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T19:57:59.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345949 2024-05-08T19:57:59.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:57:59.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345949 2024-05-08T19:57:59.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345949' 2024-05-08T19:57:59.485 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345949 2024-05-08T19:57:59.485 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:58:00.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345947 -lt 85899345949 2024-05-08T19:58:00.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: sleep 1 2024-05-08T19:58:01.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2216: flush_pg_stats: '[' 300 -eq 0 ']' 2024-05-08T19:58:01.318 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T19:58:01.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345949 -lt 85899345949 2024-05-08T19:58:01.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T19:58:01.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182424 2024-05-08T19:58:01.753 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T19:58:01.754 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T19:58:01.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182424 2024-05-08T19:58:01.756 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T19:58:01.757 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182424 2024-05-08T19:58:01.757 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182424 2024-05-08T19:58:01.758 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182424' 2024-05-08T19:58:01.758 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T19:58:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182425 -lt 107374182424 2024-05-08T19:58:02.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T19:58:02.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:02.319 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:03.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T19:58:03.060 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:03.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:03.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:03.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:03.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:03.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:03.061 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:03.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:03.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:03.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:03.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:04.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:04.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T19:58:04.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T19:58:04.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T19:58:04.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:04.163 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:04.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:04.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:04.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:04.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:04.265 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:04.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:04.266 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:04.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:04.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:04.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:04.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:05.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:05.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:05.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:05.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:05.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:05.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:05.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:05.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:05.217 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:05.971 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:05.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:05.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:05.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:05.972 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:06.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:06.072 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:06.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:06.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:06.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:06.073 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:06.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:06.074 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:06.675 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:06.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:06.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:06.676 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:07.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:07.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:07.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:07.212 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:07.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:07.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:07.213 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:07.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:07.213 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:08.153 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:58:08.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:58:08.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:08.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:08.154 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:08.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:08.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:08.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:08.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:08.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:08.255 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:08.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:08.256 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:08.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:08.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:08.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:08.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:09.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:09.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:09.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:09.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:09.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:09.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:09.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:09.186 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:09.186 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:09.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:58:09.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:58:09.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:09.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:09.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:10.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:10.056 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:10.056 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:10.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:10.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:10.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:10.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:10.057 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:10.477 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:10.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:10.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:10.478 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:11.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:11.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:11.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:11.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:11.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:11.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:11.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:11.138 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:11.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:11.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:11.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:11.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:11.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:11.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:11.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:11.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:11.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:11.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:11.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:11.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:11.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:11.984 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:12.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:12.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:12.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:12.388 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:12.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:12.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:12.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:12.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:12.906 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:12.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:12.906 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:13.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T19:58:13.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T19:58:13.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:13.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:13.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:13.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:13.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:13.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:13.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:13.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:13.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:13.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:13.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:14.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:14.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:14.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:14.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:14.816 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:15.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:15.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:15.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:15.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:15.432 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:15.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:15.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:15.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:15.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:15.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:15.534 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:15.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:15.535 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:15.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:15.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:15.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:15.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:16.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:16.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:16.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:16.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:16.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:16.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:16.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:16.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:16.599 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:17.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:17.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:17.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:17.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:17.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:17.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:17.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:17.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:17.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:17.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:17.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:17.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:17.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:17.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:17.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:17.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:17.665 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:18.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:18.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:18.381 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:18.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:18.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:18.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:18.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:18.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:18.382 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:19.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:58:19.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:58:19.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:19.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:19.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:19.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:19.198 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:19.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:19.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:19.199 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:19.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:19.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:19.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:19.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:19.600 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:19.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:19.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:20.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:20.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:20.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:20.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:20.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:20.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:20.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:20.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:20.232 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:20.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:20.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:20.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:20.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:20.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:20.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:20.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:20.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:20.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:21.592 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:21.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:21.592 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:21.593 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:22.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:22.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:22.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:22.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:22.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:22.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:22.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:22.148 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:22.148 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:22.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:58:22.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:58:22.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:22.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:22.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:23.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:23.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:23.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:23.034 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:23.035 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:23.035 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:23.035 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:23.035 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:23.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:23.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:23.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:23.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:24.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:24.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:24.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:24.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:24.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:24.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:24.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:24.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:24.174 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:25.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:25.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:25.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:25.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:25.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:25.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:25.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:25.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:25.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:25.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:25.135 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:25.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:25.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:25.653 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:25.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:25.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:25.654 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:26.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:26.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:26.200 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:26.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:26.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:26.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:26.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:26.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:26.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:26.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:26.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:26.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:26.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:26.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:26.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:26.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:27.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:27.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:27.576 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:27.577 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:28.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:28.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:28.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:28.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:28.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:28.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:28.147 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:28.148 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:28.148 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:28.917 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:58:28.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:58:28.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:28.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:28.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:29.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:29.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:29.019 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:29.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:29.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:29.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:29.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:29.020 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:29.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:29.464 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:29.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:29.465 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:29.979 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:29.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:29.980 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:30.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:30.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:30.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:30.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:30.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:30.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:30.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:30.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:30.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:30.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:30.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:30.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:30.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:31.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:31.246 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:31.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:31.247 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:31.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:31.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:31.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:31.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:31.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:31.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:31.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:31.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:31.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:32.387 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:58:32.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:58:32.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:32.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:32.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:32.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:32.489 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:32.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:32.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:32.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:32.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:32.490 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:32.491 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:32.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:32.931 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:32.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:32.932 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:33.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:33.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:33.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:33.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:33.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:33.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:33.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:33.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:33.767 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:34.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:34.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:34.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:34.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:34.580 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:34.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:34.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:34.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:34.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:34.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:34.682 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:34.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:34.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:35.211 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:35.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:35.211 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:35.212 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:35.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:35.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:35.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:35.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:35.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:35.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:35.753 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:35.754 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:35.754 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:36.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:36.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:36.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:36.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:36.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:36.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:36.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:36.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:36.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:36.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:36.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:36.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:36.783 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:37.195 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:37.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:37.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:37.196 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:37.774 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:37.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:37.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:37.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:37.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:37.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:37.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:37.775 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:37.776 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:38.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:58:38.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:58:38.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:38.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:38.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:38.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:38.458 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:38.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:38.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:38.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:38.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:38.459 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:38.460 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:38.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:38.868 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:38.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:38.869 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:39.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:39.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:39.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:39.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:39.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:39.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:39.513 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:39.513 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:39.514 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T19:58:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T19:58:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:40.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:40.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:40.304 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:40.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:40.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:40.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:40.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:40.305 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:40.306 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:40.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:40.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:40.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:40.745 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:41.443 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:41.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:41.444 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:42.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:58:42.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:58:42.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:42.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:42.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:42.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:42.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:42.138 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:42.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:42.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:42.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:42.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:42.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:42.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:42.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:42.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:42.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:43.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:43.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:43.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:43.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:43.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:43.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:43.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:43.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:43.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:44.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:58:44.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:58:44.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:44.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:44.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:44.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:44.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:44.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:44.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:44.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:44.251 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:44.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:44.252 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:44.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:44.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:44.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:44.642 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:45.157 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:45.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:45.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:45.158 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:45.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T19:58:45.793 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T19:58:45.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:45.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:45.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:45.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:45.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:45.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:45.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:45.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:45.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:45.896 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:45.897 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:46.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T19:58:46.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:46.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:46.311 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:46.872 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T19:58:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T19:58:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T19:58:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T19:58:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T19:58:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T19:58:46.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T19:58:46.873 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T19:58:46.873 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T19:58:47.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T19:58:47.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T19:58:47.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T19:58:47.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T19:58:47.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T19:58:47.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T19:58:47.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T19:58:47.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T19:58:47.558 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T19:58:47.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T19:58:47.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T19:58:47.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T19:58:47.559 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T19:58:47.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T19:58:47.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T19:58:47.974 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T19:58:47.975 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T19:58:48.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T19:58:48.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T19:58:48.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T19:58:48.523 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:428: TEST_backfill_sizeup4_allout: expr 200 '*' 2 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:428: TEST_backfill_sizeup4_allout: local misdeg=400 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:429: TEST_backfill_sizeup4_allout: check td/osd-backfill-stats 1.0 0 replicated 400 0 400 200 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=0 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=400 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=400 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=200 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T19:58:48.525 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T19:58:48.526 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T19:58:48.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2024-05-08T19:58:48.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T19:58:48.547 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T19:58:48.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T19:58:48.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-05-08T19:58:48.550 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T19:58:48.550 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.550 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T19:58:48.550 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T19:58:48.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[2,4,3]/[0,1]' 2024-05-08T19:58:48.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[2,4,3]/[0,1]' ']' 2024-05-08T19:58:48.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T19:58:48.578 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:58:48.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [2,4,3]/[0,1] ' 2024-05-08T19:58:48.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T19:58:48.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T19:58:48.578 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:58:48.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=400 2024-05-08T19:58:48.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2024-05-08T19:58:48.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 400 400 2024-05-08T19:58:48.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-05-08T19:58:48.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:58:48.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-05-08T19:58:48.583 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:58:48.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:58:48.583 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.583 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T19:58:48.583 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:58:48.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=2 2024-05-08T19:58:48.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2024-05-08T19:58:48.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 2 0 2024-05-08T19:58:48.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-05-08T19:58:48.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:58:48.595 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T19:58:48.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:58:48.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T19:58:48.596 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:58:48.596 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.597 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [2,4,3]/[0,1] ' 2024-05-08T19:58:48.597 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T19:58:48.597 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T19:58:48.597 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:58:48.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=400 2024-05-08T19:58:48.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 400 400 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T19:58:48.602 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T19:58:48.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=201 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 201 ']' 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 201 200 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=201 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=200 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:431: TEST_backfill_sizeup4_allout: delete_pool test 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T19:58:48.615 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T19:58:49.426 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T19:58:49.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:432: TEST_backfill_sizeup4_allout: kill_daemons td/osd-backfill-stats 2024-05-08T19:58:49.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:58:49.446 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:58:49.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:58:49.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:58:49.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:58:54.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:58:54.767 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:58:54.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:58:54.776 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:58:54.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:58:54.777 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:58:54.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:58:54.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:58:54.778 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:58:54.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:58:54.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:58:54.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:58:54.779 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:58:54.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:58:54.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:58:54.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:58:54.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:58:54.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:58:54.823 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:58:54.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:58:54.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:58:54.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:58:54.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-05-08T19:58:54.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-05-08T19:58:54.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-backfill-stats 2024-05-08T19:58:54.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-backfill-stats 2024-05-08T19:58:54.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T19:58:54.825 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T19:58:54.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T19:58:54.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T19:58:54.826 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T19:58:54.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T19:58:54.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T19:58:54.826 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T19:58:54.827 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T19:58:54.827 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T19:58:54.828 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T19:58:54.828 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T19:58:54.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T19:58:54.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T19:58:54.829 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T19:58:54.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:58:54.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T19:58:54.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T19:58:54.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:58:54.831 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T19:58:54.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T19:58:54.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T19:58:54.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T19:58:54.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:58:54.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:58:54.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T19:58:54.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T19:58:54.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T19:58:54.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-backfill-stats 2024-05-08T19:58:54.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2024-05-08T19:58:54.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:58:54.836 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:58:54.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.473885 2024-05-08T19:58:54.838 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2024-05-08T19:58:54.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2024-05-08T19:58:54.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2024-05-08T19:58:54.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-05-08T19:58:54.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup_out td/osd-backfill-stats 2024-05-08T19:58:54.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:182: TEST_backfill_sizeup_out: local dir=td/osd-backfill-stats 2024-05-08T19:58:54.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:184: TEST_backfill_sizeup_out: run_mon td/osd-backfill-stats a 2024-05-08T19:58:54.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-backfill-stats 2024-05-08T19:58:54.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2024-05-08T19:58:54.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2024-05-08T19:58:54.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2024-05-08T19:58:54.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-backfill-stats/a 2024-05-08T19:58:54.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-05-08T19:58:55.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2024-05-08T19:58:55.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:58:55.286 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:58:55.286 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:58:55.286 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:58:55.287 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:58:55.287 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:58:55.287 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-05-08T19:58:55.527 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2024-05-08T19:58:55.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2024-05-08T19:58:55.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:58:55.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:58:55.528 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2024-05-08T19:58:55.529 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2024-05-08T19:58:55.529 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:58:55.529 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:58:55.529 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:58:55.530 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:58:55.530 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:58:55.530 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:58:55.530 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:58:55.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:58:55.530 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get fsid 2024-05-08T19:58:55.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2024-05-08T19:58:55.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2024-05-08T19:58:55.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2024-05-08T19:58:55.644 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2024-05-08T19:58:55.645 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2024-05-08T19:58:55.645 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2024-05-08T19:58:55.645 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2024-05-08T19:58:55.645 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2024-05-08T19:58:55.645 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2024-05-08T19:58:55.645 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:58:55.645 INFO:tasks.workunit.client.0.smithi117.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:58:55.645 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.473885/ceph-mon.a.asok 2024-05-08T19:58:55.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2024-05-08T19:58:55.646 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.473885/ceph-mon.a.asok config get mon_host 2024-05-08T19:58:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:185: TEST_backfill_sizeup_out: run_mgr td/osd-backfill-stats x 2024-05-08T19:58:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-backfill-stats 2024-05-08T19:58:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2024-05-08T19:58:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2024-05-08T19:58:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2024-05-08T19:58:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-backfill-stats/x 2024-05-08T19:58:55.763 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2024-05-08T19:58:56.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2024-05-08T19:58:56.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:58:56.702 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:58:56.703 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:58:56.703 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:58:56.703 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:58:56.703 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:58:56.704 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:58:56.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-05-08T19:58:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:186: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 0 2024-05-08T19:58:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:58:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:58:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2024-05-08T19:58:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:58:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/0 2024-05-08T19:58:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:58:56.789 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:58:56.790 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:58:56.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/0 2024-05-08T19:58:56.792 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:58:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=54613a46-9b13-4dc1-806e-a8448c2be9c7 2024-05-08T19:58:56.792 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 54613a46-9b13-4dc1-806e-a8448c2be9c7' 2024-05-08T19:58:56.793 INFO:tasks.workunit.client.0.smithi117.stdout:add osd0 54613a46-9b13-4dc1-806e-a8448c2be9c7 2024-05-08T19:58:56.793 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:58:56.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCA2TtmT/T2MBAAgD2aIiv/l/EZNRkFeJixBQ== 2024-05-08T19:58:56.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCA2TtmT/T2MBAAgD2aIiv/l/EZNRkFeJixBQ=="}' 2024-05-08T19:58:56.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 54613a46-9b13-4dc1-806e-a8448c2be9c7 -i td/osd-backfill-stats/0/new.json 2024-05-08T19:58:57.159 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:58:57.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/0/new.json 2024-05-08T19:58:57.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCA2TtmT/T2MBAAgD2aIiv/l/EZNRkFeJixBQ== --osd-uuid 54613a46-9b13-4dc1-806e-a8448c2be9c7 2024-05-08T19:58:57.219 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:58:57.228+0000 7f710f0f17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:58:57.235 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:58:57.244+0000 7f710f0f17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:58:57.236 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:58:57.244+0000 7f710f0f17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:58:57.237 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:58:57.244+0000 7f710f0f17c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:58:57.237 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:58:57.244+0000 7f710f0f17c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:58:57.237 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:58:57.244+0000 7f710f0f17c0 -1 bluestore(td/osd-backfill-stats/0/block) _read_bdev_label failed to open td/osd-backfill-stats/0/block: (2) No such file or directory 2024-05-08T19:58:57.275 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:58:57.284+0000 7f710f0f17c0 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-05-08T19:59:05.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-05-08T19:59:05.079 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:59:05.081 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd0 key to auth repository 2024-05-08T19:59:05.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2024-05-08T19:59:05.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:59:05.642 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.0 2024-05-08T19:59:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2024-05-08T19:59:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:59:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:59:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:59:05.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:59:05.676 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:05.684+0000 7f3599c937c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:05.678 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:05.688+0000 7f3599c937c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:05.679 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:05.688+0000 7f3599c937c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:06.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2024-05-08T19:59:06.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:59:06.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2024-05-08T19:59:06.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:59:06.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:59:06.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:06.040 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:59:06.040 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:59:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:06.041 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:06.272 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:06.280+0000 7f3599c937c0 -1 Falling back to public interface 2024-05-08T19:59:06.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:07.501 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:07.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:07.502 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:59:07.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:59:07.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:07.503 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:07.916 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:08.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:08.918 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:08.918 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:59:08.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:59:08.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:08.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:09.092 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:09.100+0000 7f3599c937c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:59:09.356 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:10.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:10.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:10.358 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:59:10.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:59:10.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:10.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:10.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:11.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:11.836 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:59:11.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:11.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:59:11.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:11.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:12.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:13.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:13.372 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:13.373 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T19:59:13.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T19:59:13.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:13.374 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:13.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:14.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:14.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:14.779 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T19:59:14.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T19:59:14.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:14.780 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:15.357 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:16.359 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T19:59:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T19:59:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:16.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:16.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:17.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:17.802 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:17.803 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T19:59:17.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T19:59:17.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:17.803 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:18.329 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:19.330 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:19.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:19.331 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T19:59:19.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T19:59:19.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:19.332 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:19.781 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:20.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:20.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:20.783 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T19:59:20.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T19:59:20.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:20.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:21.305 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:22.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:22.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:22.307 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T19:59:22.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T19:59:22.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:22.308 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:22.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:23.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:23.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:23.905 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T19:59:23.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T19:59:23.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:23.905 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:24.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:25.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:25.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:25.504 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T19:59:25.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T19:59:25.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:25.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:26.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:27.170 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:27.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T19:59:27.171 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T19:59:27.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:27.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:27.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:28.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:28.626 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T19:59:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T19:59:28.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:28.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:29.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:30.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:30.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:30.177 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T19:59:30.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T19:59:30.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:30.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:30.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:31.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:31.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:31.914 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T19:59:31.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T19:59:31.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:31.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:33.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:34.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:34.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:34.327 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T19:59:34.327 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T19:59:34.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:34.328 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:35.591 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:36.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:36.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:36.593 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T19:59:36.593 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T19:59:36.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:36.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:37.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:38.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:38.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:38.366 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T19:59:38.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T19:59:38.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:38.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:39.156 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:40.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:40.158 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:40.158 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T19:59:40.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T19:59:40.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:40.159 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:41.015 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:42.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:42.016 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:42.016 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T19:59:42.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T19:59:42.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:42.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2024-05-08T19:59:42.512 INFO:tasks.workunit.client.0.smithi117.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4025573570,v1:127.0.0.1:6803/4025573570] [v2:127.0.0.1:6804/4025573570,v1:127.0.0.1:6805/4025573570] exists,up 54613a46-9b13-4dc1-806e-a8448c2be9c7 2024-05-08T19:59:42.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T19:59:42.515 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:187: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 1 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/1 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-05-08T19:59:42.516 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T19:59:42.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T19:59:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T19:59:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T19:59:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T19:59:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T19:59:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T19:59:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T19:59:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T19:59:42.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/1 2024-05-08T19:59:42.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T19:59:42.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=389467b7-7ae0-46d9-b1ad-3742cee16489 2024-05-08T19:59:42.519 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 389467b7-7ae0-46d9-b1ad-3742cee16489' 2024-05-08T19:59:42.519 INFO:tasks.workunit.client.0.smithi117.stdout:add osd1 389467b7-7ae0-46d9-b1ad-3742cee16489 2024-05-08T19:59:42.519 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T19:59:42.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCu2TtmQ7+jIBAABmoE1v4GkEd2FLv78VjqOQ== 2024-05-08T19:59:42.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCu2TtmQ7+jIBAABmoE1v4GkEd2FLv78VjqOQ=="}' 2024-05-08T19:59:42.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 389467b7-7ae0-46d9-b1ad-3742cee16489 -i td/osd-backfill-stats/1/new.json 2024-05-08T19:59:43.132 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:59:43.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/1/new.json 2024-05-08T19:59:43.149 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCu2TtmQ7+jIBAABmoE1v4GkEd2FLv78VjqOQ== --osd-uuid 389467b7-7ae0-46d9-b1ad-3742cee16489 2024-05-08T19:59:43.184 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:43.192+0000 7f6d521807c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:43.185 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:43.196+0000 7f6d521807c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:43.187 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:43.196+0000 7f6d521807c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:43.187 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:43.196+0000 7f6d521807c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:59:43.187 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:43.196+0000 7f6d521807c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:59:43.187 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:43.196+0000 7f6d521807c0 -1 bluestore(td/osd-backfill-stats/1/block) _read_bdev_label failed to open td/osd-backfill-stats/1/block: (2) No such file or directory 2024-05-08T19:59:43.249 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:43.256+0000 7f6d521807c0 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-05-08T19:59:51.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-05-08T19:59:51.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T19:59:51.620 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd1 key to auth repository 2024-05-08T19:59:51.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2024-05-08T19:59:51.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T19:59:52.191 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.1 2024-05-08T19:59:52.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2024-05-08T19:59:52.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T19:59:52.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T19:59:52.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T19:59:52.193 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T19:59:52.225 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:52.231+0000 7f484c57e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:52.227 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:52.235+0000 7f484c57e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:52.228 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:52.235+0000 7f484c57e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T19:59:52.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2024-05-08T19:59:52.610 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T19:59:52.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2024-05-08T19:59:52.611 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T19:59:52.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T19:59:52.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T19:59:52.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:52.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T19:59:52.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:52.612 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:59:52.771 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:52.779+0000 7f484c57e7c0 -1 Falling back to public interface 2024-05-08T19:59:53.007 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:54.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:54.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:54.009 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T19:59:54.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T19:59:54.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:54.009 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:59:54.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:55.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:55.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:55.430 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T19:59:55.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T19:59:55.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:55.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:59:55.492 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T19:59:55.499+0000 7f484c57e7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:59:55.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:56.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:56.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:56.951 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T19:59:56.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T19:59:56.951 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:56.952 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:59:57.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T19:59:58.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T19:59:58.504 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T19:59:58.505 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T19:59:58.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T19:59:58.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T19:59:58.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T19:59:59.017 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:00.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:00.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:00.019 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T20:00:00.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T20:00:00.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:00.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:00.698 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:01.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:01.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:01.701 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T20:00:01.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T20:00:01.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:01.702 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:02.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:03.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:03.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:03.377 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T20:00:03.377 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T20:00:03.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:03.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:03.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:04.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:04.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:04.995 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T20:00:04.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T20:00:04.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:04.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:05.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:06.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:06.426 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:06.426 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T20:00:06.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T20:00:06.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:06.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:07.141 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:08.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:08.143 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:08.143 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T20:00:08.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T20:00:08.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:08.144 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:08.747 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:09.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:09.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:09.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T20:00:09.750 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T20:00:09.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:09.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:10.405 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:11.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:11.407 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:11.407 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T20:00:11.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T20:00:11.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:11.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:12.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:13.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:13.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:13.207 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T20:00:13.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T20:00:13.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:13.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:13.717 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:14.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:14.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:14.719 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T20:00:14.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T20:00:14.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:14.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:15.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:16.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:16.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:16.265 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T20:00:16.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T20:00:16.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:16.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:17.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:18.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:18.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:18.029 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T20:00:18.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T20:00:18.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:18.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:19.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:20.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:20.408 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:20.409 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T20:00:20.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T20:00:20.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:20.409 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:21.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:22.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:22.255 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:22.255 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T20:00:22.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T20:00:22.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:22.256 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:23.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:24.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:24.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:24.167 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T20:00:24.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T20:00:24.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:24.168 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:25.148 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:26.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:26.150 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:26.150 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T20:00:26.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T20:00:26.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:26.151 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:27.101 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:28.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:28.103 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:28.103 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T20:00:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T20:00:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:28.104 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2024-05-08T20:00:28.619 INFO:tasks.workunit.client.0.smithi117.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3614336431,v1:127.0.0.1:6811/3614336431] [v2:127.0.0.1:6812/3614336431,v1:127.0.0.1:6813/3614336431] exists,up 389467b7-7ae0-46d9-b1ad-3742cee16489 2024-05-08T20:00:28.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T20:00:28.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T20:00:28.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T20:00:28.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:188: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 2 2024-05-08T20:00:28.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T20:00:28.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/2 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T20:00:28.624 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T20:00:28.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T20:00:28.625 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T20:00:28.625 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T20:00:28.625 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T20:00:28.625 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T20:00:28.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/2 2024-05-08T20:00:28.627 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T20:00:28.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8ed14e13-f477-43ad-850c-7f655fd97e75 2024-05-08T20:00:28.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 8ed14e13-f477-43ad-850c-7f655fd97e75' 2024-05-08T20:00:28.628 INFO:tasks.workunit.client.0.smithi117.stdout:add osd2 8ed14e13-f477-43ad-850c-7f655fd97e75 2024-05-08T20:00:28.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T20:00:28.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDc2TtmaYVxJxAAm66B+/J/h6AdQghHH+FYnQ== 2024-05-08T20:00:28.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDc2TtmaYVxJxAAm66B+/J/h6AdQghHH+FYnQ=="}' 2024-05-08T20:00:28.650 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8ed14e13-f477-43ad-850c-7f655fd97e75 -i td/osd-backfill-stats/2/new.json 2024-05-08T20:00:29.371 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T20:00:29.388 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/2/new.json 2024-05-08T20:00:29.389 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDc2TtmaYVxJxAAm66B+/J/h6AdQghHH+FYnQ== --osd-uuid 8ed14e13-f477-43ad-850c-7f655fd97e75 2024-05-08T20:00:29.424 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:29.431+0000 7efc534487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:00:29.426 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:29.435+0000 7efc534487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:00:29.427 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:29.435+0000 7efc534487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:00:29.428 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:29.435+0000 7efc534487c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T20:00:29.428 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:29.435+0000 7efc534487c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T20:00:29.428 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:29.435+0000 7efc534487c0 -1 bluestore(td/osd-backfill-stats/2/block) _read_bdev_label failed to open td/osd-backfill-stats/2/block: (2) No such file or directory 2024-05-08T20:00:29.518 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:29.527+0000 7efc534487c0 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-05-08T20:00:37.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-05-08T20:00:37.691 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T20:00:37.692 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd2 key to auth repository 2024-05-08T20:00:37.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2024-05-08T20:00:37.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T20:00:38.281 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.2 2024-05-08T20:00:38.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2024-05-08T20:00:38.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T20:00:38.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T20:00:38.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T20:00:38.283 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T20:00:38.314 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:38.322+0000 7f684d30c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:00:38.353 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:38.358+0000 7f684d30c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:00:38.354 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:38.362+0000 7f684d30c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:00:38.719 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2024-05-08T20:00:38.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T20:00:38.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2024-05-08T20:00:38.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T20:00:38.720 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T20:00:38.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T20:00:38.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:38.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T20:00:38.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:38.722 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:38.912 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:38.918+0000 7f684d30c7c0 -1 Falling back to public interface 2024-05-08T20:00:39.132 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:40.133 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:40.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:40.134 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T20:00:40.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T20:00:40.134 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:40.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:40.539 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:41.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:41.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:41.541 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T20:00:41.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T20:00:41.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:41.542 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:41.839 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:00:41.846+0000 7f684d30c7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T20:00:41.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:42.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:42.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:42.956 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T20:00:42.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T20:00:42.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:42.957 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:43.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:44.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:44.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:44.786 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T20:00:44.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T20:00:44.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:44.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:45.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:46.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:46.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:46.415 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T20:00:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T20:00:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:46.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:46.912 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:47.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:47.914 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:47.915 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T20:00:47.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T20:00:47.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:47.915 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:48.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:49.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:49.463 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:49.464 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T20:00:49.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T20:00:49.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:49.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:49.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:50.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:50.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:50.932 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T20:00:50.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T20:00:50.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:50.932 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:51.473 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:52.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:52.475 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:52.476 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T20:00:52.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T20:00:52.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:52.476 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:52.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:53.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:53.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:53.998 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T20:00:53.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T20:00:53.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:53.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:54.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:55.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:55.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:55.695 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T20:00:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T20:00:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:55.696 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:56.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:57.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:57.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:57.244 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T20:00:57.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T20:00:57.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:57.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:57.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:00:58.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:00:58.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:00:58.690 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T20:00:58.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T20:00:58.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:00:58.690 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:00:59.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:00.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:00.325 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:00.326 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T20:01:00.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T20:01:00.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:00.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:00.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:01.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:01.876 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:01.876 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T20:01:01.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T20:01:01.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:01.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:02.995 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:03.996 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:03.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:03.997 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T20:01:03.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T20:01:03.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:03.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:05.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:06.173 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:06.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:06.174 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T20:01:06.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T20:01:06.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:06.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:07.187 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:08.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:08.189 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:08.189 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T20:01:08.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T20:01:08.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:08.190 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:09.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:10.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:10.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:10.428 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T20:01:10.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T20:01:10.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:10.428 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:11.427 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:12.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:12.429 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:12.429 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T20:01:12.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T20:01:12.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:12.430 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:13.314 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:14.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:14.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:14.316 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T20:01:14.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T20:01:14.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:14.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:14.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:15.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:15.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:15.833 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T20:01:15.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T20:01:15.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:15.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2024-05-08T20:01:16.288 INFO:tasks.workunit.client.0.smithi117.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3307116645,v1:127.0.0.1:6819/3307116645] [v2:127.0.0.1:6820/3307116645,v1:127.0.0.1:6821/3307116645] exists,up 8ed14e13-f477-43ad-850c-7f655fd97e75 2024-05-08T20:01:16.293 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:189: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 3 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/3 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T20:01:16.294 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T20:01:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T20:01:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T20:01:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-05-08T20:01:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-05-08T20:01:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T20:01:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T20:01:16.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T20:01:16.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T20:01:16.296 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T20:01:16.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T20:01:16.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T20:01:16.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T20:01:16.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T20:01:16.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T20:01:16.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T20:01:16.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T20:01:16.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/3 2024-05-08T20:01:16.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T20:01:16.298 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ce68979d-e072-4769-b595-a02e391a7891 2024-05-08T20:01:16.299 INFO:tasks.workunit.client.0.smithi117.stdout:add osd3 ce68979d-e072-4769-b595-a02e391a7891 2024-05-08T20:01:16.299 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 ce68979d-e072-4769-b595-a02e391a7891' 2024-05-08T20:01:16.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T20:01:16.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAM2jtmOZagExAAVCSgBiPn7KfipDF3ghcblA== 2024-05-08T20:01:16.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAM2jtmOZagExAAVCSgBiPn7KfipDF3ghcblA=="}' 2024-05-08T20:01:16.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ce68979d-e072-4769-b595-a02e391a7891 -i td/osd-backfill-stats/3/new.json 2024-05-08T20:01:16.866 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T20:01:16.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/3/new.json 2024-05-08T20:01:16.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAM2jtmOZagExAAVCSgBiPn7KfipDF3ghcblA== --osd-uuid ce68979d-e072-4769-b595-a02e391a7891 2024-05-08T20:01:16.919 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:16.930+0000 7f35d81e67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:01:16.962 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:16.974+0000 7f35d81e67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:01:16.963 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:16.974+0000 7f35d81e67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:01:16.964 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:16.974+0000 7f35d81e67c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T20:01:16.964 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:16.974+0000 7f35d81e67c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T20:01:16.964 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:16.974+0000 7f35d81e67c0 -1 bluestore(td/osd-backfill-stats/3/block) _read_bdev_label failed to open td/osd-backfill-stats/3/block: (2) No such file or directory 2024-05-08T20:01:17.009 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:17.018+0000 7f35d81e67c0 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-05-08T20:01:25.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-05-08T20:01:25.064 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T20:01:25.066 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd3 key to auth repository 2024-05-08T20:01:25.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2024-05-08T20:01:25.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T20:01:25.627 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.3 2024-05-08T20:01:25.627 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2024-05-08T20:01:25.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T20:01:25.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T20:01:25.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T20:01:25.628 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T20:01:25.660 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:25.670+0000 7f258aeee7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:01:25.662 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:25.674+0000 7f258aeee7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:01:25.663 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:25.674+0000 7f258aeee7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:01:26.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2024-05-08T20:01:26.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T20:01:26.029 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2024-05-08T20:01:26.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T20:01:26.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T20:01:26.030 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T20:01:26.030 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:26.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T20:01:26.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:26.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:26.207 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:26.218+0000 7f258aeee7c0 -1 Falling back to public interface 2024-05-08T20:01:26.459 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:27.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:27.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:27.461 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T20:01:27.461 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T20:01:27.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:27.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:27.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:28.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:28.881 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:28.881 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T20:01:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T20:01:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:28.882 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:29.036 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:01:29.045+0000 7f258aeee7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T20:01:29.351 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:30.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:30.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:30.353 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T20:01:30.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T20:01:30.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:30.354 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:30.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:31.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:31.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:31.863 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T20:01:31.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T20:01:31.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:31.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:32.419 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:33.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:33.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:33.421 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T20:01:33.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T20:01:33.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:33.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:33.931 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:34.933 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:34.934 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:34.934 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T20:01:34.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T20:01:34.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:34.935 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:35.680 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:36.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:36.681 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:36.682 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T20:01:36.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T20:01:36.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:36.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:37.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:38.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:38.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:38.243 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T20:01:38.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T20:01:38.243 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:38.244 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:38.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:39.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:39.895 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T20:01:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T20:01:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:39.895 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:40.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:41.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:41.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:41.643 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T20:01:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T20:01:41.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:41.644 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:42.245 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:43.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:43.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:43.247 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T20:01:43.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T20:01:43.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:43.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:43.730 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:44.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:44.731 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:44.732 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T20:01:44.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T20:01:44.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:44.732 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:45.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:46.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:46.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:46.451 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T20:01:46.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T20:01:46.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:46.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:47.063 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:48.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:48.065 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:48.066 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T20:01:48.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T20:01:48.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:48.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:48.623 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:49.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:49.625 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:49.625 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T20:01:49.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T20:01:49.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:49.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:50.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:51.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:51.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:51.694 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T20:01:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T20:01:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:51.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:52.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:53.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:53.555 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:53.556 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T20:01:53.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T20:01:53.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:53.556 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:54.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:55.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:55.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:55.671 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T20:01:55.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T20:01:55.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:55.672 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:56.413 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:57.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:57.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:57.415 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T20:01:57.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T20:01:57.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:57.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:01:58.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:01:59.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:01:59.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:01:59.891 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T20:01:59.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T20:01:59.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:01:59.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:02:00.505 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:01.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:01.507 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:01.507 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T20:02:01.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T20:02:01.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:01.508 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:02:02.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:03.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:03.540 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:03.540 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T20:02:03.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T20:02:03.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:03.541 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2024-05-08T20:02:03.954 INFO:tasks.workunit.client.0.smithi117.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2895651217,v1:127.0.0.1:6827/2895651217] [v2:127.0.0.1:6828/2895651217,v1:127.0.0.1:6829/2895651217] exists,up ce68979d-e072-4769-b595-a02e391a7891 2024-05-08T20:02:03.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T20:02:03.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T20:02:03.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T20:02:03.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:190: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 4 2024-05-08T20:02:03.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T20:02:03.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T20:02:03.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2024-05-08T20:02:03.958 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/4 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T20:02:03.959 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T20:02:03.960 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T20:02:03.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T20:02:03.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T20:02:03.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/4 2024-05-08T20:02:03.961 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T20:02:03.961 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7272cca1-79fe-4425-935a-ed2c66812366 2024-05-08T20:02:03.962 INFO:tasks.workunit.client.0.smithi117.stdout:add osd4 7272cca1-79fe-4425-935a-ed2c66812366 2024-05-08T20:02:03.962 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 7272cca1-79fe-4425-935a-ed2c66812366' 2024-05-08T20:02:03.962 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T20:02:03.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA72jtm2i7/OhAAJEjiVwReC2ND6fUtF5yEzA== 2024-05-08T20:02:03.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA72jtm2i7/OhAAJEjiVwReC2ND6fUtF5yEzA=="}' 2024-05-08T20:02:03.978 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7272cca1-79fe-4425-935a-ed2c66812366 -i td/osd-backfill-stats/4/new.json 2024-05-08T20:02:04.733 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T20:02:04.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/4/new.json 2024-05-08T20:02:04.751 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA72jtm2i7/OhAAJEjiVwReC2ND6fUtF5yEzA== --osd-uuid 7272cca1-79fe-4425-935a-ed2c66812366 2024-05-08T20:02:04.787 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:04.797+0000 7f49643767c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:04.790 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:04.801+0000 7f49643767c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:04.791 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:04.801+0000 7f49643767c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:04.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:04.801+0000 7f49643767c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T20:02:04.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:04.801+0000 7f49643767c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T20:02:04.792 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:04.801+0000 7f49643767c0 -1 bluestore(td/osd-backfill-stats/4/block) _read_bdev_label failed to open td/osd-backfill-stats/4/block: (2) No such file or directory 2024-05-08T20:02:04.925 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:04.937+0000 7f49643767c0 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-05-08T20:02:13.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-05-08T20:02:13.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T20:02:13.340 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd4 key to auth repository 2024-05-08T20:02:13.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2024-05-08T20:02:13.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T20:02:13.902 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.4 2024-05-08T20:02:13.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2024-05-08T20:02:13.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T20:02:13.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T20:02:13.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T20:02:13.904 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T20:02:13.936 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:13.945+0000 7f7e246dc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:13.938 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:13.949+0000 7f7e246dc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:13.939 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:13.949+0000 7f7e246dc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2024-05-08T20:02:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T20:02:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2024-05-08T20:02:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T20:02:14.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T20:02:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:14.323 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T20:02:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T20:02:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:14.323 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:14.480 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:14.489+0000 7f7e246dc7c0 -1 Falling back to public interface 2024-05-08T20:02:14.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:15.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:15.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:15.813 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T20:02:15.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T20:02:15.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:15.813 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:16.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:17.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:17.240 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:17.240 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T20:02:17.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T20:02:17.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:17.241 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:17.347 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:17.356+0000 7f7e246dc7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T20:02:17.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:18.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:18.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:18.786 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T20:02:18.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T20:02:18.786 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:18.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:19.367 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:20.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:20.369 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:20.369 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T20:02:20.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T20:02:20.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:20.370 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:20.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:21.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:21.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:21.950 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T20:02:21.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T20:02:21.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:21.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:22.422 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:23.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:23.424 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:23.424 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T20:02:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T20:02:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:23.425 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:24.306 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:25.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:25.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:25.309 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T20:02:25.309 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T20:02:25.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:25.310 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:26.119 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:27.121 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:27.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:27.122 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T20:02:27.122 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T20:02:27.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:27.123 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:27.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:28.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:28.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:28.788 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T20:02:28.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T20:02:28.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:28.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:29.398 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:30.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:30.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:30.400 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T20:02:30.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T20:02:30.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:30.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:30.864 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:31.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:31.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:31.867 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T20:02:31.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T20:02:31.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:31.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:32.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:33.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:33.484 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:33.484 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T20:02:33.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T20:02:33.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:33.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:34.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:35.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:35.361 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:35.362 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T20:02:35.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T20:02:35.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:35.362 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:36.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:37.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:37.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:37.034 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T20:02:37.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T20:02:37.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:37.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:37.633 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:38.634 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:38.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:38.635 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T20:02:38.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T20:02:38.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:38.635 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:39.445 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:40.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:40.446 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:40.447 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T20:02:40.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T20:02:40.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:40.447 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:41.183 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:42.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:42.185 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:42.185 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T20:02:42.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T20:02:42.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:42.186 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:42.741 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:43.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:43.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:43.743 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T20:02:43.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T20:02:43.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:43.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:44.863 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:45.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:45.865 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:45.865 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T20:02:45.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T20:02:45.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:45.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:47.246 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:48.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:48.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:48.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T20:02:48.249 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T20:02:48.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:48.249 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:49.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:50.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:50.262 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:50.263 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T20:02:50.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T20:02:50.263 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:50.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:50.710 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:02:51.711 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:02:51.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:02:51.712 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 22 2024-05-08T20:02:51.712 INFO:tasks.workunit.client.0.smithi117.stdout:22 2024-05-08T20:02:51.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:02:51.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2024-05-08T20:02:52.312 INFO:tasks.workunit.client.0.smithi117.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/376488914,v1:127.0.0.1:6835/376488914] [v2:127.0.0.1:6836/376488914,v1:127.0.0.1:6837/376488914] exists,up 7272cca1-79fe-4425-935a-ed2c66812366 2024-05-08T20:02:52.315 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:191: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 5 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-backfill-stats 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-backfill-stats/5 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2024-05-08T20:02:52.316 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T20:02:52.317 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T20:02:52.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' 2024-05-08T20:02:52.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2024-05-08T20:02:52.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2024-05-08T20:02:52.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2024-05-08T20:02:52.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-05-08T20:02:52.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-05-08T20:02:52.319 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-backfill-stats/5 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=39acfa42-b44d-4a05-89d9-89fd2d1ac9f5 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 39acfa42-b44d-4a05-89d9-89fd2d1ac9f5' 2024-05-08T20:02:52.320 INFO:tasks.workunit.client.0.smithi117.stdout:add osd5 39acfa42-b44d-4a05-89d9-89fd2d1ac9f5 2024-05-08T20:02:52.321 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2024-05-08T20:02:52.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBs2jtmYBsTFRAA0ozOAvbtsT4RG0wIhHqFgg== 2024-05-08T20:02:52.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBs2jtmYBsTFRAA0ozOAvbtsT4RG0wIhHqFgg=="}' 2024-05-08T20:02:52.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 39acfa42-b44d-4a05-89d9-89fd2d1ac9f5 -i td/osd-backfill-stats/5/new.json 2024-05-08T20:02:52.957 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T20:02:52.974 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-backfill-stats/5/new.json 2024-05-08T20:02:52.975 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBs2jtmYBsTFRAA0ozOAvbtsT4RG0wIhHqFgg== --osd-uuid 39acfa42-b44d-4a05-89d9-89fd2d1ac9f5 2024-05-08T20:02:53.010 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:53.020+0000 7fb6e41fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:53.012 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:53.020+0000 7fb6e41fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:53.013 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:53.024+0000 7fb6e41fb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:02:53.014 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:53.024+0000 7fb6e41fb7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T20:02:53.014 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:53.024+0000 7fb6e41fb7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T20:02:53.014 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:53.024+0000 7fb6e41fb7c0 -1 bluestore(td/osd-backfill-stats/5/block) _read_bdev_label failed to open td/osd-backfill-stats/5/block: (2) No such file or directory 2024-05-08T20:02:53.132 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:02:53.140+0000 7fb6e41fb7c0 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-05-08T20:03:01.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-05-08T20:03:01.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2024-05-08T20:03:01.340 INFO:tasks.workunit.client.0.smithi117.stdout:adding osd5 key to auth repository 2024-05-08T20:03:01.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2024-05-08T20:03:01.341 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-05-08T20:03:01.919 INFO:tasks.workunit.client.0.smithi117.stdout:start osd.5 2024-05-08T20:03:01.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2024-05-08T20:03:01.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2024-05-08T20:03:01.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2024-05-08T20:03:01.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=cb2fa78a-91db-46d6-a7ca-6da55a69fb53 --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.473885/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-05-08T20:03:01.920 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2024-05-08T20:03:01.953 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:03:01.960+0000 7fb1ba6b97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:03:01.955 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:03:01.964+0000 7fb1ba6b97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:03:01.956 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:03:01.964+0000 7fb1ba6b97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-05-08T20:03:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2024-05-08T20:03:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2024-05-08T20:03:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2024-05-08T20:03:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2024-05-08T20:03:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2024-05-08T20:03:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:02.317 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2024-05-08T20:03:02.318 INFO:tasks.workunit.client.0.smithi117.stdout:0 2024-05-08T20:03:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:02.318 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:02.520 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:03:02.528+0000 7fb1ba6b97c0 -1 Falling back to public interface 2024-05-08T20:03:02.725 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:03.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:03.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:03.727 INFO:tasks.workunit.client.0.smithi117.stdout:1 2024-05-08T20:03:03.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2024-05-08T20:03:03.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:03.728 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:04.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:05.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:05.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:05.137 INFO:tasks.workunit.client.0.smithi117.stdout:2 2024-05-08T20:03:05.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2024-05-08T20:03:05.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:05.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:05.320 INFO:tasks.workunit.client.0.smithi117.stderr:2024-05-08T20:03:05.328+0000 7fb1ba6b97c0 -1 osd.5 0 log_to_monitors true 2024-05-08T20:03:05.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:06.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:06.662 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:06.663 INFO:tasks.workunit.client.0.smithi117.stdout:3 2024-05-08T20:03:06.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2024-05-08T20:03:06.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:06.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:07.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:08.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:08.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:08.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2024-05-08T20:03:08.535 INFO:tasks.workunit.client.0.smithi117.stdout:4 2024-05-08T20:03:08.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:08.535 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:08.954 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:09.955 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:09.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:09.956 INFO:tasks.workunit.client.0.smithi117.stdout:5 2024-05-08T20:03:09.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2024-05-08T20:03:09.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:09.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:10.462 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:11.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:11.464 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:11.464 INFO:tasks.workunit.client.0.smithi117.stdout:6 2024-05-08T20:03:11.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2024-05-08T20:03:11.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:11.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:12.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:13.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:13.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:13.279 INFO:tasks.workunit.client.0.smithi117.stdout:7 2024-05-08T20:03:13.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2024-05-08T20:03:13.279 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:13.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:13.866 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:14.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:14.868 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:14.869 INFO:tasks.workunit.client.0.smithi117.stdout:8 2024-05-08T20:03:14.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 8 2024-05-08T20:03:14.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:14.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:15.491 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:16.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:16.493 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:16.493 INFO:tasks.workunit.client.0.smithi117.stdout:9 2024-05-08T20:03:16.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 9 2024-05-08T20:03:16.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:16.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:17.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:18.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:18.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:18.178 INFO:tasks.workunit.client.0.smithi117.stdout:10 2024-05-08T20:03:18.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 10 2024-05-08T20:03:18.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:18.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:18.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:19.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:19.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:19.778 INFO:tasks.workunit.client.0.smithi117.stdout:11 2024-05-08T20:03:19.778 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 11 2024-05-08T20:03:19.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:19.779 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:20.373 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:21.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:21.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:21.375 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 12 2024-05-08T20:03:21.376 INFO:tasks.workunit.client.0.smithi117.stdout:12 2024-05-08T20:03:21.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:21.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:21.877 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:22.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:22.878 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:22.879 INFO:tasks.workunit.client.0.smithi117.stdout:13 2024-05-08T20:03:22.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 13 2024-05-08T20:03:22.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:22.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:23.567 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:24.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:24.569 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:24.569 INFO:tasks.workunit.client.0.smithi117.stdout:14 2024-05-08T20:03:24.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 14 2024-05-08T20:03:24.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:24.570 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:25.235 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:26.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:26.237 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:26.238 INFO:tasks.workunit.client.0.smithi117.stdout:15 2024-05-08T20:03:26.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 15 2024-05-08T20:03:26.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:26.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:27.031 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:28.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:28.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:28.034 INFO:tasks.workunit.client.0.smithi117.stdout:16 2024-05-08T20:03:28.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 16 2024-05-08T20:03:28.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:28.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:28.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:29.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:29.790 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:29.791 INFO:tasks.workunit.client.0.smithi117.stdout:17 2024-05-08T20:03:29.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 17 2024-05-08T20:03:29.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:29.791 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:31.174 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:32.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:32.175 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:32.176 INFO:tasks.workunit.client.0.smithi117.stdout:18 2024-05-08T20:03:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 18 2024-05-08T20:03:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:32.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:33.364 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:34.365 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:34.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:34.366 INFO:tasks.workunit.client.0.smithi117.stdout:19 2024-05-08T20:03:34.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 19 2024-05-08T20:03:34.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:34.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:35.205 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:36.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:36.207 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:36.208 INFO:tasks.workunit.client.0.smithi117.stdout:20 2024-05-08T20:03:36.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 20 2024-05-08T20:03:36.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:36.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:37.197 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2024-05-08T20:03:38.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2024-05-08T20:03:38.199 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2024-05-08T20:03:38.199 INFO:tasks.workunit.client.0.smithi117.stdout:21 2024-05-08T20:03:38.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 21 2024-05-08T20:03:38.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2024-05-08T20:03:38.200 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2024-05-08T20:03:38.630 INFO:tasks.workunit.client.0.smithi117.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3351903155,v1:127.0.0.1:6843/3351903155] [v2:127.0.0.1:6844/3351903155,v1:127.0.0.1:6845/3351903155] exists,up 39acfa42-b44d-4a05-89d9-89fd2d1ac9f5 2024-05-08T20:03:38.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2024-05-08T20:03:38.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2024-05-08T20:03:38.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2024-05-08T20:03:38.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:193: TEST_backfill_sizeup_out: create_pool test 1 1 2024-05-08T20:03:38.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2024-05-08T20:03:39.265 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' already exists 2024-05-08T20:03:39.282 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2024-05-08T20:03:40.285 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:194: TEST_backfill_sizeup_out: ceph osd pool set test size 1 --yes-i-really-mean-it 2024-05-08T20:03:41.376 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 1 2024-05-08T20:03:41.399 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:196: TEST_backfill_sizeup_out: wait_for_clean 2024-05-08T20:03:41.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T20:03:41.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T20:03:41.400 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T20:03:41.400 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T20:03:41.401 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T20:03:41.401 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T20:03:41.402 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T20:03:41.402 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T20:03:41.402 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T20:03:41.523 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T20:03:41.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T20:03:41.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T20:03:41.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T20:03:41.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T20:03:41.524 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T20:03:42.066 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T20:03:42.066 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T20:03:42.066 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T20:03:42.066 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T20:03:42.066 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T20:03:42.067 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T20:03:42.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T20:03:42.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:03:42.067 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T20:03:42.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836537 2024-05-08T20:03:42.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836537 2024-05-08T20:03:42.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537' 2024-05-08T20:03:42.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:03:42.295 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T20:03:42.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673009 2024-05-08T20:03:42.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673009 2024-05-08T20:03:42.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673009' 2024-05-08T20:03:42.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:03:42.450 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T20:03:42.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509480 2024-05-08T20:03:42.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509480 2024-05-08T20:03:42.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673009 2-64424509480' 2024-05-08T20:03:42.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:03:42.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T20:03:42.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345945 2024-05-08T20:03:42.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345945 2024-05-08T20:03:42.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673009 2-64424509480 3-85899345945' 2024-05-08T20:03:42.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:03:42.855 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T20:03:43.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182416 2024-05-08T20:03:43.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182416 2024-05-08T20:03:43.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673009 2-64424509480 3-85899345945 4-107374182416' 2024-05-08T20:03:43.006 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:03:43.006 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T20:03:43.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018889 2024-05-08T20:03:43.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018889 2024-05-08T20:03:43.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836537 1-42949673009 2-64424509480 3-85899345945 4-107374182416 5-128849018889' 2024-05-08T20:03:43.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:03:43.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836537 2024-05-08T20:03:43.162 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:03:43.162 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T20:03:43.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836537 2024-05-08T20:03:43.163 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:03:43.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836537 2024-05-08T20:03:43.164 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836537 2024-05-08T20:03:43.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2024-05-08T20:03:43.165 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T20:03:43.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836537 -lt 21474836537 2024-05-08T20:03:43.671 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:03:43.672 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673009 2024-05-08T20:03:43.672 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:03:43.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T20:03:43.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673009 2024-05-08T20:03:43.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:03:43.676 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673009 2024-05-08T20:03:43.676 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673009 2024-05-08T20:03:43.677 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673009' 2024-05-08T20:03:43.677 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T20:03:44.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673009 -lt 42949673009 2024-05-08T20:03:44.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:03:44.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509480 2024-05-08T20:03:44.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:03:44.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T20:03:44.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509480 2024-05-08T20:03:44.170 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:03:44.171 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509480 2024-05-08T20:03:44.171 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509480 2024-05-08T20:03:44.172 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509480' 2024-05-08T20:03:44.172 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T20:03:44.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509480 -lt 64424509480 2024-05-08T20:03:44.611 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:03:44.611 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345945 2024-05-08T20:03:44.612 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:03:44.614 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T20:03:44.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345945 2024-05-08T20:03:44.615 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:03:44.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345945 2024-05-08T20:03:44.616 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345945 2024-05-08T20:03:44.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345945' 2024-05-08T20:03:44.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T20:03:45.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345945 -lt 85899345945 2024-05-08T20:03:45.046 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:03:45.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182416 2024-05-08T20:03:45.047 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:03:45.048 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T20:03:45.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182416 2024-05-08T20:03:45.049 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:03:45.050 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182416 2024-05-08T20:03:45.050 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182416 2024-05-08T20:03:45.051 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182416' 2024-05-08T20:03:45.051 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T20:03:45.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182416 -lt 107374182416 2024-05-08T20:03:45.594 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:03:45.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018889 2024-05-08T20:03:45.595 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:03:45.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T20:03:45.597 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018889 2024-05-08T20:03:45.597 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:03:45.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018889 2024-05-08T20:03:45.598 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018889' 2024-05-08T20:03:45.598 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018889 2024-05-08T20:03:45.598 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T20:03:46.053 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018890 -lt 128849018889 2024-05-08T20:03:46.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T20:03:46.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:03:46.054 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:03:46.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T20:03:46.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:03:46.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:03:46.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:03:46.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:03:46.589 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:03:46.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:03:46.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:03:46.989 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T20:03:46.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:03:46.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:03:46.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:03:47.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T20:03:47.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T20:03:47.606 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T20:03:47.607 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: seq 1 200 2024-05-08T20:03:47.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:47.607 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj1 /dev/null 2024-05-08T20:03:47.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:47.808 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj2 /dev/null 2024-05-08T20:03:48.018 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj3 /dev/null 2024-05-08T20:03:48.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.110 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj4 /dev/null 2024-05-08T20:03:48.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.242 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj5 /dev/null 2024-05-08T20:03:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj6 /dev/null 2024-05-08T20:03:48.416 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.417 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj7 /dev/null 2024-05-08T20:03:48.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj8 /dev/null 2024-05-08T20:03:48.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj9 /dev/null 2024-05-08T20:03:48.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.718 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj10 /dev/null 2024-05-08T20:03:48.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.810 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj11 /dev/null 2024-05-08T20:03:48.902 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.903 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj12 /dev/null 2024-05-08T20:03:48.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:48.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj13 /dev/null 2024-05-08T20:03:49.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.111 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj14 /dev/null 2024-05-08T20:03:49.203 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.204 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj15 /dev/null 2024-05-08T20:03:49.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.295 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj16 /dev/null 2024-05-08T20:03:49.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.378 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj17 /dev/null 2024-05-08T20:03:49.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.512 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj18 /dev/null 2024-05-08T20:03:49.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj19 /dev/null 2024-05-08T20:03:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.750 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj20 /dev/null 2024-05-08T20:03:49.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj21 /dev/null 2024-05-08T20:03:49.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:49.926 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj22 /dev/null 2024-05-08T20:03:50.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.039 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj23 /dev/null 2024-05-08T20:03:50.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj24 /dev/null 2024-05-08T20:03:50.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj25 /dev/null 2024-05-08T20:03:50.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj26 /dev/null 2024-05-08T20:03:50.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.414 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj27 /dev/null 2024-05-08T20:03:50.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.534 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj28 /dev/null 2024-05-08T20:03:50.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj29 /dev/null 2024-05-08T20:03:50.699 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.700 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj30 /dev/null 2024-05-08T20:03:50.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj31 /dev/null 2024-05-08T20:03:50.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:50.875 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj32 /dev/null 2024-05-08T20:03:51.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.008 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj33 /dev/null 2024-05-08T20:03:51.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.100 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj34 /dev/null 2024-05-08T20:03:51.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.191 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj35 /dev/null 2024-05-08T20:03:51.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.284 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj36 /dev/null 2024-05-08T20:03:51.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.376 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj37 /dev/null 2024-05-08T20:03:51.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj38 /dev/null 2024-05-08T20:03:51.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.661 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj39 /dev/null 2024-05-08T20:03:51.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.752 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj40 /dev/null 2024-05-08T20:03:51.843 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.844 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj41 /dev/null 2024-05-08T20:03:51.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:51.986 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj42 /dev/null 2024-05-08T20:03:52.136 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.137 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj43 /dev/null 2024-05-08T20:03:52.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.228 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj44 /dev/null 2024-05-08T20:03:52.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj45 /dev/null 2024-05-08T20:03:52.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj46 /dev/null 2024-05-08T20:03:52.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.538 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj47 /dev/null 2024-05-08T20:03:52.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj48 /dev/null 2024-05-08T20:03:52.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.704 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj49 /dev/null 2024-05-08T20:03:52.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.787 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj50 /dev/null 2024-05-08T20:03:52.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.871 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj51 /dev/null 2024-05-08T20:03:52.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:52.998 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj52 /dev/null 2024-05-08T20:03:53.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj53 /dev/null 2024-05-08T20:03:53.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.165 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj54 /dev/null 2024-05-08T20:03:53.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.247 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj55 /dev/null 2024-05-08T20:03:53.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj56 /dev/null 2024-05-08T20:03:53.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.466 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj57 /dev/null 2024-05-08T20:03:53.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj58 /dev/null 2024-05-08T20:03:53.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj59 /dev/null 2024-05-08T20:03:53.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj60 /dev/null 2024-05-08T20:03:53.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:53.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj61 /dev/null 2024-05-08T20:03:54.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.067 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj62 /dev/null 2024-05-08T20:03:54.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.176 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj63 /dev/null 2024-05-08T20:03:54.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.267 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj64 /dev/null 2024-05-08T20:03:54.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.359 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj65 /dev/null 2024-05-08T20:03:54.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.485 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj66 /dev/null 2024-05-08T20:03:54.576 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.577 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj67 /dev/null 2024-05-08T20:03:54.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj68 /dev/null 2024-05-08T20:03:54.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.761 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj69 /dev/null 2024-05-08T20:03:54.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.853 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj70 /dev/null 2024-05-08T20:03:54.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:54.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj71 /dev/null 2024-05-08T20:03:55.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.069 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj72 /dev/null 2024-05-08T20:03:55.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.161 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj73 /dev/null 2024-05-08T20:03:55.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.254 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj74 /dev/null 2024-05-08T20:03:55.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.379 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj75 /dev/null 2024-05-08T20:03:55.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj76 /dev/null 2024-05-08T20:03:55.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.637 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj77 /dev/null 2024-05-08T20:03:55.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.720 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj78 /dev/null 2024-05-08T20:03:55.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.795 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj79 /dev/null 2024-05-08T20:03:55.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:55.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj80 /dev/null 2024-05-08T20:03:56.080 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.081 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj81 /dev/null 2024-05-08T20:03:56.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.164 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj82 /dev/null 2024-05-08T20:03:56.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.248 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj83 /dev/null 2024-05-08T20:03:56.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.331 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj84 /dev/null 2024-05-08T20:03:56.456 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.457 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj85 /dev/null 2024-05-08T20:03:56.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.548 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj86 /dev/null 2024-05-08T20:03:56.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.632 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj87 /dev/null 2024-05-08T20:03:56.723 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.724 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj88 /dev/null 2024-05-08T20:03:56.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.858 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj89 /dev/null 2024-05-08T20:03:56.949 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:56.950 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj90 /dev/null 2024-05-08T20:03:57.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj91 /dev/null 2024-05-08T20:03:57.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj92 /dev/null 2024-05-08T20:03:57.216 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.217 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj93 /dev/null 2024-05-08T20:03:57.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj94 /dev/null 2024-05-08T20:03:57.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.451 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj95 /dev/null 2024-05-08T20:03:57.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj96 /dev/null 2024-05-08T20:03:57.659 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj97 /dev/null 2024-05-08T20:03:57.742 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.743 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj98 /dev/null 2024-05-08T20:03:57.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:57.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj99 /dev/null 2024-05-08T20:03:58.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj100 /dev/null 2024-05-08T20:03:58.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj101 /dev/null 2024-05-08T20:03:58.219 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj102 /dev/null 2024-05-08T20:03:58.311 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj103 /dev/null 2024-05-08T20:03:58.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.438 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj104 /dev/null 2024-05-08T20:03:58.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj105 /dev/null 2024-05-08T20:03:58.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj106 /dev/null 2024-05-08T20:03:58.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.713 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj107 /dev/null 2024-05-08T20:03:58.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj108 /dev/null 2024-05-08T20:03:58.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:58.929 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj109 /dev/null 2024-05-08T20:03:59.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.014 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj110 /dev/null 2024-05-08T20:03:59.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.096 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj111 /dev/null 2024-05-08T20:03:59.214 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.215 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj112 /dev/null 2024-05-08T20:03:59.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.340 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj113 /dev/null 2024-05-08T20:03:59.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.450 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj114 /dev/null 2024-05-08T20:03:59.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.557 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj115 /dev/null 2024-05-08T20:03:59.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.649 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj116 /dev/null 2024-05-08T20:03:59.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.783 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj117 /dev/null 2024-05-08T20:03:59.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:03:59.874 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj118 /dev/null 2024-05-08T20:04:00.033 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj119 /dev/null 2024-05-08T20:04:00.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj120 /dev/null 2024-05-08T20:04:00.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.208 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj121 /dev/null 2024-05-08T20:04:00.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.326 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj122 /dev/null 2024-05-08T20:04:00.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.418 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj123 /dev/null 2024-05-08T20:04:00.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.509 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj124 /dev/null 2024-05-08T20:04:00.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.601 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj125 /dev/null 2024-05-08T20:04:00.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.727 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj126 /dev/null 2024-05-08T20:04:00.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.819 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj127 /dev/null 2024-05-08T20:04:00.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:00.911 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj128 /dev/null 2024-05-08T20:04:01.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj129 /dev/null 2024-05-08T20:04:01.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.094 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj130 /dev/null 2024-05-08T20:04:01.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.220 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj131 /dev/null 2024-05-08T20:04:01.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.312 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj132 /dev/null 2024-05-08T20:04:01.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.403 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj133 /dev/null 2024-05-08T20:04:01.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.554 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj134 /dev/null 2024-05-08T20:04:01.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj135 /dev/null 2024-05-08T20:04:01.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.771 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj136 /dev/null 2024-05-08T20:04:01.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:01.862 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj137 /dev/null 2024-05-08T20:04:02.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.047 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj138 /dev/null 2024-05-08T20:04:02.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj139 /dev/null 2024-05-08T20:04:02.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.264 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj140 /dev/null 2024-05-08T20:04:02.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.349 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj141 /dev/null 2024-05-08T20:04:02.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.440 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj142 /dev/null 2024-05-08T20:04:02.532 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.533 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj143 /dev/null 2024-05-08T20:04:02.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj144 /dev/null 2024-05-08T20:04:02.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.749 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj145 /dev/null 2024-05-08T20:04:02.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.849 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj146 /dev/null 2024-05-08T20:04:02.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:02.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj147 /dev/null 2024-05-08T20:04:03.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj148 /dev/null 2024-05-08T20:04:03.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj149 /dev/null 2024-05-08T20:04:03.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj150 /dev/null 2024-05-08T20:04:03.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj151 /dev/null 2024-05-08T20:04:03.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.449 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj152 /dev/null 2024-05-08T20:04:03.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.568 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj153 /dev/null 2024-05-08T20:04:03.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.660 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj154 /dev/null 2024-05-08T20:04:03.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.777 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj155 /dev/null 2024-05-08T20:04:03.869 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:03.870 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj156 /dev/null 2024-05-08T20:04:04.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.036 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj157 /dev/null 2024-05-08T20:04:04.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.128 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj158 /dev/null 2024-05-08T20:04:04.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.253 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj159 /dev/null 2024-05-08T20:04:04.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.345 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj160 /dev/null 2024-05-08T20:04:04.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.437 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj161 /dev/null 2024-05-08T20:04:04.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.529 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj162 /dev/null 2024-05-08T20:04:04.620 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.621 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj163 /dev/null 2024-05-08T20:04:04.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.746 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj164 /dev/null 2024-05-08T20:04:04.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.838 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj165 /dev/null 2024-05-08T20:04:04.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:04.930 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj166 /dev/null 2024-05-08T20:04:05.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.013 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj167 /dev/null 2024-05-08T20:04:05.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.097 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj168 /dev/null 2024-05-08T20:04:05.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.231 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj169 /dev/null 2024-05-08T20:04:05.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.322 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj170 /dev/null 2024-05-08T20:04:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.415 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj171 /dev/null 2024-05-08T20:04:05.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.549 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj172 /dev/null 2024-05-08T20:04:05.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj173 /dev/null 2024-05-08T20:04:05.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.766 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj174 /dev/null 2024-05-08T20:04:05.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:05.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj175 /dev/null 2024-05-08T20:04:06.034 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj176 /dev/null 2024-05-08T20:04:06.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.125 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj177 /dev/null 2024-05-08T20:04:06.250 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.251 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj178 /dev/null 2024-05-08T20:04:06.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.342 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj179 /dev/null 2024-05-08T20:04:06.433 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.434 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj180 /dev/null 2024-05-08T20:04:06.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.526 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj181 /dev/null 2024-05-08T20:04:06.617 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj182 /dev/null 2024-05-08T20:04:06.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.744 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj183 /dev/null 2024-05-08T20:04:06.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.835 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj184 /dev/null 2024-05-08T20:04:06.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:06.927 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj185 /dev/null 2024-05-08T20:04:07.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.019 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj186 /dev/null 2024-05-08T20:04:07.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.169 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj187 /dev/null 2024-05-08T20:04:07.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.261 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj188 /dev/null 2024-05-08T20:04:07.352 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.353 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj189 /dev/null 2024-05-08T20:04:07.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.465 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj190 /dev/null 2024-05-08T20:04:07.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.596 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj191 /dev/null 2024-05-08T20:04:07.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj192 /dev/null 2024-05-08T20:04:07.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.812 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj193 /dev/null 2024-05-08T20:04:07.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:07.997 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj194 /dev/null 2024-05-08T20:04:08.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:08.543 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj195 /dev/null 2024-05-08T20:04:08.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:08.657 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj196 /dev/null 2024-05-08T20:04:08.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:08.782 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj197 /dev/null 2024-05-08T20:04:08.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:08.873 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj198 /dev/null 2024-05-08T20:04:08.965 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:08.966 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj199 /dev/null 2024-05-08T20:04:09.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-05-08T20:04:09.057 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj200 /dev/null 2024-05-08T20:04:09.183 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:203: TEST_backfill_sizeup_out: get_pg test obj1 2024-05-08T20:04:09.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2024-05-08T20:04:09.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=obj1 2024-05-08T20:04:09.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test obj1 2024-05-08T20:04:09.184 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2024-05-08T20:04:09.616 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:203: TEST_backfill_sizeup_out: local PG=1.0 2024-05-08T20:04:09.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:205: TEST_backfill_sizeup_out: get_primary test obj1 2024-05-08T20:04:09.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=test 2024-05-08T20:04:09.617 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=obj1 2024-05-08T20:04:09.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map test obj1 2024-05-08T20:04:09.618 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2024-05-08T20:04:10.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:205: TEST_backfill_sizeup_out: local primary=1 2024-05-08T20:04:10.113 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:207: TEST_backfill_sizeup_out: ceph osd set nobackfill 2024-05-08T20:04:10.892 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is set 2024-05-08T20:04:10.913 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:208: TEST_backfill_sizeup_out: ceph osd out osd.1 2024-05-08T20:04:11.611 INFO:tasks.workunit.client.0.smithi117.stderr:osd.1 is already out. 2024-05-08T20:04:11.631 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:209: TEST_backfill_sizeup_out: ceph osd pool set test size 3 2024-05-08T20:04:12.818 INFO:tasks.workunit.client.0.smithi117.stderr:set pool 1 size to 3 2024-05-08T20:04:12.841 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:210: TEST_backfill_sizeup_out: sleep 2 2024-05-08T20:04:14.842 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:211: TEST_backfill_sizeup_out: ceph osd unset nobackfill 2024-05-08T20:04:15.630 INFO:tasks.workunit.client.0.smithi117.stderr:nobackfill is unset 2024-05-08T20:04:15.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:213: TEST_backfill_sizeup_out: wait_for_clean 2024-05-08T20:04:15.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: wait_for_clean: local cmd= 2024-05-08T20:04:15.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_clean: local num_active_clean=-1 2024-05-08T20:04:15.655 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: local cur_active_clean 2024-05-08T20:04:15.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: get_timeout_delays 90 .1 2024-05-08T20:04:15.656 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: shopt -q -o xtrace 2024-05-08T20:04:15.656 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: echo true 2024-05-08T20:04:15.656 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: get_timeout_delays: local trace=true 2024-05-08T20:04:15.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: true 2024-05-08T20:04:15.657 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: get_timeout_delays: shopt -u -o xtrace 2024-05-08T20:04:15.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-05-08T20:04:15.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1645: wait_for_clean: local -a delays 2024-05-08T20:04:15.775 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1646: wait_for_clean: local -i loop=0 2024-05-08T20:04:15.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: flush_pg_stats 2024-05-08T20:04:15.776 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2197: flush_pg_stats: local timeout=300 2024-05-08T20:04:15.776 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ceph osd ls 2024-05-08T20:04:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2199: flush_pg_stats: ids='0 2024-05-08T20:04:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:1 2024-05-08T20:04:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:2 2024-05-08T20:04:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:3 2024-05-08T20:04:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:4 2024-05-08T20:04:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:5' 2024-05-08T20:04:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2200: flush_pg_stats: seqs= 2024-05-08T20:04:16.358 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:04:16.359 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-05-08T20:04:16.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=21474836545 2024-05-08T20:04:16.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 21474836545 2024-05-08T20:04:16.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836545' 2024-05-08T20:04:16.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:04:16.518 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-05-08T20:04:16.705 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=42949673018 2024-05-08T20:04:16.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 42949673018 2024-05-08T20:04:16.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836545 1-42949673018' 2024-05-08T20:04:16.706 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:04:16.706 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-05-08T20:04:16.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=64424509489 2024-05-08T20:04:16.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 64424509489 2024-05-08T20:04:16.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836545 1-42949673018 2-64424509489' 2024-05-08T20:04:16.867 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:04:16.867 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-05-08T20:04:17.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=85899345954 2024-05-08T20:04:17.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 85899345954 2024-05-08T20:04:17.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836545 1-42949673018 2-64424509489 3-85899345954' 2024-05-08T20:04:17.025 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:04:17.025 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-05-08T20:04:17.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=107374182425 2024-05-08T20:04:17.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 107374182425 2024-05-08T20:04:17.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836545 1-42949673018 2-64424509489 3-85899345954 4-107374182425' 2024-05-08T20:04:17.177 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2201: flush_pg_stats: for osd in $ids 2024-05-08T20:04:17.177 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-05-08T20:04:17.333 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2202: flush_pg_stats: seq=128849018898 2024-05-08T20:04:17.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2203: flush_pg_stats: test -z 128849018898 2024-05-08T20:04:17.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: seqs=' 0-21474836545 1-42949673018 2-64424509489 3-85899345954 4-107374182425 5-128849018898' 2024-05-08T20:04:17.334 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:04:17.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 0-21474836545 2024-05-08T20:04:17.334 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:04:17.336 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=0 2024-05-08T20:04:17.336 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 0-21474836545 2024-05-08T20:04:17.337 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:04:17.337 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=21474836545 2024-05-08T20:04:17.338 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.0 seq 21474836545 2024-05-08T20:04:17.338 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.0 seq 21474836545' 2024-05-08T20:04:17.338 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 0 2024-05-08T20:04:17.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 21474836546 -lt 21474836545 2024-05-08T20:04:17.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:04:17.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 1-42949673018 2024-05-08T20:04:17.856 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:04:17.857 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=1 2024-05-08T20:04:17.857 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 1-42949673018 2024-05-08T20:04:17.858 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:04:17.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=42949673018 2024-05-08T20:04:17.859 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.1 seq 42949673018' 2024-05-08T20:04:17.859 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.1 seq 42949673018 2024-05-08T20:04:17.859 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 1 2024-05-08T20:04:18.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 42949673018 -lt 42949673018 2024-05-08T20:04:18.582 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:04:18.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 2-64424509489 2024-05-08T20:04:18.583 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:04:18.585 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=2 2024-05-08T20:04:18.586 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 2-64424509489 2024-05-08T20:04:18.586 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:04:18.587 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=64424509489 2024-05-08T20:04:18.587 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.2 seq 64424509489 2024-05-08T20:04:18.588 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.2 seq 64424509489' 2024-05-08T20:04:18.588 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 2 2024-05-08T20:04:19.275 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 64424509489 -lt 64424509489 2024-05-08T20:04:19.276 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:04:19.276 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 3-85899345954 2024-05-08T20:04:19.277 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:04:19.278 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=3 2024-05-08T20:04:19.279 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 3-85899345954 2024-05-08T20:04:19.279 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:04:19.280 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=85899345954 2024-05-08T20:04:19.280 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.3 seq 85899345954 2024-05-08T20:04:19.281 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.3 seq 85899345954' 2024-05-08T20:04:19.281 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 3 2024-05-08T20:04:19.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 85899345955 -lt 85899345954 2024-05-08T20:04:19.982 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:04:19.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 4-107374182425 2024-05-08T20:04:19.983 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:04:19.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=4 2024-05-08T20:04:19.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 4-107374182425 2024-05-08T20:04:19.986 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:04:19.987 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.4 seq 107374182425 2024-05-08T20:04:19.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=107374182425 2024-05-08T20:04:19.987 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.4 seq 107374182425' 2024-05-08T20:04:19.987 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 4 2024-05-08T20:04:20.663 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 107374182425 -lt 107374182425 2024-05-08T20:04:20.664 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: for s in $seqs 2024-05-08T20:04:20.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: echo 5-128849018898 2024-05-08T20:04:20.664 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: cut -d - -f 1 2024-05-08T20:04:20.666 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: osd=5 2024-05-08T20:04:20.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: echo 5-128849018898 2024-05-08T20:04:20.667 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: cut -d - -f 2 2024-05-08T20:04:20.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2212: flush_pg_stats: seq=128849018898 2024-05-08T20:04:20.669 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: echo 'waiting osd.5 seq 128849018898' 2024-05-08T20:04:20.670 INFO:tasks.workunit.client.0.smithi117.stdout:waiting osd.5 seq 128849018898 2024-05-08T20:04:20.670 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: ceph osd last-stat-seq 5 2024-05-08T20:04:21.238 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2214: flush_pg_stats: test 128849018899 -lt 128849018898 2024-05-08T20:04:21.238 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-05-08T20:04:21.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:21.239 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:22.138 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 == 0 2024-05-08T20:04:22.139 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:22.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:22.139 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:22.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:22.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:22.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:22.140 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:22.654 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:22.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:22.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:22.655 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' -1 2024-05-08T20:04:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: loop=0 2024-05-08T20:04:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: num_active_clean=0 2024-05-08T20:04:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:23.265 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:23.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:23.366 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:23.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:23.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:23.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:23.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:23.367 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:23.368 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:24.032 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:24.032 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:24.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:24.033 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:24.682 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:24.683 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:24.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:24.683 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:25.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=0 2024-05-08T20:04:25.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 0 '!=' null 2024-05-08T20:04:25.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:25.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:25.524 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:25.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:25.626 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:25.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:25.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:25.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:25.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:25.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:25.628 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:26.076 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:26.077 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:26.077 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:26.077 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:26.673 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:26.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:26.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:26.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:26.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:26.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:26.674 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:26.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:26.675 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:27.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T20:04:27.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T20:04:27.517 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:27.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:27.518 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:27.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:27.618 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:27.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:27.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:27.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:27.619 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:27.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:27.620 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:28.035 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:28.035 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:28.036 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:28.036 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:28.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:28.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:28.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:28.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:28.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:28.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:28.686 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:28.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:28.687 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:29.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T20:04:29.498 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T20:04:29.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:29.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:29.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:29.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:29.600 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:29.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:29.601 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:29.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:29.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:29.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:29.602 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:30.124 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:30.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:30.124 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:30.125 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:30.799 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:30.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:30.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:30.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:30.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:30.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:30.800 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:30.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:30.800 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:31.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2024-05-08T20:04:31.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2024-05-08T20:04:31.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:31.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:31.613 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:31.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:31.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:31.715 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:31.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:31.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:31.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:31.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:31.716 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:32.223 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:32.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:32.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:32.224 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:32.923 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:33.545 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=4 2024-05-08T20:04:33.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 4 '!=' null 2024-05-08T20:04:33.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:33.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:33.546 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:33.646 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:33.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:33.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:33.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:33.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:33.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:33.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:33.648 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:34.297 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:34.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:34.298 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:34.299 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:34.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:34.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:34.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:34.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:34.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:34.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:34.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:34.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:34.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:35.759 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:35.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:35.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:35.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:35.760 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:35.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:35.861 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:35.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:35.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:35.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:35.862 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:35.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:35.863 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:36.266 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:36.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:36.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:36.267 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:36.990 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:36.990 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:36.991 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:37.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:37.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:37.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:37.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:37.855 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:37.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:37.956 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:37.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:37.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:37.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:37.957 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:37.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:37.958 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:38.404 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:38.404 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:38.404 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:38.404 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:38.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:38.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:38.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:38.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:38.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:38.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:38.946 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:38.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:38.947 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:39.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:39.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:39.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:39.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:39.879 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:39.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:39.980 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:39.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:39.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:39.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:39.981 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:39.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:39.982 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:40.536 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:40.536 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:40.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:40.537 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:41.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:41.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:41.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:41.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:41.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:41.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:41.324 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:41.324 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:41.325 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:41.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T20:04:41.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T20:04:41.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:41.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:41.919 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:42.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:42.021 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:42.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:42.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:42.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:42.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:42.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:42.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:42.431 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:42.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:42.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:42.431 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:42.993 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:42.994 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:42.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:42.994 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:43.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:43.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:43.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:43.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:43.896 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:43.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:43.999 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:43.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:43.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:43.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:43.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:43.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:43.999 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:44.420 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:44.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:44.420 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:44.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:45.083 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:45.084 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:45.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:45.084 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:45.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:45.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:45.687 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:45.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:45.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:45.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:45.788 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:45.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:45.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:45.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:45.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:45.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:45.789 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:46.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:46.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:46.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:46.179 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:46.688 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:46.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:46.689 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:46.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:46.689 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T20:04:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T20:04:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:47.401 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:47.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:47.502 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:47.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:47.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:47.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:47.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:47.503 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:47.504 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:48.166 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:48.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:48.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:48.167 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:48.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:48.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:48.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:48.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:48.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:48.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:48.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:48.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:48.833 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:49.382 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:49.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:49.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:49.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:49.383 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:49.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:49.482 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:49.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:49.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:49.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:49.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:49.483 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:49.484 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:50.135 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:50.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:50.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:50.136 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:50.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:50.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:50.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:50.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:50.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:50.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:50.880 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:50.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:50.881 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:51.784 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:51.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:51.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:51.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:51.785 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:51.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:51.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:51.887 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:51.887 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:51.887 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:51.887 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:51.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:51.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:52.307 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:52.308 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:52.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:52.309 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:52.985 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:53.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:53.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:53.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:53.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:53.839 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:53.940 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:53.941 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:53.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:53.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:53.941 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:53.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:53.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:53.942 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:54.368 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:54.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:54.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:54.369 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:54.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:54.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:54.991 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:54.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:54.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:54.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:54.992 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:54.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:54.992 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:55.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T20:04:55.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T20:04:55.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:55.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:55.900 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:56.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:56.001 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:56.001 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:56.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:56.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:56.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:56.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:56.002 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:56.421 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:56.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:56.421 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:56.422 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:56.976 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:56.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:56.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:56.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:56.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:56.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:56.977 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:56.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:56.977 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:57.692 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T20:04:57.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T20:04:57.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:57.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:57.693 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:04:57.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:04:57.794 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:04:57.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:04:57.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:04:57.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:04:57.795 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:04:57.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:04:57.796 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:04:58.292 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:04:58.292 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:04:58.293 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:04:58.293 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:04:59.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:04:59.042 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:04:59.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:04:59.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:04:59.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:04:59.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:04:59.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:04:59.043 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:04:59.043 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:04:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:04:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:04:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:04:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:04:59.942 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:05:00.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:05:00.043 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:05:00.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:05:00.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:05:00.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:05:00.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:05:00.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:05:00.044 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:05:00.481 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:05:00.481 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:05:00.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:05:00.482 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:05:01.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:05:01.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:05:01.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:05:01.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:05:01.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:05:01.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:05:01.003 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:05:01.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:05:01.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:05:01.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T20:05:01.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T20:05:01.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:05:01.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:05:01.901 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:05:02.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:05:02.002 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:05:02.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:05:02.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:05:02.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:05:02.003 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:05:02.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:05:02.004 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:05:02.494 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:05:02.494 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:05:02.495 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:05:02.495 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:05:03.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:05:03.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:05:03.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:05:03.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:05:03.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:05:03.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:05:03.027 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:05:03.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:05:03.028 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:05:03.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:05:03.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:05:03.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:05:03.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:05:03.910 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:05:04.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:05:04.011 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:05:04.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:05:04.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:05:04.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:05:04.012 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:05:04.013 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:05:04.013 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:05:04.436 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:05:04.436 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:05:04.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:05:04.437 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:05:05.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:05:05.178 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:05:05.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:05:05.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:05:05.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:05:05.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:05:05.179 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:05:05.180 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:05:05.180 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:05:05.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=3 2024-05-08T20:05:05.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 3 '!=' null 2024-05-08T20:05:05.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:05:05.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:05:05.823 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:05:05.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:05:05.924 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:05:05.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:05:05.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:05:05.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:05:05.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:05:05.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:05:05.925 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:05:06.339 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=0 2024-05-08T20:05:06.339 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:05:06.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:05:06.340 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 0 = 1 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: test 0 '!=' 0 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_is_making_recovery_progress 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2024-05-08T20:05:06.973 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-05-08T20:05:07.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=5 2024-05-08T20:05:07.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 5 '!=' null 2024-05-08T20:05:07.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: loop=0 2024-05-08T20:05:07.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: eval 2024-05-08T20:05:07.488 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: sleep 0.1 2024-05-08T20:05:07.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: loop+=1 2024-05-08T20:05:07.589 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: true 2024-05-08T20:05:07.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: get_num_active_clean 2024-05-08T20:05:07.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2024-05-08T20:05:07.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-05-08T20:05:07.590 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-05-08T20:05:07.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2024-05-08T20:05:07.591 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-05-08T20:05:08.020 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: cur_active_clean=1 2024-05-08T20:05:08.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: get_num_pgs 2024-05-08T20:05:08.021 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2024-05-08T20:05:08.022 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2024-05-08T20:05:08.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: test 1 = 1 2024-05-08T20:05:08.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: break 2024-05-08T20:05:08.639 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: return 0 2024-05-08T20:05:08.640 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:215: TEST_backfill_sizeup_out: expr 200 '*' 2 2024-05-08T20:05:08.641 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:215: TEST_backfill_sizeup_out: local degraded=400 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:216: TEST_backfill_sizeup_out: check td/osd-backfill-stats 1.0 1 replicated 400 0 200 0 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=400 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=200 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-05-08T20:05:08.642 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-05-08T20:05:08.643 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-05-08T20:05:08.643 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.647 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-05-08T20:05:08.647 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-05-08T20:05:08.665 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.666 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-05-08T20:05:08.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-05-08T20:05:08.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-05-08T20:05:08.668 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-05-08T20:05:08.669 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-05-08T20:05:08.669 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.669 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-05-08T20:05:08.669 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-05-08T20:05:08.694 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[0,2,4]/[1]' 2024-05-08T20:05:08.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[0,2,4]/[1]' ']' 2024-05-08T20:05:08.695 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-05-08T20:05:08.695 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T20:05:08.696 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.696 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [0,2,4]/[1] ' 2024-05-08T20:05:08.696 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-05-08T20:05:08.696 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-05-08T20:05:08.696 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T20:05:08.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=400 2024-05-08T20:05:08.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2024-05-08T20:05:08.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 400 400 2024-05-08T20:05:08.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-05-08T20:05:08.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T20:05:08.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-05-08T20:05:08.701 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T20:05:08.701 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T20:05:08.702 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.702 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-05-08T20:05:08.702 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T20:05:08.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=2 2024-05-08T20:05:08.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2024-05-08T20:05:08.714 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 2 0 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [0,2,4]/[1] ' 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-05-08T20:05:08.715 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-05-08T20:05:08.716 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T20:05:08.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=200 2024-05-08T20:05:08.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2024-05-08T20:05:08.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 200 200 2024-05-08T20:05:08.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-05-08T20:05:08.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-05-08T20:05:08.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-05-08T20:05:08.721 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-05-08T20:05:08.721 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-05-08T20:05:08.722 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-05-08T20:05:08.722 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-05-08T20:05:08.722 INFO:tasks.workunit.client.0.smithi117.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=1 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 1 0 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-05-08T20:05:08.733 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:218: TEST_backfill_sizeup_out: delete_pool test 2024-05-08T20:05:08.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2024-05-08T20:05:08.734 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-05-08T20:05:09.479 INFO:tasks.workunit.client.0.smithi117.stderr:pool 'test' does not exist 2024-05-08T20:05:09.499 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:219: TEST_backfill_sizeup_out: kill_daemons td/osd-backfill-stats 2024-05-08T20:05:09.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T20:05:09.500 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T20:05:09.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T20:05:09.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T20:05:09.500 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T20:05:11.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T20:05:11.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-05-08T20:05:11.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T20:05:11.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2024-05-08T20:05:11.817 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T20:05:11.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T20:05:11.818 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T20:05:11.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T20:05:11.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T20:05:11.818 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T20:05:11.829 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T20:05:11.830 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T20:05:11.830 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T20:05:11.831 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T20:05:11.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T20:05:11.832 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T20:05:11.832 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T20:05:11.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:05:11.833 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T20:05:11.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T20:05:11.834 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:05:11.834 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:05:11.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2024-05-08T20:05:11.836 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T20:05:11.882 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T20:05:11.882 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T20:05:11.883 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T20:05:11.883 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T20:05:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T20:05:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T20:05:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2314: main: code=0 2024-05-08T20:05:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: teardown td/osd-backfill-stats 0 2024-05-08T20:05:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-backfill-stats 2024-05-08T20:05:11.884 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2024-05-08T20:05:11.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-backfill-stats KILL 2024-05-08T20:05:11.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2024-05-08T20:05:11.885 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2024-05-08T20:05:11.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2024-05-08T20:05:11.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2024-05-08T20:05:11.885 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2024-05-08T20:05:11.886 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2024-05-08T20:05:11.886 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2024-05-08T20:05:11.887 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2024-05-08T20:05:11.887 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2024-05-08T20:05:11.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2024-05-08T20:05:11.888 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2024-05-08T20:05:11.888 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2024-05-08T20:05:11.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:05:11.889 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2024-05-08T20:05:11.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2024-05-08T20:05:11.890 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:05:11.890 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:05:11.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2024-05-08T20:05:11.891 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-backfill-stats 2024-05-08T20:05:11.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2024-05-08T20:05:11.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2024-05-08T20:05:11.893 INFO:tasks.workunit.client.0.smithi117.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.473885 2024-05-08T20:05:11.893 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.473885 2024-05-08T20:05:11.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2024-05-08T20:05:11.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2024-05-08T20:05:11.894 INFO:tasks.workunit.client.0.smithi117.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2319: main: return 0 2024-05-08T20:05:11.895 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T20:05:11.895 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T20:05:11.952 INFO:tasks.workunit:Stopping ['osd-backfill'] on client.0... 2024-05-08T20:05:11.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T20:05:12.271 DEBUG:teuthology.parallel:result is None 2024-05-08T20:05:12.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:05:12.284 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:05:12.284 DEBUG:teuthology.orchestra.run.smithi117:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-08T20:05:12.351 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:05:12.402 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T20:05:12.415 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T20:05:12.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T20:05:12.453 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T20:05:12.464 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T20:05:12.464 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:05:12.482 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T20:05:12.482 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-05-08T20:05:12.482 INFO:teuthology.orchestra.run.smithi117.stdout:*hv01.front.sepi 67.205.162.81 3 u 51 256 377 0.147 -1.908 0.582 2024-05-08T20:05:12.483 INFO:teuthology.orchestra.run.smithi117.stdout:+hv02.front.sepi 63.231.80.2 3 u 219 256 377 0.157 -0.448 0.354 2024-05-08T20:05:12.483 INFO:teuthology.orchestra.run.smithi117.stdout:+hv03.front.sepi 74.6.168.72 3 u 229 256 377 0.149 -0.995 0.318 2024-05-08T20:05:12.483 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-08T20:05:12.484 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T20:05:12.494 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T20:05:12.495 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T20:05:12.508 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T20:05:12.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T20:05:12.536 INFO:teuthology.task.internal:Duration was 10377.443758 seconds 2024-05-08T20:05:12.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T20:05:12.550 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T20:05:12.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T20:05:12.588 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T20:05:12.588 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:05:12.588 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T20:05:12.639 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T20:05:12.639 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:05:12.718 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T20:05:12.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T20:05:12.816 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T20:05:12.828 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T20:05:12.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T20:05:12.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T20:05:12.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:05:12.955 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-05-08T20:05:12.968 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:05:13.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:05:13.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T20:05:13.028 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T20:05:13.030 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-05-08_14:59:36-rados-wip-lflores-testing-2-2024-05-07-1606-squid-distro-default-smithi/7697765/remote/smithi117 2024-05-08T20:05:13.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T20:05:13.078 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T20:05:13.078 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T20:05:13.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T20:05:13.135 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T20:05:13.135 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T20:05:13.144 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T20:05:13.145 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T20:05:13.170 INFO:teuthology.orchestra.run.smithi117.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 20:05 /home/ubuntu/cephtest 2024-05-08T20:05:13.171 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T20:05:13.184 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T20:05:13.212 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} duration: 10377.443757534027 flavor: default owner: scheduled_lflores@teuthology success: true 2024-05-08T20:05:13.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T20:05:13.286 INFO:teuthology.run:pass